Sep 03 11:06:45 devstack cinder-volume[76070]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 03 11:06:45 devstack cinder-volume[76070]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 03 11:06:45 devstack cinder-volume[76070]: we strongly recommend against using it for new projects. Sep 03 11:06:45 devstack cinder-volume[76070]: If you are already using Eventlet, we recommend migrating to a different Sep 03 11:06:45 devstack cinder-volume[76070]: framework. For more detail see Sep 03 11:06:45 devstack cinder-volume[76070]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 03 11:06:45 devstack cinder-volume[76070]: import eventlet # noqa Sep 03 11:06:48 devstack cinder-volume[76070]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76070) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 11:06:48 devstack cinder-volume[76070]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76070) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 11:06:48 devstack cinder-volume[76070]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76070) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 11:06:48 devstack cinder-volume[76070]: INFO dbcounter [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] Registered counter for database cinder Sep 03 11:06:49 devstack cinder-volume[76070]: DEBUG oslo_db.sqlalchemy.engines [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76070) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 11:06:49 devstack cinder-volume[76070]: DEBUG dbcounter [-] [76070] Writer thread running {{(pid=76070) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 03 11:06:49 devstack cinder-volume[76070]: INFO cinder.rpc [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 03 11:06:49 devstack cinder-volume[76070]: INFO cinder.rpc [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 03 11:06:49 devstack cinder-volume[76070]: DEBUG oslo_db.sqlalchemy.engines [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76070) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 11:06:49 devstack cinder-volume[76070]: INFO cinder.volume.manager [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] Determined volume DB was empty at startup. Sep 03 11:06:49 devstack cinder-volume[76070]: DEBUG cinder.volume.manager [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76070) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 03 11:06:49 devstack cinder-volume[76070]: INFO cinder.volume.manager [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 03 11:06:49 devstack cinder-volume[76070]: WARNING stevedore.named [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 03 11:06:49 devstack cinder-volume[76070]: WARNING castellan.key_manager [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 11:06:49 devstack cinder-volume[76070]: WARNING cinder.keymgr.conf_key_mgr [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 11:06:49 devstack cinder-volume[76070]: DEBUG cinder.volume.drivers.lvm [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76070) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 03 11:06:49 devstack cinder-volume[76070]: DEBUG oslo_concurrency.processutils [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_concurrency.processutils [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] CMD "cinder-rtstool verify" returned: 0 in 0.455s {{(pid=76070) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_db.sqlalchemy.engines [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76070) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 11:06:50 devstack cinder-volume[76070]: INFO cinder.rpc [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 03 11:06:50 devstack cinder-volume[76070]: INFO cinder.rpc [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 03 11:06:50 devstack cinder-volume[76070]: WARNING stevedore.named [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 03 11:06:50 devstack cinder-volume[76070]: WARNING castellan.key_manager [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 11:06:50 devstack cinder-volume[76070]: INFO cinder.volume.manager [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_db.sqlalchemy.engines [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76070) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 11:06:50 devstack cinder-volume[76070]: INFO oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] Starting 1 workers Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] Started child 76222 {{(pid=76070) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] Full set of CONF: {{(pid=76070) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] ******************************************************************************** {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] Configuration options gathered from: {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] ================================================================================ {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] allow_availability_zone_fallback = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] allow_compression_on_image_upload = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] allowed_direct_url_schemes = [] {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] api_rate_limit = True {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] auth_strategy = keystone {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] az_cache_duration = 3600 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_availability_zone = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_host = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_name = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_stats_polling_interval = 60 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backup_api_class = cinder.backup.api.API {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backup_name_template = backup-%s {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backup_use_same_host = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backup_use_temp_snapshot = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] chap_password = **** {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] chap_username = {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cinder_internal_tenant_project_id = 145c261a0e3345208db4dacc12404439 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cinder_internal_tenant_user_id = 45b463bb8bfd455e8f2fff349a41e06e {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cloned_volume_same_az = True {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76222]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cluster = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] compression_format = gzip {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] compute_api_class = cinder.compute.nova.API {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] config_dir = [] {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] config_source = [] {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] control_exchange = openstack {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] debug = True {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] default_availability_zone = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] default_group_type = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] default_volume_type = lvmdriver-1 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] disk_geometry = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] driver_client_cert = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] driver_client_cert_key = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] driver_data_namespace = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] driver_ssl_cert_path = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] driver_ssl_cert_verify = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] driver_use_ssl = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] enable_force_upload = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] enable_new_services = True {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] enable_unsupported_driver = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] enabled_backends = ['lvmdriver-1'] {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] enforce_multipath_for_image_xfer = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] filter_function = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] glance_api_insecure = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] glance_api_servers = ['http://192.168.122.194/image'] {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] glance_api_ssl_compression = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] glance_ca_certificates_file = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] glance_catalog_info = image:glance:publicURL {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] glance_certfile = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] glance_keyfile = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] glance_num_retries = 3 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] glance_request_timeout = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] goodness_function = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] graceful_shutdown_timeout = 5 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] group_api_class = cinder.group.api.API {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] host = devstack {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] image_compress_on_upload = True {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] image_conversion_address_space_limit = 1 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] image_conversion_cpu_limit = 60 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] image_conversion_disable = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] image_upload_use_cinder_backend = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] image_upload_use_internal_tenant = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] image_volume_cache_enabled = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] image_volume_cache_max_count = 0 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] image_volume_cache_max_size_gb = 0 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] init_host_max_objects_retrieval = 0 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] instance_format = [instance: %(uuid)s] {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] iscsi_target_flags = {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] iscsi_write_cache = on {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] iser_helper = tgtadm {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] iser_ip_address = 192.168.122.194 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] iser_port = 3260 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] log_color = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] log_config_append = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] log_dir = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] log_file = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] log_options = True {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] log_rotate_interval = 1 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] log_rotate_interval_type = days {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] log_rotation_type = none {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] max_age = 0 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] max_logfile_count = 30 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] max_logfile_size_mb = 200 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] max_over_subscription_ratio = 20.0 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] message_reap_interval = 86400 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] message_ttl = 2592000 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] migration_create_volume_timeout_secs = 300 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] monkey_patch = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] monkey_patch_modules = [] {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] my_ip = 192.168.122.194 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] no_snapshot_gb_quota = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] num_iser_scan_tries = 3 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] num_shell_tries = 3 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] num_volume_device_scan_tries = 3 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] nvmeof_conn_info_version = 1 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] nvmet_ns_id = 10 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] nvmet_port_id = 1 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] osapi_max_limit = 1000 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] osapi_volume_ext_list = [] {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] osapi_volume_listen = 0.0.0.0 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] osapi_volume_listen_port = 8776 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] osapi_volume_use_ssl = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] osapi_volume_workers = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] per_volume_size_limit = -1 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] periodic_fuzzy_delay = 60 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] periodic_interval = 60 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] project_id_regex = [0-9a-f\-]+ {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] public_endpoint = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] publish_errors = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] quota_backup_gigabytes = 1000 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] quota_backups = 10 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] quota_gigabytes = 1000 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] quota_groups = 10 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] quota_snapshots = 10 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] quota_volumes = 10 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] rate_limit_burst = 0 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] rate_limit_except_level = CRITICAL {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] rate_limit_interval = 0 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] reinit_driver_count = 3 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] replication_device = **** {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] report_discard_supported = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] report_interval = 120 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] reservation_clean_interval = 86400 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] reservation_expire = 86400 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] reserved_image_namespaces = [] {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] reserved_percentage = 0 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] rpc_response_timeout = 120 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] run_external_periodic_tasks = True {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] scst_target_driver = iscsi {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] scst_target_iqn_name = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] service_down_time = 720 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] shell_completion = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] snapshot_name_template = snapshot-%s {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] snapshot_same_host = True {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] split_loggers = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] state_path = /opt/stack/data/cinder {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] storage_availability_zone = nova {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] storage_protocol = iSCSI {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] syslog_log_facility = LOG_USER {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] target_helper = lioadm {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] target_ip_address = 192.168.122.194 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] target_port = 3260 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] target_protocol = iscsi {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] target_secondary_ip_addresses = [] {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] trace_flags = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] transfer_api_class = cinder.transfer.api.API {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] transport_url = **** {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] until_refresh = 0 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] use_chap_auth = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] use_default_quota_class = True {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] use_journal = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] use_json = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] use_multipath_for_image_xfer = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] use_stderr = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] use_syslog = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] verify_glance_signatures = enabled {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] volume_api_class = cinder.volume.api.API {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] volume_backend_name = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] volume_clear = zero {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] volume_clear_ionice = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] volume_clear_size = 0 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] volume_copy_bps_limit = 0 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] volume_dd_blocksize = 1M {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] volume_name_template = volume-%s {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] volume_service_inithost_offload = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] volume_usage_audit_period = month {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] zoning_mode = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_concurrency.disable_process_locking = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.auth_section = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.auth_type = password {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.auth_version = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76222]: INFO cinder.volume.manager [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.cache = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.certfile = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.delay_auth_decision = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.http_connect_timeout = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.include_service_catalog = True {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.insecure = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.interface = public {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.keyfile = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.memcache_password = **** {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.memcache_username = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.region_name = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.service_token_roles_required = True {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.service_type = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.token_cache_time = 300 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.194/identity {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.backend = dogpile.cache.null {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.backend_argument = **** {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.backend_expiration_time = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.config_prefix = cache.oslo {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.debug_cache_backend = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.enable_retry_client = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.enable_socket_keepalive = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.enabled = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.expiration_time = 600 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.hashclient_retry_attempts = 2 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.memcache_dead_retry = 300 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.memcache_pool_maxsize = 10 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.memcache_sasl_enabled = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.password = **** {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.proxies = [] {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.redis_db = 0 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.redis_sentinel_service_name = mymaster {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.redis_server = localhost:6379 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.retry_attempts = 2 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.retry_delay = 0.0 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.socket_keepalive_count = 1 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.socket_keepalive_idle = 1 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.socket_keepalive_interval = 1 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.socket_timeout = 1.0 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.tls_allowed_ciphers = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.tls_cafile = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.tls_certfile = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.tls_enabled = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.tls_keyfile = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cache.username = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.045s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] coordination.backend_url = **** {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] database.asyncio_connection = **** {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] database.asyncio_slave_connection = **** {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] database.backend = sqlalchemy {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] database.connection = **** {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] database.connection_debug = 0 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] database.connection_parameters = {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] database.connection_recycle_time = 3600 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] database.connection_trace = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] database.db_inc_retry_interval = True {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] database.db_max_retries = 20 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] database.db_max_retry_interval = 10 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] database.db_retry_interval = 1 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] database.max_overflow = 50 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] database.max_pool_size = 5 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] database.max_retries = 10 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] database.mysql_wsrep_sync_wait = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] database.pool_timeout = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] database.retry_interval = 10 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] database.slave_connection = **** {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] database.sqlite_synchronous = True {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] database.synchronous_reader = True {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] database.use_db_reconnect = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_tracing.insecure = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] profiler.connection_string = messaging:// {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] profiler.enabled = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] profiler.es_doc_type = notification {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] profiler.es_scroll_size = 10000 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] profiler.es_scroll_time = 2m {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] profiler.filter_error_trace = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] profiler.hmac_keys = **** {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] profiler.sentinel_service_name = mymaster {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] profiler.socket_timeout = 0.1 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] profiler.trace_requests = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] profiler.trace_sqlalchemy = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] profiler_jaeger.process_tags = {} {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] profiler_jaeger.service_name_prefix = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] profiler_otlp.service_name_prefix = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_policy.enforce_new_defaults = True {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_policy.policy_default_rule = default {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_policy.policy_file = policy.yaml {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_policy.remote_timeout = 60.0 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] privsep_osbrick.group = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] privsep_osbrick.helper_command = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] privsep_osbrick.user = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cinder_sys_admin.group = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cinder_sys_admin.helper_command = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] cinder_sys_admin.user = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] service_user.auth_section = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] service_user.auth_type = password {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] service_user.cafile = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] service_user.certfile = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] service_user.collect_timing = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] service_user.insecure = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] service_user.keyfile = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] service_user.send_service_user_token = True {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] service_user.split_loggers = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] service_user.timeout = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] service_user.tls_ciphers = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] service_user.tls_min_version = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] glance.auth_section = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] glance.auth_type = password {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] glance.certfile = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] glance.collect_timing = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] glance.insecure = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] glance.keyfile = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] glance.region_name = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] glance.split_loggers = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] glance.timeout = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] glance.tls_ciphers = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] glance.tls_min_version = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.backend_availability_zone = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.chap_password = **** {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.chap_username = {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.disk_geometry = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.driver_client_cert = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.driver_client_cert_key = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.driver_data_namespace = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.driver_use_ssl = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.enable_unsupported_driver = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.extra_capabilities = {} {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.filter_function = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.goodness_function = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.iscsi_target_flags = {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.iscsi_write_cache = on {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.iser_helper = tgtadm {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.iser_ip_address = 192.168.122.194 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.iser_port = 3260 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:50 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.lvm_mirrors = 0 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.lvm_share_target = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.lvm_type = auto {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.num_shell_tries = 3 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.nvmet_port_id = 1 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.replication_device = **** {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.report_discard_supported = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.reserved_percentage = 0 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.scst_target_driver = iscsi {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.scst_target_iqn_name = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.storage_protocol = iSCSI {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.target_helper = tgtadm {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.target_ip_address = 192.168.122.194 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.target_port = 3260 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.target_protocol = iscsi {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.trace_flags = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.unique_fqdn_network = True {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.use_chap_auth = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.volume_backend_name = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.volume_clear = zero {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.volume_clear_ionice = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.volume_clear_size = 0 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.volume_group = cinder-volumes {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_reports.file_event_handler = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_reports.log_dir = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.backend_availability_zone = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.backend_host = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack sudo[76247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 03 11:06:50 devstack sudo[76247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.chap_password = **** {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.chap_username = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.chiscsi_conf = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.disk_geometry = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.driver_client_cert = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.driver_data_namespace = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.driver_use_ssl = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.extra_capabilities = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.filter_function = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.goodness_function = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.iser_helper = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.iser_ip_address = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.iser_port = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.iser_target_prefix = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.lvm_conf_file = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.lvm_mirrors = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.lvm_share_target = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.lvm_type = auto {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.num_shell_tries = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.nvmet_port_id = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.replication_device = **** {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.report_discard_supported = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.reserved_percentage = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.scst_target_driver = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.storage_protocol = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.target_helper = lioadm {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.target_ip_address = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.target_port = 3260 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.target_protocol = iscsi {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.trace_flags = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.use_chap_auth = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.volume_clear = zero {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.volume_clear_size = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] lvmdriver-1.volumes_dir = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.ssl = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.ssl_version = {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_notifications.driver = [] {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_notifications.retry = -1 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] oslo_messaging_notifications.transport_url = **** {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] key_manager.fixed_key = **** {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] barbican.barbican_api_version = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] barbican.barbican_endpoint = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] barbican.barbican_endpoint_type = public {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] barbican.barbican_region_name = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] barbican.cafile = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] barbican.certfile = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] barbican.collect_timing = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] barbican.insecure = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] barbican.keyfile = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] barbican.number_of_retries = 60 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] barbican.retry_delay = 1 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] barbican.send_service_user_token = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] barbican.split_loggers = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] barbican.timeout = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] barbican.tls_ciphers = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] barbican.tls_min_version = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] barbican.verify_ssl = True {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] barbican.verify_ssl_path = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] barbican_service_user.auth_section = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] barbican_service_user.auth_type = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] barbican_service_user.cafile = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] barbican_service_user.certfile = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] barbican_service_user.collect_timing = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] barbican_service_user.insecure = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] barbican_service_user.keyfile = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] barbican_service_user.split_loggers = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] barbican_service_user.timeout = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] barbican_service_user.tls_ciphers = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] barbican_service_user.tls_min_version = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] vault.approle_role_id = **** {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] vault.approle_secret_id = **** {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] vault.auth_method = approle {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] vault.auth_path = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] vault.kv_mountpoint = secret {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] vault.kv_path = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] vault.kv_version = 2 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] vault.namespace = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] vault.root_token_id = **** {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] vault.ssl_ca_crt_file = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] vault.timeout = 60.0 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] vault.token_file = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] vault.token_role = None {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] vault.use_ssl = False {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:06:50 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] ******************************************************************************** {{(pid=76070) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 03 11:06:50 devstack sudo[76247]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:50 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.323s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:50 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:50 devstack sudo[76385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 11:06:50 devstack sudo[76385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:51 devstack sudo[76385]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:51 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.281s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:51 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:06:51 devstack cinder-volume[76222]: INFO cinder.brick.local_dev.lvm [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 03 11:06:51 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:51 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:51 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:51 devstack sudo[76462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 11:06:51 devstack sudo[76462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:51 devstack sudo[76462]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:51 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:51 devstack cinder-volume[76222]: DEBUG cinder.brick.local_dev.lvm [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76222) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 03 11:06:51 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:51 devstack sudo[76570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 11:06:51 devstack sudo[76570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:51 devstack sudo[76570]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:51 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.493s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:51 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:51 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:51 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:51 devstack sudo[76750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 11:06:51 devstack sudo[76750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:52 devstack sudo[76750]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:52 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.295s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:52 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:52 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:52 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:52 devstack sudo[76837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 03 11:06:52 devstack sudo[76837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:52 devstack sudo[76837]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:52 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.253s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:52 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:52 devstack sudo[76840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 11:06:52 devstack sudo[76840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:52 devstack sudo[76840]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:52 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.322s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:52 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:52 devstack sudo[76924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 11:06:52 devstack sudo[76924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:52 devstack sudo[76924]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:52 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:52 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:52 devstack sudo[76927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 11:06:52 devstack sudo[76927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:53 devstack sudo[76927]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:53 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.322s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:53 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:53 devstack sudo[76993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 11:06:53 devstack sudo[76993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:53 devstack sudo[76993]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:53 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.298s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:53 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:53 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:53 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:53 devstack sudo[77020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 11:06:53 devstack sudo[77020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:53 devstack sudo[77020]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:53 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.255s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:53 devstack cinder-volume[76222]: INFO cinder.volume.drivers.lvm [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 03 11:06:53 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:53 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:53 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:53 devstack sudo[77030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 11:06:53 devstack sudo[77030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:54 devstack sudo[77030]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:54 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:54 devstack cinder-volume[76222]: DEBUG cinder.volume.drivers.lvm [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Updating volume stats {{(pid=76222) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 11:06:54 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:54 devstack sudo[77033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 11:06:54 devstack sudo[77033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:54 devstack sudo[77033]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:54 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:54 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:54 devstack sudo[77036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 11:06:54 devstack sudo[77036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:54 devstack sudo[77036]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:54 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:54 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:54 devstack sudo[77039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 11:06:54 devstack sudo[77039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:54 devstack sudo[77039]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:54 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:54 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:54 devstack sudo[77042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 11:06:54 devstack sudo[77042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:55 devstack sudo[77042]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:55 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:55 devstack cinder-volume[76222]: INFO cinder.volume.driver [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Driver hasn't implemented _init_vendor_properties() Sep 03 11:06:55 devstack cinder-volume[76222]: DEBUG cinder.volume.driver [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76222) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 03 11:06:55 devstack cinder-volume[76222]: DEBUG oslo_db.sqlalchemy.engines [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76222) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 11:06:55 devstack cinder-volume[76222]: DEBUG dbcounter [-] [76222] Writer thread running {{(pid=76222) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 03 11:06:55 devstack cinder-volume[76222]: DEBUG cinder.db.api [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Building query based on filter {{(pid=76222) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 03 11:06:55 devstack cinder-volume[76222]: DEBUG cinder.image.image_utils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76222) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 03 11:06:55 devstack cinder-volume[76222]: INFO cinder.keymgr.migration [None req-78dd721a-db2d-4efe-a61c-5ba544f43ed3 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 03 11:06:55 devstack cinder-volume[76222]: DEBUG cinder.volume.drivers.lvm [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Updating volume stats {{(pid=76222) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 11:06:55 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:55 devstack sudo[77045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 11:06:55 devstack sudo[77045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:55 devstack sudo[77045]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:55 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:55 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:55 devstack sudo[77050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 11:06:55 devstack sudo[77050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:55 devstack sudo[77050]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:55 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:55 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:55 devstack sudo[77053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 11:06:55 devstack sudo[77053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:56 devstack sudo[77053]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:56 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.304s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:56 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:56 devstack sudo[77057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 11:06:56 devstack sudo[77057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:56 devstack sudo[77057]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:56 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:56 devstack cinder-volume[76222]: DEBUG cinder.manager [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Notifying Schedulers of capabilities ... {{(pid=76222) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:06:56 devstack cinder-volume[76222]: INFO cinder.volume.manager [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Driver initialization completed successfully. Sep 03 11:06:56 devstack cinder-volume[76222]: INFO cinder.manager [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Initiating service 2 cleanup Sep 03 11:06:56 devstack cinder-volume[76222]: INFO cinder.manager [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Service 2 cleanup completed. Sep 03 11:06:56 devstack cinder-volume[76222]: DEBUG cinder.service [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Creating RPC server for service cinder-volume {{(pid=76222) start /opt/stack/cinder/cinder/service.py:231}} Sep 03 11:06:56 devstack cinder-volume[76222]: DEBUG cinder.service [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76222) start /opt/stack/cinder/cinder/service.py:237}} Sep 03 11:06:56 devstack cinder-volume[76222]: INFO cinder.volume.manager [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 03 11:06:56 devstack cinder-volume[76222]: DEBUG cinder.volume.drivers.lvm [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Updating volume stats {{(pid=76222) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 11:06:56 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:56 devstack sudo[77060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 11:06:56 devstack sudo[77060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:56 devstack sudo[77060]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:56 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:56 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:56 devstack sudo[77065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 11:06:56 devstack sudo[77065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:57 devstack sudo[77065]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:57 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:57 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:57 devstack sudo[77072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 11:06:57 devstack sudo[77072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:57 devstack sudo[77072]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:57 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:57 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:06:57 devstack sudo[77075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 11:06:57 devstack sudo[77075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:06:57 devstack sudo[77075]: pam_unix(sudo:session): session closed for user root Sep 03 11:06:57 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:06:57 devstack cinder-volume[76222]: INFO cinder.volume.manager [None req-100875c4-4a31-4053-87c8-cd515253e187 None None] Driver post RPC initialization completed successfully. Sep 03 11:07:00 devstack cinder-volume[76070]: DEBUG dbcounter [-] [76070] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76070) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:07:07 devstack cinder-volume[76222]: DEBUG dbcounter [-] [76222] Writing DB stats cinder:SELECT=3 {{(pid=76222) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:07:07 devstack cinder-volume[76222]: DEBUG dbcounter [-] [76222] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76222) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:07:29 devstack cinder-volume[76222]: DEBUG oslo_service.periodic_task [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] Running periodic task VolumeManager._thread_info {{(pid=76222) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:07:29 devstack cinder-volume[76222]: DEBUG cinder.volume.manager [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] thread count: 6 {{(pid=76222) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:07:29 devstack cinder-volume[76222]: DEBUG cinder.volume.manager [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] thread info: [<_MainThread(MainThread, started 128868686696576)>, , , , , ] {{(pid=76222) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:08:29 devstack cinder-volume[76222]: DEBUG oslo_service.periodic_task [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76222) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:08:29 devstack cinder-volume[76222]: DEBUG cinder.volume.drivers.lvm [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] Updating volume stats {{(pid=76222) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 11:08:29 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:29 devstack sudo[81606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 11:08:29 devstack sudo[81606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:30 devstack sudo[81606]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:30 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:30 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:30 devstack sudo[81814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 11:08:30 devstack sudo[81814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:30 devstack sudo[81814]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:30 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:30 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:30 devstack sudo[81994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 11:08:30 devstack sudo[81994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:30 devstack sudo[81994]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:30 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:30 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:08:30 devstack sudo[82164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 11:08:30 devstack sudo[82164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:08:30 devstack sudo[82164]: pam_unix(sudo:session): session closed for user root Sep 03 11:08:30 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:08:30 devstack cinder-volume[76222]: DEBUG cinder.manager [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] Notifying Schedulers of capabilities ... {{(pid=76222) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:08:30 devstack cinder-volume[76222]: DEBUG oslo_service.periodic_task [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] Running periodic task VolumeManager._thread_info {{(pid=76222) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:08:30 devstack cinder-volume[76222]: DEBUG cinder.volume.manager [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] thread count: 6 {{(pid=76222) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:08:30 devstack cinder-volume[76222]: DEBUG cinder.volume.manager [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] thread info: [<_MainThread(MainThread, started 128868686696576)>, , , , , ] {{(pid=76222) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:09:07 devstack cinder-volume[76222]: DEBUG dbcounter [-] [76222] Writing DB stats cinder:SELECT=1 {{(pid=76222) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:09:07 devstack cinder-volume[76222]: DEBUG dbcounter [-] [76222] Writing DB stats cinder:UPDATE=1 {{(pid=76222) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:09:29 devstack cinder-volume[76222]: DEBUG oslo_service.periodic_task [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76222) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:09:29 devstack cinder-volume[76222]: DEBUG cinder.volume.drivers.lvm [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] Updating volume stats {{(pid=76222) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 11:09:29 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:09:29 devstack sudo[83679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 11:09:29 devstack sudo[83679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:09:30 devstack sudo[83679]: pam_unix(sudo:session): session closed for user root Sep 03 11:09:30 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:09:30 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:09:30 devstack sudo[83701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 11:09:30 devstack sudo[83701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:09:30 devstack sudo[83701]: pam_unix(sudo:session): session closed for user root Sep 03 11:09:30 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:09:30 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:09:30 devstack sudo[83705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 11:09:30 devstack sudo[83705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:09:30 devstack sudo[83705]: pam_unix(sudo:session): session closed for user root Sep 03 11:09:30 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:09:30 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:09:30 devstack sudo[83709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 11:09:30 devstack sudo[83709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:09:30 devstack sudo[83709]: pam_unix(sudo:session): session closed for user root Sep 03 11:09:30 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:09:30 devstack cinder-volume[76222]: DEBUG cinder.manager [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] Notifying Schedulers of capabilities ... {{(pid=76222) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:09:30 devstack cinder-volume[76222]: DEBUG oslo_service.periodic_task [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] Running periodic task VolumeManager._thread_info {{(pid=76222) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:09:30 devstack cinder-volume[76222]: DEBUG cinder.volume.manager [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] thread count: 6 {{(pid=76222) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:09:30 devstack cinder-volume[76222]: DEBUG cinder.volume.manager [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] thread info: [<_MainThread(MainThread, started 128868686696576)>, , , , , ] {{(pid=76222) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:10:29 devstack cinder-volume[76222]: DEBUG oslo_service.periodic_task [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76222) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:10:29 devstack cinder-volume[76222]: DEBUG cinder.volume.drivers.lvm [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] Updating volume stats {{(pid=76222) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 11:10:29 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:10:29 devstack sudo[85204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 11:10:29 devstack sudo[85204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:10:30 devstack sudo[85204]: pam_unix(sudo:session): session closed for user root Sep 03 11:10:30 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:10:30 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:10:30 devstack sudo[85215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 11:10:30 devstack sudo[85215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:10:30 devstack sudo[85215]: pam_unix(sudo:session): session closed for user root Sep 03 11:10:30 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:10:30 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:10:30 devstack sudo[85218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 11:10:30 devstack sudo[85218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:10:30 devstack sudo[85218]: pam_unix(sudo:session): session closed for user root Sep 03 11:10:30 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:10:30 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:10:30 devstack sudo[85224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 11:10:30 devstack sudo[85224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:10:30 devstack sudo[85224]: pam_unix(sudo:session): session closed for user root Sep 03 11:10:30 devstack cinder-volume[76222]: DEBUG oslo_concurrency.processutils [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76222) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:10:30 devstack cinder-volume[76222]: DEBUG cinder.manager [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] Notifying Schedulers of capabilities ... {{(pid=76222) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:10:30 devstack cinder-volume[76222]: DEBUG oslo_service.periodic_task [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] Running periodic task VolumeManager._thread_info {{(pid=76222) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:10:30 devstack cinder-volume[76222]: DEBUG cinder.volume.manager [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] thread count: 6 {{(pid=76222) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:10:30 devstack cinder-volume[76222]: DEBUG cinder.volume.manager [None req-70c690f5-323a-49ff-9e11-b80eb78e01e9 None None] thread info: [<_MainThread(MainThread, started 128868686696576)>, , , , , ] {{(pid=76222) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:11:07 devstack cinder-volume[76222]: DEBUG dbcounter [-] [76222] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76222) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:11:19 devstack cinder-volume[76070]: INFO oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] Caught SIGTERM, stopping children Sep 03 11:11:19 devstack cinder-volume[76070]: DEBUG oslo_concurrency.lockutils [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] Acquiring lock "singleton_lock" {{(pid=76070) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 11:11:19 devstack cinder-volume[76070]: DEBUG oslo_concurrency.lockutils [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] Acquired lock "singleton_lock" {{(pid=76070) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 11:11:19 devstack cinder-volume[76070]: DEBUG oslo_concurrency.lockutils [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] Releasing lock "singleton_lock" {{(pid=76070) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 11:11:19 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] Stop services. {{(pid=76070) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 03 11:11:19 devstack cinder-volume[76070]: DEBUG oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] Killing children. {{(pid=76070) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 03 11:11:19 devstack cinder-volume[76070]: INFO oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] Waiting on 1 children to exit Sep 03 11:11:21 devstack cinder-volume[76222]: DEBUG oslo_concurrency.lockutils [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] Acquiring lock "singleton_lock" {{(pid=76222) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 11:11:21 devstack cinder-volume[76222]: DEBUG oslo_concurrency.lockutils [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] Acquired lock "singleton_lock" {{(pid=76222) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 11:11:21 devstack cinder-volume[76222]: DEBUG oslo_concurrency.lockutils [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] Releasing lock "singleton_lock" {{(pid=76222) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 11:11:21 devstack cinder-volume[76222]: WARNING amqp [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 03 11:11:21 devstack cinder-volume[76222]: WARNING amqp [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 03 11:11:21 devstack cinder-volume[76070]: INFO oslo_service.backend._eventlet.service [None req-217d44a7-f2e3-4f4f-a6b5-bf9c71c07d6c None None] Child 76222 exited with status 0 Sep 03 11:11:22 devstack cinder-volume[86234]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 03 11:11:22 devstack cinder-volume[86234]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 03 11:11:22 devstack cinder-volume[86234]: we strongly recommend against using it for new projects. Sep 03 11:11:22 devstack cinder-volume[86234]: If you are already using Eventlet, we recommend migrating to a different Sep 03 11:11:22 devstack cinder-volume[86234]: framework. For more detail see Sep 03 11:11:22 devstack cinder-volume[86234]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 03 11:11:22 devstack cinder-volume[86234]: import eventlet # noqa Sep 03 11:11:24 devstack cinder-volume[86234]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86234) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 11:11:24 devstack cinder-volume[86234]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86234) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 11:11:24 devstack cinder-volume[86234]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86234) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 11:11:24 devstack cinder-volume[86234]: INFO dbcounter [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] Registered counter for database cinder Sep 03 11:11:24 devstack cinder-volume[86234]: DEBUG oslo_db.sqlalchemy.engines [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86234) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG dbcounter [-] [86234] Writer thread running {{(pid=86234) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 03 11:11:25 devstack cinder-volume[86234]: INFO cinder.rpc [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 03 11:11:25 devstack cinder-volume[86234]: INFO cinder.rpc [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_db.sqlalchemy.engines [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86234) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 11:11:25 devstack cinder-volume[86234]: INFO cinder.volume.manager [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] Determined volume DB was empty at startup. Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG cinder.volume.manager [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86234) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 03 11:11:25 devstack cinder-volume[86234]: INFO cinder.volume.manager [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 03 11:11:25 devstack cinder-volume[86234]: WARNING stevedore.named [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 03 11:11:25 devstack cinder-volume[86234]: WARNING castellan.key_manager [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 11:11:25 devstack cinder-volume[86234]: WARNING cinder.keymgr.conf_key_mgr [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 11:11:25 devstack cinder-volume[86234]: INFO cinder.volume.manager [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_db.sqlalchemy.engines [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86234) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 11:11:25 devstack cinder-volume[86234]: INFO oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] Starting 1 workers Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] Started child 86449 {{(pid=86234) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] Full set of CONF: {{(pid=86234) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] ******************************************************************************** {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] Configuration options gathered from: {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] ================================================================================ {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] allow_availability_zone_fallback = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] allow_compression_on_image_upload = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] allowed_direct_url_schemes = [] {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] api_rate_limit = True {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] auth_strategy = keystone {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_availability_zone = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_host = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_name = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_stats_polling_interval = 60 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backup_api_class = cinder.backup.api.API {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backup_name_template = backup-%s {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backup_use_same_host = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backup_use_temp_snapshot = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] chap_password = **** {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] chap_username = {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cinder_internal_tenant_project_id = 145c261a0e3345208db4dacc12404439 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86449]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cinder_internal_tenant_user_id = 45b463bb8bfd455e8f2fff349a41e06e {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cluster = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] compression_format = gzip {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] compute_api_class = cinder.compute.nova.API {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] config_dir = [] {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] config_source = [] {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] control_exchange = openstack {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] debug = True {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] default_availability_zone = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] default_group_type = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] default_volume_type = QuobyteHD {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] disk_geometry = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] driver_client_cert = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] driver_client_cert_key = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] driver_data_namespace = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] driver_ssl_cert_path = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] driver_ssl_cert_verify = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] driver_use_ssl = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] enable_new_services = True {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] enable_unsupported_driver = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] enabled_backends = ['QuobyteHD'] {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] enforce_multipath_for_image_xfer = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] filter_function = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] glance_api_insecure = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] glance_api_servers = ['http://192.168.122.194/image'] {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] glance_api_ssl_compression = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] glance_ca_certificates_file = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] glance_catalog_info = image:glance:publicURL {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] glance_certfile = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] glance_keyfile = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] glance_num_retries = 3 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] glance_request_timeout = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] goodness_function = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] graceful_shutdown_timeout = 5 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] group_api_class = cinder.group.api.API {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] host = devstack {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] image_compress_on_upload = True {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] image_conversion_address_space_limit = 1 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] image_conversion_cpu_limit = 60 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] image_conversion_disable = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] image_upload_use_cinder_backend = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] image_upload_use_internal_tenant = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] image_volume_cache_enabled = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] image_volume_cache_max_count = 0 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] image_volume_cache_max_size_gb = 0 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] init_host_max_objects_retrieval = 0 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] instance_format = [instance: %(uuid)s] {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] iscsi_target_flags = {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] iscsi_write_cache = on {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] iser_helper = tgtadm {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] iser_ip_address = 192.168.122.194 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] iser_port = 3260 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] log_color = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] log_config_append = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] log_dir = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] log_file = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] log_options = True {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] log_rotate_interval = 1 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] log_rotate_interval_type = days {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] log_rotation_type = none {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] max_age = 0 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] max_logfile_count = 30 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] max_logfile_size_mb = 200 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] max_over_subscription_ratio = 20.0 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] message_reap_interval = 86400 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] message_ttl = 2592000 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] migration_create_volume_timeout_secs = 300 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] monkey_patch = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] monkey_patch_modules = [] {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] my_ip = 192.168.122.194 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] no_snapshot_gb_quota = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] num_iser_scan_tries = 3 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] num_shell_tries = 3 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] num_volume_device_scan_tries = 3 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] nvmeof_conn_info_version = 1 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] nvmet_ns_id = 10 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] nvmet_port_id = 1 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] osapi_max_limit = 1000 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] osapi_volume_ext_list = [] {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] osapi_volume_listen_port = 8776 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] osapi_volume_use_ssl = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] osapi_volume_workers = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] per_volume_size_limit = -1 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] periodic_fuzzy_delay = 60 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] periodic_interval = 60 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] public_endpoint = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] publish_errors = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] quota_backup_gigabytes = 1000 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] quota_backups = 10 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] quota_gigabytes = 1000 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] quota_groups = 10 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] quota_snapshots = 10 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] quota_volumes = 10 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] rate_limit_burst = 0 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] rate_limit_except_level = CRITICAL {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] rate_limit_interval = 0 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] reinit_driver_count = 3 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] replication_device = **** {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] report_discard_supported = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] report_interval = 120 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] reservation_clean_interval = 86400 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] reservation_expire = 86400 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] reserved_image_namespaces = [] {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] reserved_percentage = 0 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] rpc_response_timeout = 120 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] run_external_periodic_tasks = True {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] scst_target_driver = iscsi {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] scst_target_iqn_name = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] service_down_time = 720 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] shell_completion = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] snapshot_name_template = snapshot-%s {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] split_loggers = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] state_path = /opt/stack/data/cinder {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] storage_availability_zone = nova {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] storage_protocol = iSCSI {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] syslog_log_facility = LOG_USER {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] target_helper = lioadm {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] target_ip_address = 192.168.122.194 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] target_port = 3260 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] target_protocol = iscsi {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] target_secondary_ip_addresses = [] {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] trace_flags = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] transport_url = **** {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] until_refresh = 0 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] use_chap_auth = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] use_default_quota_class = True {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] use_journal = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] use_json = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] use_multipath_for_image_xfer = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] use_stderr = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] use_syslog = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] verify_glance_signatures = enabled {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] volume_api_class = cinder.volume.api.API {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] volume_backend_name = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] volume_clear = zero {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] volume_clear_ionice = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] volume_clear_size = 0 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] volume_copy_bps_limit = 0 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] volume_dd_blocksize = 1M {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] volume_name_template = volume-%s {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] volume_service_inithost_offload = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] volume_usage_audit_period = month {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] zoning_mode = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_concurrency.disable_process_locking = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.auth_section = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86449]: INFO cinder.volume.manager [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.auth_type = password {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86449]: DEBUG cinder.volume.drivers.remotefs [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86449) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.auth_version = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.cache = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.certfile = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.include_service_catalog = True {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.insecure = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.interface = public {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.keyfile = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.memcache_password = **** {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.memcache_username = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.region_name = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.service_type = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.194/identity {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.backend = dogpile.cache.null {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.backend_argument = **** {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.backend_expiration_time = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.config_prefix = cache.oslo {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.debug_cache_backend = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.enable_retry_client = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.enable_socket_keepalive = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.enabled = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.expiration_time = 600 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.hashclient_retry_attempts = 2 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.memcache_dead_retry = 300 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.memcache_pool_maxsize = 10 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.memcache_sasl_enabled = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.password = **** {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.proxies = [] {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.redis_db = 0 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.redis_server = localhost:6379 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.retry_attempts = 2 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.retry_delay = 0.0 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.socket_keepalive_count = 1 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.socket_keepalive_idle = 1 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.socket_keepalive_interval = 1 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.socket_timeout = 1.0 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.tls_allowed_ciphers = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.tls_cafile = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.tls_certfile = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.tls_enabled = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.tls_keyfile = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cache.username = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] coordination.backend_url = **** {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] database.asyncio_connection = **** {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] database.asyncio_slave_connection = **** {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] database.backend = sqlalchemy {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] database.connection = **** {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] database.connection_debug = 0 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] database.connection_parameters = {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] database.connection_recycle_time = 3600 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] database.connection_trace = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] database.db_inc_retry_interval = True {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] database.db_max_retries = 20 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] database.db_max_retry_interval = 10 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] database.db_retry_interval = 1 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] database.max_overflow = 50 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] database.max_pool_size = 5 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] database.max_retries = 10 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] database.mysql_wsrep_sync_wait = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] database.pool_timeout = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] database.retry_interval = 10 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] database.slave_connection = **** {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] database.sqlite_synchronous = True {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] database.synchronous_reader = True {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] database.use_db_reconnect = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_tracing.insecure = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] profiler.connection_string = messaging:// {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] profiler.enabled = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] profiler.es_doc_type = notification {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] profiler.es_scroll_size = 10000 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] profiler.es_scroll_time = 2m {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] profiler.filter_error_trace = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] profiler.hmac_keys = **** {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] profiler.sentinel_service_name = mymaster {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] profiler.socket_timeout = 0.1 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] profiler.trace_requests = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] profiler.trace_sqlalchemy = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] profiler_jaeger.process_tags = {} {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] profiler_jaeger.service_name_prefix = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] profiler_otlp.service_name_prefix = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_policy.enforce_new_defaults = True {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_policy.policy_default_rule = default {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_policy.policy_file = policy.yaml {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] privsep_osbrick.group = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] privsep_osbrick.helper_command = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] privsep_osbrick.user = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cinder_sys_admin.group = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cinder_sys_admin.helper_command = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] cinder_sys_admin.user = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] service_user.auth_section = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] service_user.auth_type = password {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] service_user.cafile = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] service_user.certfile = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] service_user.collect_timing = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] service_user.insecure = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] service_user.keyfile = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] service_user.send_service_user_token = True {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] service_user.split_loggers = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] service_user.timeout = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] service_user.tls_ciphers = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] service_user.tls_min_version = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] glance.auth_section = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] glance.auth_type = password {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] glance.certfile = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] glance.collect_timing = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] glance.insecure = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] glance.keyfile = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] glance.region_name = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] glance.split_loggers = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] glance.timeout = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] glance.tls_ciphers = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] glance.tls_min_version = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.backend_availability_zone = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.chap_password = **** {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.chap_username = {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.disk_geometry = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.driver_client_cert = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.driver_client_cert_key = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.driver_data_namespace = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.driver_use_ssl = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.extra_capabilities = {} {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.filter_function = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.goodness_function = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.iscsi_target_flags = {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.iscsi_write_cache = on {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.iser_helper = tgtadm {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.iser_ip_address = 192.168.122.194 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.iser_port = 3260 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.nas_host = {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.nas_login = admin {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.nas_mount_options = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.nas_password = **** {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.nas_private_key = {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.nas_share_path = {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.num_shell_tries = 3 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.quobyte_volume_url = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.replication_device = **** {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.report_discard_supported = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.reserved_percentage = 0 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.target_helper = tgtadm {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.target_ip_address = 192.168.122.194 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.target_port = 3260 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.target_protocol = iscsi {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.trace_flags = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.unique_fqdn_network = True {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.use_chap_auth = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.volume_backend_name = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.volume_clear = zero {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.volume_clear_ionice = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.volume_clear_size = 0 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_reports.file_event_handler = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_reports.log_dir = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.backend_availability_zone = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.backend_host = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.chap_password = **** {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.chap_username = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.chiscsi_conf = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.disk_geometry = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.driver_client_cert = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.driver_data_namespace = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.driver_use_ssl = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.extra_capabilities = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86449]: DEBUG cinder.volume.drivers.quobyte [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86449) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 03 11:11:25 devstack cinder-volume[86449]: WARNING cinder.volume.drivers.quobyte [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 03 11:11:25 devstack cinder-volume[86449]: WARNING cinder.volume.drivers.quobyte [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 03 11:11:25 devstack cinder-volume[86449]: DEBUG oslo_concurrency.processutils [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] Running cmd (subprocess): mount.quobyte {{(pid=86449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.filter_function = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.goodness_function = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.iser_helper = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.iser_ip_address = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.iser_port = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.iser_target_prefix = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.nas_host = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.nas_login = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.nas_mount_options = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.nas_password = **** {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.nas_private_key = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.nas_share_path = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.nas_ssh_port = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.num_shell_tries = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.nvmet_port_id = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.replication_device = **** {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.report_discard_supported = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.reserved_percentage = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.scst_target_driver = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.storage_protocol = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.target_helper = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.target_ip_address = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.target_port = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.target_prefix = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.target_protocol = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.trace_flags = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.use_chap_auth = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.volume_clear = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.volume_clear_size = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] QuobyteHD.volumes_dir = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.ssl = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_notifications.driver = [] {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_notifications.retry = -1 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] key_manager.fixed_key = **** {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack quobyte-client[86452]: Reading configuration file: /etc/quobyte/client.cfg Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] barbican.barbican_api_version = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] barbican.barbican_endpoint = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] barbican.barbican_endpoint_type = public {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack quobyte-client[86452]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] barbican.barbican_region_name = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] barbican.cafile = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86449]: DEBUG oslo_concurrency.processutils [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] CMD "mount.quobyte" returned: 1 in 0.120s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] barbican.certfile = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86449]: DEBUG oslo_concurrency.lockutils [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] barbican.collect_timing = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86449]: DEBUG oslo_concurrency.lockutils [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] barbican.insecure = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86449]: DEBUG cinder.volume.drivers.quobyte [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=86449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:11:25 devstack cinder-volume[86449]: INFO cinder.volume.drivers.quobyte [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 ... Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] barbican.keyfile = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] barbican.number_of_retries = 60 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86449]: DEBUG oslo_concurrency.processutils [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a -c /etc/quobyte/client-cinder.cfg {{(pid=86449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] barbican.retry_delay = 1 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] barbican.send_service_user_token = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] barbican.split_loggers = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] barbican.timeout = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] barbican.tls_ciphers = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] barbican.tls_min_version = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] barbican.verify_ssl = True {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] barbican.verify_ssl_path = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] barbican_service_user.auth_section = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] barbican_service_user.auth_type = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] barbican_service_user.cafile = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] barbican_service_user.certfile = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] barbican_service_user.collect_timing = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] barbican_service_user.insecure = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] barbican_service_user.keyfile = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] barbican_service_user.split_loggers = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] barbican_service_user.timeout = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] barbican_service_user.tls_ciphers = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] barbican_service_user.tls_min_version = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] vault.approle_role_id = **** {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] vault.approle_secret_id = **** {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] vault.auth_method = approle {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] vault.auth_path = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] vault.kv_mountpoint = secret {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] vault.kv_path = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] vault.kv_version = 2 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] vault.namespace = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] vault.root_token_id = **** {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] vault.ssl_ca_crt_file = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] vault.timeout = 60.0 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] vault.token_file = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] vault.token_role = None {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] vault.use_ssl = False {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:25 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] ******************************************************************************** {{(pid=86234) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 03 11:11:25 devstack sudo[86455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a -c /etc/quobyte/client-cinder.cfg Sep 03 11:11:25 devstack sudo[86455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:26 devstack sudo[86455]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:26 devstack cinder-volume[86449]: DEBUG oslo_concurrency.processutils [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.363s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:26 devstack cinder-volume[86449]: INFO cinder.volume.drivers.quobyte [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 succeeded Sep 03 11:11:26 devstack cinder-volume[86449]: DEBUG cinder.volume.drivers.quobyte [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=86449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:11:26 devstack cinder-volume[86449]: DEBUG oslo_concurrency.lockutils [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.377s {{(pid=86449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:11:26 devstack cinder-volume[86449]: DEBUG oslo_concurrency.processutils [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=86449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:26 devstack sudo[86524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:11:26 devstack sudo[86524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:26 devstack sudo[86524]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:26 devstack cinder-volume[86449]: DEBUG oslo_concurrency.processutils [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.234s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:26 devstack cinder-volume[86449]: INFO cinder.volume.driver [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] Driver hasn't implemented _init_vendor_properties() Sep 03 11:11:26 devstack cinder-volume[86449]: DEBUG cinder.volume.driver [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8491134643555, 'free_capacity_gb': 1773.8491134643555, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86449) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 03 11:11:26 devstack cinder-volume[86449]: DEBUG oslo_db.sqlalchemy.engines [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86449) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 11:11:26 devstack cinder-volume[86449]: DEBUG dbcounter [-] [86449] Writer thread running {{(pid=86449) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 03 11:11:26 devstack cinder-volume[86449]: DEBUG cinder.db.api [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] Building query based on filter {{(pid=86449) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 03 11:11:26 devstack cinder-volume[86449]: DEBUG cinder.image.image_utils [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86449) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 03 11:11:26 devstack cinder-volume[86449]: INFO cinder.keymgr.migration [None req-06deabcf-dcab-4d31-a284-1c443e694be0 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 03 11:11:26 devstack cinder-volume[86449]: DEBUG oslo_concurrency.lockutils [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:11:26 devstack cinder-volume[86449]: DEBUG oslo_concurrency.lockutils [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:11:26 devstack cinder-volume[86449]: DEBUG cinder.volume.drivers.quobyte [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=86449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:11:26 devstack cinder-volume[86449]: DEBUG cinder.volume.drivers.quobyte [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=86449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:11:26 devstack cinder-volume[86449]: DEBUG oslo_concurrency.lockutils [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:11:26 devstack cinder-volume[86449]: DEBUG oslo_concurrency.processutils [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=86449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:26 devstack sudo[86527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:11:26 devstack sudo[86527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:26 devstack sudo[86527]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:26 devstack cinder-volume[86449]: DEBUG oslo_concurrency.processutils [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.242s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:26 devstack cinder-volume[86449]: DEBUG cinder.manager [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] Notifying Schedulers of capabilities ... {{(pid=86449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:11:26 devstack cinder-volume[86449]: INFO cinder.volume.manager [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] Driver initialization completed successfully. Sep 03 11:11:26 devstack cinder-volume[86449]: INFO cinder.manager [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] Initiating service 3 cleanup Sep 03 11:11:26 devstack cinder-volume[86449]: INFO cinder.manager [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] Service 3 cleanup completed. Sep 03 11:11:26 devstack cinder-volume[86449]: DEBUG cinder.service [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] Creating RPC server for service cinder-volume {{(pid=86449) start /opt/stack/cinder/cinder/service.py:231}} Sep 03 11:11:26 devstack cinder-volume[86449]: DEBUG cinder.service [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86449) start /opt/stack/cinder/cinder/service.py:237}} Sep 03 11:11:27 devstack cinder-volume[86449]: INFO cinder.volume.manager [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 03 11:11:27 devstack cinder-volume[86449]: DEBUG oslo_concurrency.lockutils [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:11:27 devstack cinder-volume[86449]: DEBUG oslo_concurrency.lockutils [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:11:27 devstack cinder-volume[86449]: DEBUG cinder.volume.drivers.quobyte [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=86449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:11:27 devstack cinder-volume[86449]: DEBUG cinder.volume.drivers.quobyte [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=86449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:11:27 devstack cinder-volume[86449]: DEBUG oslo_concurrency.lockutils [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:11:27 devstack cinder-volume[86449]: DEBUG oslo_concurrency.processutils [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=86449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:27 devstack sudo[86531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:11:27 devstack sudo[86531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:27 devstack sudo[86531]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:27 devstack cinder-volume[86449]: DEBUG oslo_concurrency.processutils [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.282s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:27 devstack cinder-volume[86449]: INFO cinder.volume.manager [None req-e25d243a-7177-407a-b91f-a25be1dd0e64 None None] Driver post RPC initialization completed successfully. Sep 03 11:11:31 devstack cinder-volume[86449]: DEBUG oslo_service.periodic_task [None req-abd06d60-0eea-4e20-b111-0984f1d7caf8 None None] Running periodic task VolumeManager._thread_info {{(pid=86449) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:11:31 devstack cinder-volume[86449]: DEBUG cinder.volume.manager [None req-abd06d60-0eea-4e20-b111-0984f1d7caf8 None None] thread count: 6 {{(pid=86449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:11:31 devstack cinder-volume[86449]: DEBUG cinder.volume.manager [None req-abd06d60-0eea-4e20-b111-0984f1d7caf8 None None] thread info: [<_MainThread(MainThread, started 134574403006592)>, , , , , ] {{(pid=86449) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:11:31 devstack cinder-volume[86449]: DEBUG oslo_concurrency.lockutils [None req-27dc7102-d08b-47cb-9f1e-e69c76f322be None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:11:31 devstack cinder-volume[86449]: DEBUG oslo_concurrency.lockutils [None req-27dc7102-d08b-47cb-9f1e-e69c76f322be None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:11:31 devstack cinder-volume[86449]: DEBUG cinder.volume.drivers.quobyte [None req-27dc7102-d08b-47cb-9f1e-e69c76f322be None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=86449) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:11:31 devstack cinder-volume[86449]: DEBUG cinder.volume.drivers.quobyte [None req-27dc7102-d08b-47cb-9f1e-e69c76f322be None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=86449) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:11:31 devstack cinder-volume[86449]: DEBUG oslo_concurrency.lockutils [None req-27dc7102-d08b-47cb-9f1e-e69c76f322be None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86449) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:11:31 devstack cinder-volume[86449]: DEBUG oslo_concurrency.processutils [None req-27dc7102-d08b-47cb-9f1e-e69c76f322be None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=86449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:31 devstack sudo[86678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:11:31 devstack sudo[86678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:32 devstack sudo[86678]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:32 devstack cinder-volume[86449]: DEBUG oslo_concurrency.processutils [None req-27dc7102-d08b-47cb-9f1e-e69c76f322be None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.236s {{(pid=86449) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:32 devstack cinder-volume[86449]: DEBUG cinder.manager [None req-27dc7102-d08b-47cb-9f1e-e69c76f322be None None] Notifying Schedulers of capabilities ... {{(pid=86449) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:11:32 devstack cinder-volume[86234]: INFO oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] Caught SIGTERM, stopping children Sep 03 11:11:32 devstack cinder-volume[86234]: DEBUG oslo_concurrency.lockutils [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] Acquiring lock "singleton_lock" {{(pid=86234) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 11:11:32 devstack cinder-volume[86234]: DEBUG oslo_concurrency.lockutils [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] Acquired lock "singleton_lock" {{(pid=86234) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 11:11:32 devstack cinder-volume[86234]: DEBUG oslo_concurrency.lockutils [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] Releasing lock "singleton_lock" {{(pid=86234) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 11:11:32 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] Stop services. {{(pid=86234) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 03 11:11:32 devstack cinder-volume[86234]: DEBUG oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] Killing children. {{(pid=86234) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 03 11:11:32 devstack cinder-volume[86234]: INFO oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] Waiting on 1 children to exit Sep 03 11:11:35 devstack cinder-volume[86449]: DEBUG oslo_concurrency.lockutils [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] Acquiring lock "singleton_lock" {{(pid=86449) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 11:11:35 devstack cinder-volume[86449]: DEBUG oslo_concurrency.lockutils [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] Acquired lock "singleton_lock" {{(pid=86449) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 11:11:35 devstack cinder-volume[86449]: DEBUG oslo_concurrency.lockutils [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] Releasing lock "singleton_lock" {{(pid=86449) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 11:11:35 devstack cinder-volume[86449]: WARNING amqp [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 03 11:11:35 devstack cinder-volume[86449]: WARNING amqp [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 03 11:11:35 devstack cinder-volume[86234]: INFO oslo_service.backend._eventlet.service [None req-0249fc27-0293-485c-b926-2911823e68d4 None None] Child 86449 exited with status 0 Sep 03 11:11:36 devstack cinder-volume[86736]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 03 11:11:36 devstack cinder-volume[86736]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 03 11:11:36 devstack cinder-volume[86736]: we strongly recommend against using it for new projects. Sep 03 11:11:36 devstack cinder-volume[86736]: If you are already using Eventlet, we recommend migrating to a different Sep 03 11:11:36 devstack cinder-volume[86736]: framework. For more detail see Sep 03 11:11:36 devstack cinder-volume[86736]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 03 11:11:36 devstack cinder-volume[86736]: import eventlet # noqa Sep 03 11:11:39 devstack cinder-volume[86736]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86736) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 11:11:39 devstack cinder-volume[86736]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86736) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 11:11:39 devstack cinder-volume[86736]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86736) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 11:11:40 devstack cinder-volume[86736]: INFO dbcounter [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] Registered counter for database cinder Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_db.sqlalchemy.engines [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86736) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG dbcounter [-] [86736] Writer thread running {{(pid=86736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 03 11:11:40 devstack cinder-volume[86736]: INFO cinder.rpc [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 03 11:11:40 devstack cinder-volume[86736]: INFO cinder.rpc [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_db.sqlalchemy.engines [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86736) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 11:11:40 devstack cinder-volume[86736]: INFO cinder.volume.manager [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] Determined volume DB was empty at startup. Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG cinder.volume.manager [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86736) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 03 11:11:40 devstack cinder-volume[86736]: WARNING stevedore.named [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 03 11:11:40 devstack cinder-volume[86736]: WARNING castellan.key_manager [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 11:11:40 devstack cinder-volume[86736]: WARNING cinder.keymgr.conf_key_mgr [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 11:11:40 devstack cinder-volume[86736]: INFO cinder.volume.manager [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_db.sqlalchemy.engines [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86736) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 11:11:40 devstack cinder-volume[86736]: INFO oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] Starting 1 workers Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] Started child 87038 {{(pid=86736) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] Full set of CONF: {{(pid=86736) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] ******************************************************************************** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] Configuration options gathered from: {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] ================================================================================ {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] allow_availability_zone_fallback = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[87038]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] allow_compression_on_image_upload = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] allowed_direct_url_schemes = [] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] api_rate_limit = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] auth_strategy = keystone {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_availability_zone = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_host = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_name = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_stats_polling_interval = 60 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backup_api_class = cinder.backup.api.API {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backup_name_template = backup-%s {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backup_use_same_host = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backup_use_temp_snapshot = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] chap_password = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] chap_username = {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cinder_internal_tenant_project_id = 145c261a0e3345208db4dacc12404439 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cinder_internal_tenant_user_id = 45b463bb8bfd455e8f2fff349a41e06e {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cluster = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] compression_format = gzip {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] compute_api_class = cinder.compute.nova.API {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] config_dir = [] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] config_source = [] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] control_exchange = openstack {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] debug = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] default_availability_zone = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] default_group_type = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] default_volume_type = QuobyteHD {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] disk_geometry = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] driver_client_cert = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] driver_client_cert_key = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] driver_data_namespace = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] driver_ssl_cert_path = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] driver_ssl_cert_verify = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] driver_use_ssl = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] enable_new_services = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] enable_unsupported_driver = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] enabled_backends = ['QuobyteHD'] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] enforce_multipath_for_image_xfer = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] filter_function = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] glance_api_insecure = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] glance_api_servers = ['http://192.168.122.194/image'] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] glance_api_ssl_compression = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] glance_ca_certificates_file = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] glance_catalog_info = image:glance:publicURL {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] glance_certfile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] glance_keyfile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] glance_num_retries = 3 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] glance_request_timeout = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] goodness_function = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] graceful_shutdown_timeout = 5 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] group_api_class = cinder.group.api.API {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] host = devstack {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] image_compress_on_upload = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] image_conversion_address_space_limit = 1 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] image_conversion_cpu_limit = 60 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] image_conversion_disable = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] image_upload_use_cinder_backend = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] image_upload_use_internal_tenant = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] image_volume_cache_enabled = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] image_volume_cache_max_count = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] image_volume_cache_max_size_gb = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] init_host_max_objects_retrieval = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] instance_format = [instance: %(uuid)s] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] iscsi_target_flags = {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] iscsi_write_cache = on {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] iser_helper = tgtadm {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] iser_ip_address = 192.168.122.194 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] iser_port = 3260 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] log_color = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] log_config_append = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] log_dir = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] log_file = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] log_options = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] log_rotate_interval = 1 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] log_rotate_interval_type = days {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] log_rotation_type = none {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] max_age = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] max_logfile_count = 30 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] max_logfile_size_mb = 200 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] max_over_subscription_ratio = 20.0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] message_reap_interval = 86400 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] message_ttl = 2592000 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] Starting volume driver QuobyteDriver (1.2.1) Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] migration_create_volume_timeout_secs = 300 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] monkey_patch = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] monkey_patch_modules = [] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] my_ip = 192.168.122.194 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] no_snapshot_gb_quota = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] num_iser_scan_tries = 3 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] num_shell_tries = 3 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] num_volume_device_scan_tries = 3 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87038) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] nvmeof_conn_info_version = 1 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] nvmet_ns_id = 10 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] nvmet_port_id = 1 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] osapi_max_limit = 1000 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] osapi_volume_ext_list = [] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] osapi_volume_listen_port = 8776 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] osapi_volume_use_ssl = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] osapi_volume_workers = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] per_volume_size_limit = -1 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] periodic_fuzzy_delay = 60 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] periodic_interval = 60 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] public_endpoint = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] publish_errors = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] quota_backup_gigabytes = 1000 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] quota_backups = 10 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] quota_gigabytes = 1000 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] quota_groups = 10 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] quota_snapshots = 10 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] quota_volumes = 10 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] rate_limit_burst = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] rate_limit_except_level = CRITICAL {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] rate_limit_interval = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] reinit_driver_count = 3 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] replication_device = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] report_discard_supported = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] report_interval = 120 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] reservation_clean_interval = 86400 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] reservation_expire = 86400 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] reserved_image_namespaces = [] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] reserved_percentage = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] rpc_response_timeout = 120 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] run_external_periodic_tasks = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] scst_target_driver = iscsi {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] scst_target_iqn_name = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] service_down_time = 720 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] shell_completion = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] snapshot_name_template = snapshot-%s {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] split_loggers = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] state_path = /opt/stack/data/cinder {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] storage_availability_zone = nova {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] storage_protocol = iSCSI {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] syslog_log_facility = LOG_USER {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] target_helper = lioadm {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] target_ip_address = 192.168.122.194 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] target_port = 3260 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] target_protocol = iscsi {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] target_secondary_ip_addresses = [] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] trace_flags = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] transport_url = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] until_refresh = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] use_chap_auth = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] use_default_quota_class = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] use_journal = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] use_json = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] use_multipath_for_image_xfer = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] use_stderr = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] use_syslog = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] verify_glance_signatures = enabled {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] volume_api_class = cinder.volume.api.API {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] volume_backend_name = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] volume_clear = zero {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] volume_clear_ionice = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] volume_clear_size = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] volume_copy_bps_limit = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] volume_dd_blocksize = 1M {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] volume_name_template = volume-%s {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] volume_service_inithost_offload = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] volume_usage_audit_period = month {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] zoning_mode = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_concurrency.disable_process_locking = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.auth_section = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.auth_type = password {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.auth_version = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.cache = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.certfile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.include_service_catalog = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.insecure = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.interface = public {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.keyfile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.memcache_password = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.memcache_username = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.region_name = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.service_type = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87038) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.194/identity {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.backend = dogpile.cache.null {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.backend_argument = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.quobyte [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 03 11:11:40 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.quobyte [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.backend_expiration_time = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.config_prefix = cache.oslo {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.debug_cache_backend = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] Running cmd (subprocess): mount.quobyte {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.enable_retry_client = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.enable_socket_keepalive = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.enabled = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.expiration_time = 600 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.hashclient_retry_attempts = 2 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.memcache_dead_retry = 300 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.memcache_pool_maxsize = 10 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.memcache_sasl_enabled = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.password = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.proxies = [] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.redis_db = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.redis_server = localhost:6379 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.retry_attempts = 2 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.retry_delay = 0.0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.socket_keepalive_count = 1 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.socket_keepalive_idle = 1 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.socket_keepalive_interval = 1 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.socket_timeout = 1.0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.tls_allowed_ciphers = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.tls_cafile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.tls_certfile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.tls_enabled = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.tls_keyfile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cache.username = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] coordination.backend_url = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] database.asyncio_connection = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] database.asyncio_slave_connection = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] database.backend = sqlalchemy {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] database.connection = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] database.connection_debug = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] database.connection_parameters = {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] database.connection_recycle_time = 3600 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] database.connection_trace = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] database.db_inc_retry_interval = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] database.db_max_retries = 20 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] database.db_max_retry_interval = 10 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] database.db_retry_interval = 1 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] database.max_overflow = 50 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] database.max_pool_size = 5 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] database.max_retries = 10 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] database.mysql_wsrep_sync_wait = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] database.pool_timeout = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] database.retry_interval = 10 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] database.slave_connection = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] database.sqlite_synchronous = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] database.synchronous_reader = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] database.use_db_reconnect = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_tracing.insecure = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] profiler.connection_string = messaging:// {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] profiler.enabled = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] profiler.es_doc_type = notification {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] profiler.es_scroll_size = 10000 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] profiler.es_scroll_time = 2m {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] profiler.filter_error_trace = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] profiler.hmac_keys = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] profiler.sentinel_service_name = mymaster {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] profiler.socket_timeout = 0.1 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] profiler.trace_requests = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] profiler.trace_sqlalchemy = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] profiler_jaeger.process_tags = {} {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] profiler_jaeger.service_name_prefix = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] profiler_otlp.service_name_prefix = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_policy.enforce_new_defaults = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_policy.policy_default_rule = default {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_policy.policy_file = policy.yaml {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] privsep_osbrick.group = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] privsep_osbrick.helper_command = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] privsep_osbrick.user = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cinder_sys_admin.group = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cinder_sys_admin.helper_command = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] cinder_sys_admin.user = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] service_user.auth_section = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] service_user.auth_type = password {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] service_user.cafile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] service_user.certfile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] service_user.collect_timing = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] service_user.insecure = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] service_user.keyfile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] service_user.send_service_user_token = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] service_user.split_loggers = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] service_user.timeout = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] service_user.tls_ciphers = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] service_user.tls_min_version = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] glance.auth_section = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] glance.auth_type = password {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] glance.certfile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] glance.collect_timing = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] glance.insecure = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] glance.keyfile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] glance.region_name = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] glance.split_loggers = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] glance.timeout = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] glance.tls_ciphers = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] glance.tls_min_version = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.backend_availability_zone = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.chap_password = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.chap_username = {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.disk_geometry = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.driver_client_cert = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.driver_client_cert_key = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.driver_data_namespace = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] CMD "mount.quobyte" returned: 1 in 0.055s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.driver_use_ssl = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.extra_capabilities = {} {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.filter_function = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.goodness_function = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.iscsi_target_flags = {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.iscsi_write_cache = on {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.iser_helper = tgtadm {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.iser_ip_address = 192.168.122.194 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.iser_port = 3260 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:11:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.nas_host = {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.nas_login = admin {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.nas_mount_options = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.nas_password = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.nas_private_key = {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.nas_share_path = {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.num_shell_tries = 3 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.quobyte_volume_url = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.replication_device = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.report_discard_supported = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.reserved_percentage = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.target_helper = tgtadm {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.target_ip_address = 192.168.122.194 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.target_port = 3260 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.target_protocol = iscsi {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.trace_flags = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.unique_fqdn_network = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.use_chap_auth = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack sudo[87040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.volume_backend_name = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.volume_clear = zero {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.volume_clear_ionice = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.volume_clear_size = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack sudo[87040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_reports.file_event_handler = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_reports.log_dir = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.backend_availability_zone = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.backend_host = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.chap_password = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.chap_username = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.chiscsi_conf = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.disk_geometry = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.driver_client_cert = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.driver_data_namespace = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.driver_use_ssl = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.extra_capabilities = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.filter_function = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.goodness_function = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.iser_helper = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.iser_ip_address = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.iser_port = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.iser_target_prefix = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.nas_host = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.nas_login = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.nas_mount_options = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.nas_password = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.nas_private_key = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.nas_share_path = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.nas_ssh_port = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.num_shell_tries = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.nvmet_port_id = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.replication_device = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.report_discard_supported = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.reserved_percentage = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.scst_target_driver = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.storage_protocol = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.target_helper = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.target_ip_address = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.target_port = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.target_prefix = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.target_protocol = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.trace_flags = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.use_chap_auth = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.volume_clear = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.volume_clear_size = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] QuobyteHD.volumes_dir = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.ssl = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_notifications.driver = [] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_notifications.retry = -1 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] key_manager.fixed_key = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] barbican.barbican_api_version = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] barbican.barbican_endpoint = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] barbican.barbican_endpoint_type = public {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] barbican.barbican_region_name = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] barbican.cafile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] barbican.certfile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] barbican.collect_timing = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] barbican.insecure = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] barbican.keyfile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] barbican.number_of_retries = 60 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] barbican.retry_delay = 1 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] barbican.send_service_user_token = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] barbican.split_loggers = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] barbican.timeout = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] barbican.tls_ciphers = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] barbican.tls_min_version = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] barbican.verify_ssl = True {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] barbican.verify_ssl_path = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] barbican_service_user.auth_section = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] barbican_service_user.auth_type = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] barbican_service_user.cafile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] barbican_service_user.certfile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:40 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] barbican_service_user.collect_timing = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:41 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] barbican_service_user.insecure = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:41 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] barbican_service_user.keyfile = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:41 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] barbican_service_user.split_loggers = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:41 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] barbican_service_user.timeout = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:41 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] barbican_service_user.tls_ciphers = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:41 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] barbican_service_user.tls_min_version = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:41 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] vault.approle_role_id = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:41 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] vault.approle_secret_id = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:41 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] vault.auth_method = approle {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:41 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] vault.auth_path = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:41 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] vault.kv_mountpoint = secret {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:41 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] vault.kv_path = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:41 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] vault.kv_version = 2 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:41 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] vault.namespace = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:41 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] vault.root_token_id = **** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:41 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] vault.ssl_ca_crt_file = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:41 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] vault.timeout = 60.0 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:41 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] vault.token_file = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:41 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] vault.token_role = None {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:41 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] vault.use_ssl = False {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:41 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:11:41 devstack cinder-volume[86736]: DEBUG oslo_service.backend._eventlet.service [None req-207dc022-8047-4a18-9a4a-3efc3fa2fcd5 None None] ******************************************************************************** {{(pid=86736) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 03 11:11:41 devstack sudo[87040]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.233s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:41 devstack cinder-volume[87038]: INFO cinder.volume.driver [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] Driver hasn't implemented _init_vendor_properties() Sep 03 11:11:41 devstack cinder-volume[87038]: DEBUG cinder.volume.driver [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8491134643555, 'free_capacity_gb': 1773.8491134643555, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87038) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 03 11:11:41 devstack cinder-volume[87038]: DEBUG oslo_db.sqlalchemy.engines [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87038) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 11:11:41 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writer thread running {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 03 11:11:41 devstack cinder-volume[87038]: DEBUG cinder.db.api [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] Building query based on filter {{(pid=87038) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 03 11:11:41 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87038) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 03 11:11:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:11:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:11:41 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:11:41 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:11:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:11:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:41 devstack cinder-volume[87038]: INFO cinder.keymgr.migration [None req-67fd7da9-6a91-47b4-aa6e-5094ebbe8605 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 03 11:11:41 devstack sudo[87053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:11:41 devstack sudo[87053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:41 devstack sudo[87053]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.229s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:41 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:11:41 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] Driver initialization completed successfully. Sep 03 11:11:41 devstack cinder-volume[87038]: INFO cinder.manager [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] Initiating service 3 cleanup Sep 03 11:11:41 devstack cinder-volume[87038]: INFO cinder.manager [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] Service 3 cleanup completed. Sep 03 11:11:41 devstack cinder-volume[87038]: DEBUG cinder.service [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] Creating RPC server for service cinder-volume {{(pid=87038) start /opt/stack/cinder/cinder/service.py:231}} Sep 03 11:11:41 devstack cinder-volume[87038]: DEBUG cinder.service [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87038) start /opt/stack/cinder/cinder/service.py:237}} Sep 03 11:11:41 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 03 11:11:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:11:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:11:41 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:11:41 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:11:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:11:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:11:41 devstack sudo[87064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:11:41 devstack sudo[87064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:11:41 devstack sudo[87064]: pam_unix(sudo:session): session closed for user root Sep 03 11:11:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.254s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:11:41 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-110d23f5-a05f-4b58-83a3-1fef3b8f0aec None None] Driver post RPC initialization completed successfully. Sep 03 11:11:50 devstack cinder-volume[86736]: DEBUG dbcounter [-] [86736] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86736) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:11:51 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=3 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:11:51 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:12:17 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:12:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread count: 6 {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:12:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread info: [<_MainThread(MainThread, started 139554943000704)>, , , , , ] {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:12:47 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b25fc05-9697-4acd-9491-16104cd8a72d tempest-DeleteServersTestJSON-685837928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:12:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5b25fc05-9697-4acd-9491-16104cd8a72d tempest-DeleteServersTestJSON-685837928 None] Flow 'volume_create_manager' (507b994e-83bb-4f79-9b95-325700ec1767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5b25fc05-9697-4acd-9491-16104cd8a72d tempest-DeleteServersTestJSON-685837928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0272f4d-350b-44e2-b8b3-d3e11131cd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5b25fc05-9697-4acd-9491-16104cd8a72d tempest-DeleteServersTestJSON-685837928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0272f4d-350b-44e2-b8b3-d3e11131cd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1732177014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c73f984-2b15-4cc7-aa45-973961d8b129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8510e4d4340a403d846d4a1b9d7461de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:47Z,use_quota=True,user_id='f181030b4b0546acad23f98c79c3178a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5b25fc05-9697-4acd-9491-16104cd8a72d tempest-DeleteServersTestJSON-685837928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62266da8-9540-4777-a97e-e4d4c91a7a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5b25fc05-9697-4acd-9491-16104cd8a72d tempest-DeleteServersTestJSON-685837928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62266da8-9540-4777-a97e-e4d4c91a7a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5b25fc05-9697-4acd-9491-16104cd8a72d tempest-DeleteServersTestJSON-685837928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b32b443f-0fe7-4d0c-b775-7727ac6e79a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5b25fc05-9697-4acd-9491-16104cd8a72d tempest-DeleteServersTestJSON-685837928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b32b443f-0fe7-4d0c-b775-7727ac6e79a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c73f984-2b15-4cc7-aa45-973961d8b129', 'volume_name': 'volume-9c73f984-2b15-4cc7-aa45-973961d8b129', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5b25fc05-9697-4acd-9491-16104cd8a72d tempest-DeleteServersTestJSON-685837928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d0d0ccb-b4d5-47c4-b1e6-9bb3c1f6409c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5b25fc05-9697-4acd-9491-16104cd8a72d tempest-DeleteServersTestJSON-685837928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d0d0ccb-b4d5-47c4-b1e6-9bb3c1f6409c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5b25fc05-9697-4acd-9491-16104cd8a72d tempest-DeleteServersTestJSON-685837928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95bb3dc2-96e9-4955-beef-0cce24c3fd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:47 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-5b25fc05-9697-4acd-9491-16104cd8a72d tempest-DeleteServersTestJSON-685837928 None] Volume 9c73f984-2b15-4cc7-aa45-973961d8b129: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c73f984-2b15-4cc7-aa45-973961d8b129', 'volume_size': 1} Sep 03 11:12:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5b25fc05-9697-4acd-9491-16104cd8a72d tempest-DeleteServersTestJSON-685837928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5b25fc05-9697-4acd-9491-16104cd8a72d tempest-DeleteServersTestJSON-685837928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:47 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5b25fc05-9697-4acd-9491-16104cd8a72d tempest-DeleteServersTestJSON-685837928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:12:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1732177014',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c73f984-2b15-4cc7-aa45-973961d8b129,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8510e4d4340a403d846d4a1b9d7461de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:12:47Z,use_quota=True,user_id='f181030b4b0546acad23f98c79c3178a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:12:47 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-5b25fc05-9697-4acd-9491-16104cd8a72d tempest-DeleteServersTestJSON-685837928 None] Creating volume 9c73f984-2b15-4cc7-aa45-973961d8b129 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:12:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5b25fc05-9697-4acd-9491-16104cd8a72d tempest-DeleteServersTestJSON-685837928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5b25fc05-9697-4acd-9491-16104cd8a72d tempest-DeleteServersTestJSON-685837928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:47 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5b25fc05-9697-4acd-9491-16104cd8a72d tempest-DeleteServersTestJSON-685837928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:12:47 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5b25fc05-9697-4acd-9491-16104cd8a72d tempest-DeleteServersTestJSON-685837928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:12:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5b25fc05-9697-4acd-9491-16104cd8a72d tempest-DeleteServersTestJSON-685837928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:47 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5b25fc05-9697-4acd-9491-16104cd8a72d tempest-DeleteServersTestJSON-685837928 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:12:47 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-5b25fc05-9697-4acd-9491-16104cd8a72d tempest-DeleteServersTestJSON-685837928 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:12:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5b25fc05-9697-4acd-9491-16104cd8a72d tempest-DeleteServersTestJSON-685837928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c73f984-2b15-4cc7-aa45-973961d8b129 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:47 devstack sudo[87649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c73f984-2b15-4cc7-aa45-973961d8b129 1073741824 Sep 03 11:12:47 devstack sudo[87649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:48 devstack sudo[87649]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5b25fc05-9697-4acd-9491-16104cd8a72d tempest-DeleteServersTestJSON-685837928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c73f984-2b15-4cc7-aa45-973961d8b129 1073741824" returned: 0 in 0.999s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5b25fc05-9697-4acd-9491-16104cd8a72d tempest-DeleteServersTestJSON-685837928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c73f984-2b15-4cc7-aa45-973961d8b129 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:12:48 devstack sudo[87975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c73f984-2b15-4cc7-aa45-973961d8b129 Sep 03 11:12:48 devstack sudo[87975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:12:49 devstack sudo[87975]: pam_unix(sudo:session): session closed for user root Sep 03 11:12:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5b25fc05-9697-4acd-9491-16104cd8a72d tempest-DeleteServersTestJSON-685837928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c73f984-2b15-4cc7-aa45-973961d8b129" returned: 0 in 0.552s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:12:49 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5b25fc05-9697-4acd-9491-16104cd8a72d tempest-DeleteServersTestJSON-685837928 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:12:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5b25fc05-9697-4acd-9491-16104cd8a72d tempest-DeleteServersTestJSON-685837928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.657s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5b25fc05-9697-4acd-9491-16104cd8a72d tempest-DeleteServersTestJSON-685837928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95bb3dc2-96e9-4955-beef-0cce24c3fd90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c73f984-2b15-4cc7-aa45-973961d8b129', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5b25fc05-9697-4acd-9491-16104cd8a72d tempest-DeleteServersTestJSON-685837928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b12a8be9-981b-4d45-87bd-ccb657c53efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:12:49 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-5b25fc05-9697-4acd-9491-16104cd8a72d tempest-DeleteServersTestJSON-685837928 None] Volume volume-9c73f984-2b15-4cc7-aa45-973961d8b129 (9c73f984-2b15-4cc7-aa45-973961d8b129): created successfully Sep 03 11:12:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5b25fc05-9697-4acd-9491-16104cd8a72d tempest-DeleteServersTestJSON-685837928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b12a8be9-981b-4d45-87bd-ccb657c53efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:12:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5b25fc05-9697-4acd-9491-16104cd8a72d tempest-DeleteServersTestJSON-685837928 None] Flow 'volume_create_manager' (507b994e-83bb-4f79-9b95-325700ec1767) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:12:49 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-5b25fc05-9697-4acd-9491-16104cd8a72d tempest-DeleteServersTestJSON-685837928 None] Created volume successfully. Sep 03 11:12:57 devstack cinder-volume[87038]: WARNING py.warnings [req-570e7e3b-17e3-478a-8e82-5180f8b2fac9 req-591c2cfa-de85-4e5a-83a2-d4f574a650c8 tempest-DeleteServersTestJSON-685837928 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Sep 03 11:12:57 devstack cinder-volume[87038]: .first() Sep 03 11:12:57 devstack cinder-volume[87038]: Sep 03 11:12:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-570e7e3b-17e3-478a-8e82-5180f8b2fac9 req-591c2cfa-de85-4e5a-83a2-d4f574a650c8 tempest-DeleteServersTestJSON-685837928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:12:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-570e7e3b-17e3-478a-8e82-5180f8b2fac9 req-591c2cfa-de85-4e5a-83a2-d4f574a650c8 tempest-DeleteServersTestJSON-685837928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:12:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-570e7e3b-17e3-478a-8e82-5180f8b2fac9 req-591c2cfa-de85-4e5a-83a2-d4f574a650c8 tempest-DeleteServersTestJSON-685837928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:12:57 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-570e7e3b-17e3-478a-8e82-5180f8b2fac9 req-591c2cfa-de85-4e5a-83a2-d4f574a650c8 tempest-DeleteServersTestJSON-685837928 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912', 'name': 'volume-9c73f984-2b15-4cc7-aa45-973961d8b129', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '115f4d19-f065-42f9-9e3c-87738acb39a3', 'enforce_multipath': True} {{(pid=87038) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:12:57 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-570e7e3b-17e3-478a-8e82-5180f8b2fac9 req-591c2cfa-de85-4e5a-83a2-d4f574a650c8 tempest-DeleteServersTestJSON-685837928 None] attachment_update completed successfully. Sep 03 11:13:03 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-04a32c47-dcf1-4479-8741-d7cc7fbb56a6 req-d88c81c9-e294-4ae9-9b75-a5e805e0c18a tempest-DeleteServersTestJSON-685837928 None] Terminate volume connection completed successfully. Sep 03 11:13:03 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-04a32c47-dcf1-4479-8741-d7cc7fbb56a6 req-d88c81c9-e294-4ae9-9b75-a5e805e0c18a tempest-DeleteServersTestJSON-685837928 None] Deleting attachment 115f4d19-f065-42f9-9e3c-87738acb39a3. {{(pid=87038) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:13:05 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-cf089e70-3ce3-4f3a-aaa2-af61ceab8d4b tempest-DeleteServersTestJSON-685837928 None] Acquiring lock "cinder-9c73f984-2b15-4cc7-aa45-973961d8b129-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:05 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-cf089e70-3ce3-4f3a-aaa2-af61ceab8d4b tempest-DeleteServersTestJSON-685837928 None] Lock "cinder-9c73f984-2b15-4cc7-aa45-973961d8b129-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:05 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-cf089e70-3ce3-4f3a-aaa2-af61ceab8d4b tempest-DeleteServersTestJSON-685837928 None] Acquiring lock "cinder-quobyte-9c73f984-2b15-4cc7-aa45-973961d8b129" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:05 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-cf089e70-3ce3-4f3a-aaa2-af61ceab8d4b tempest-DeleteServersTestJSON-685837928 None] Lock "cinder-quobyte-9c73f984-2b15-4cc7-aa45-973961d8b129" acquired by "delete_volume" :: waited 0.023s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:05 devstack cinder-volume[87038]: INFO oslo.privsep.daemon [None req-cf089e70-3ce3-4f3a-aaa2-af61ceab8d4b tempest-DeleteServersTestJSON-685837928 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpkicgs_dm/privsep.sock'] Sep 03 11:13:05 devstack sudo[88648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpkicgs_dm/privsep.sock Sep 03 11:13:05 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:07 devstack cinder-volume[87038]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 03 11:13:07 devstack cinder-volume[87038]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 03 11:13:07 devstack cinder-volume[87038]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 03 11:13:07 devstack cinder-volume[87038]: WARNING oslo.privsep.daemon [-] privsep log: Sep 03 11:13:07 devstack cinder-volume[87038]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 03 11:13:07 devstack cinder-volume[87038]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 03 11:13:07 devstack cinder-volume[87038]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 03 11:13:07 devstack cinder-volume[87038]: WARNING oslo.privsep.daemon [-] privsep log: Sep 03 11:13:07 devstack cinder-volume[87038]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 03 11:13:07 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:07 devstack cinder-volume[87038]: INFO oslo.privsep.daemon [None req-cf089e70-3ce3-4f3a-aaa2-af61ceab8d4b tempest-DeleteServersTestJSON-685837928 None] Spawned new privsep daemon via rootwrap Sep 03 11:13:07 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [None req-cf089e70-3ce3-4f3a-aaa2-af61ceab8d4b tempest-DeleteServersTestJSON-685837928 None] Accepted privsep connection to /tmp/tmpkicgs_dm/privsep.sock {{(pid=87038) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 03 11:13:07 devstack cinder-volume[87038]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 03 11:13:07 devstack cinder-volume[87038]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 03 11:13:07 devstack cinder-volume[87038]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 03 11:13:07 devstack cinder-volume[87038]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88738 Sep 03 11:13:07 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[66126ab3-5569-4e59-a20f-5a507e19be9d]: (2,) {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:07 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d545204-1834-4071-ae09-c65331b675ae]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cf089e70-3ce3-4f3a-aaa2-af61ceab8d4b tempest-DeleteServersTestJSON-685837928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c73f984-2b15-4cc7-aa45-973961d8b129 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:07 devstack sudo[88741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c73f984-2b15-4cc7-aa45-973961d8b129 Sep 03 11:13:07 devstack sudo[88741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:07 devstack sudo[88741]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cf089e70-3ce3-4f3a-aaa2-af61ceab8d4b tempest-DeleteServersTestJSON-685837928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c73f984-2b15-4cc7-aa45-973961d8b129" returned: 0 in 0.533s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cf089e70-3ce3-4f3a-aaa2-af61ceab8d4b tempest-DeleteServersTestJSON-685837928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c73f984-2b15-4cc7-aa45-973961d8b129 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:07 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-66a02c61-6f61-4530-83ae-180843ee4422 tempest-VolumesAdminNegativeTest-232521603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:13:08 devstack sudo[88746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c73f984-2b15-4cc7-aa45-973961d8b129 Sep 03 11:13:08 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-66a02c61-6f61-4530-83ae-180843ee4422 tempest-VolumesAdminNegativeTest-232521603 None] Flow 'volume_create_manager' (9777afc8-d235-490c-bb0b-223231a308a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-66a02c61-6f61-4530-83ae-180843ee4422 tempest-VolumesAdminNegativeTest-232521603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff83b178-4682-4ff6-87f9-6fd588631ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-66a02c61-6f61-4530-83ae-180843ee4422 tempest-VolumesAdminNegativeTest-232521603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff83b178-4682-4ff6-87f9-6fd588631ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1892892085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2cb7c56-3cd4-4649-aa4b-cce045a765fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58c947ad96eb4e278cacea0d8fb389ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:08Z,use_quota=True,user_id='598f411e4d1c45bb81aa760200bcc918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-66a02c61-6f61-4530-83ae-180843ee4422 tempest-VolumesAdminNegativeTest-232521603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58e9bac1-7635-493d-b2ce-f7e50436bfdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-66a02c61-6f61-4530-83ae-180843ee4422 tempest-VolumesAdminNegativeTest-232521603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58e9bac1-7635-493d-b2ce-f7e50436bfdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-66a02c61-6f61-4530-83ae-180843ee4422 tempest-VolumesAdminNegativeTest-232521603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10cf131b-d31c-4f13-9c6f-bbf05c2fc49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-66a02c61-6f61-4530-83ae-180843ee4422 tempest-VolumesAdminNegativeTest-232521603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10cf131b-d31c-4f13-9c6f-bbf05c2fc49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2cb7c56-3cd4-4649-aa4b-cce045a765fc', 'volume_name': 'volume-b2cb7c56-3cd4-4649-aa4b-cce045a765fc', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-66a02c61-6f61-4530-83ae-180843ee4422 tempest-VolumesAdminNegativeTest-232521603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a65b251a-d67b-4a78-8dab-55a1dbd2f3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-66a02c61-6f61-4530-83ae-180843ee4422 tempest-VolumesAdminNegativeTest-232521603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a65b251a-d67b-4a78-8dab-55a1dbd2f3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-66a02c61-6f61-4530-83ae-180843ee4422 tempest-VolumesAdminNegativeTest-232521603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e8629f9-864f-42e2-9460-99d1c6e607c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:08 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-66a02c61-6f61-4530-83ae-180843ee4422 tempest-VolumesAdminNegativeTest-232521603 None] Volume b2cb7c56-3cd4-4649-aa4b-cce045a765fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2cb7c56-3cd4-4649-aa4b-cce045a765fc', 'volume_size': 1} Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-66a02c61-6f61-4530-83ae-180843ee4422 tempest-VolumesAdminNegativeTest-232521603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-66a02c61-6f61-4530-83ae-180843ee4422 tempest-VolumesAdminNegativeTest-232521603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-66a02c61-6f61-4530-83ae-180843ee4422 tempest-VolumesAdminNegativeTest-232521603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1892892085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2cb7c56-3cd4-4649-aa4b-cce045a765fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='58c947ad96eb4e278cacea0d8fb389ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:08Z,use_quota=True,user_id='598f411e4d1c45bb81aa760200bcc918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-66a02c61-6f61-4530-83ae-180843ee4422 tempest-VolumesAdminNegativeTest-232521603 None] Creating volume b2cb7c56-3cd4-4649-aa4b-cce045a765fc {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-66a02c61-6f61-4530-83ae-180843ee4422 tempest-VolumesAdminNegativeTest-232521603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-66a02c61-6f61-4530-83ae-180843ee4422 tempest-VolumesAdminNegativeTest-232521603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-66a02c61-6f61-4530-83ae-180843ee4422 tempest-VolumesAdminNegativeTest-232521603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-66a02c61-6f61-4530-83ae-180843ee4422 tempest-VolumesAdminNegativeTest-232521603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-66a02c61-6f61-4530-83ae-180843ee4422 tempest-VolumesAdminNegativeTest-232521603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-66a02c61-6f61-4530-83ae-180843ee4422 tempest-VolumesAdminNegativeTest-232521603 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:13:08 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-66a02c61-6f61-4530-83ae-180843ee4422 tempest-VolumesAdminNegativeTest-232521603 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-66a02c61-6f61-4530-83ae-180843ee4422 tempest-VolumesAdminNegativeTest-232521603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b2cb7c56-3cd4-4649-aa4b-cce045a765fc 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:08 devstack sudo[88748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b2cb7c56-3cd4-4649-aa4b-cce045a765fc 1073741824 Sep 03 11:13:08 devstack sudo[88748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:08 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cf089e70-3ce3-4f3a-aaa2-af61ceab8d4b tempest-DeleteServersTestJSON-685837928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c73f984-2b15-4cc7-aa45-973961d8b129" returned: 0 in 0.292s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-cf089e70-3ce3-4f3a-aaa2-af61ceab8d4b tempest-DeleteServersTestJSON-685837928 None] Lock "cinder-quobyte-9c73f984-2b15-4cc7-aa45-973961d8b129" released by "delete_volume" :: held 2.894s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:08 devstack cinder-volume[87038]: WARNING cinder.quota [None req-cf089e70-3ce3-4f3a-aaa2-af61ceab8d4b tempest-DeleteServersTestJSON-685837928 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:13:08 devstack cinder-volume[87038]: WARNING cinder.quota [None req-cf089e70-3ce3-4f3a-aaa2-af61ceab8d4b tempest-DeleteServersTestJSON-685837928 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-cf089e70-3ce3-4f3a-aaa2-af61ceab8d4b tempest-DeleteServersTestJSON-685837928 None] Created reservations ['88441c65-f101-493d-8ac8-f072c667d556', 'a9188ea0-1610-4d1a-9a32-4a8e7b58e913', '153aec70-9fc4-4a85-a364-41f38da00cae', '43b390b1-f88e-4b4c-bb28-6a05afc7d60d'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-cf089e70-3ce3-4f3a-aaa2-af61ceab8d4b tempest-DeleteServersTestJSON-685837928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-cf089e70-3ce3-4f3a-aaa2-af61ceab8d4b tempest-DeleteServersTestJSON-685837928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-cf089e70-3ce3-4f3a-aaa2-af61ceab8d4b tempest-DeleteServersTestJSON-685837928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-cf089e70-3ce3-4f3a-aaa2-af61ceab8d4b tempest-DeleteServersTestJSON-685837928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-cf089e70-3ce3-4f3a-aaa2-af61ceab8d4b tempest-DeleteServersTestJSON-685837928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cf089e70-3ce3-4f3a-aaa2-af61ceab8d4b tempest-DeleteServersTestJSON-685837928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:08 devstack sudo[88754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:13:08 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:08 devstack sudo[88748]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-66a02c61-6f61-4530-83ae-180843ee4422 tempest-VolumesAdminNegativeTest-232521603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b2cb7c56-3cd4-4649-aa4b-cce045a765fc 1073741824" returned: 0 in 0.443s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-66a02c61-6f61-4530-83ae-180843ee4422 tempest-VolumesAdminNegativeTest-232521603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b2cb7c56-3cd4-4649-aa4b-cce045a765fc {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:08 devstack sudo[88757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b2cb7c56-3cd4-4649-aa4b-cce045a765fc Sep 03 11:13:08 devstack sudo[88757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:08 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cf089e70-3ce3-4f3a-aaa2-af61ceab8d4b tempest-DeleteServersTestJSON-685837928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.328s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-cf089e70-3ce3-4f3a-aaa2-af61ceab8d4b tempest-DeleteServersTestJSON-685837928 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:13:08 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-cf089e70-3ce3-4f3a-aaa2-af61ceab8d4b tempest-DeleteServersTestJSON-685837928 None] Deleted volume successfully. Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-cf089e70-3ce3-4f3a-aaa2-af61ceab8d4b tempest-DeleteServersTestJSON-685837928 None] Lock "cinder-9c73f984-2b15-4cc7-aa45-973961d8b129-delete_volume" released by "delete_volume" :: held 3.541s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:08 devstack sudo[88757]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-66a02c61-6f61-4530-83ae-180843ee4422 tempest-VolumesAdminNegativeTest-232521603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b2cb7c56-3cd4-4649-aa4b-cce045a765fc" returned: 0 in 0.331s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-66a02c61-6f61-4530-83ae-180843ee4422 tempest-VolumesAdminNegativeTest-232521603 None] <== create_volume: return (830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-66a02c61-6f61-4530-83ae-180843ee4422 tempest-VolumesAdminNegativeTest-232521603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-66a02c61-6f61-4530-83ae-180843ee4422 tempest-VolumesAdminNegativeTest-232521603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e8629f9-864f-42e2-9460-99d1c6e607c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2cb7c56-3cd4-4649-aa4b-cce045a765fc', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-66a02c61-6f61-4530-83ae-180843ee4422 tempest-VolumesAdminNegativeTest-232521603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (307c4d98-c1e2-436e-b6f2-59544e9b7bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:08 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-66a02c61-6f61-4530-83ae-180843ee4422 tempest-VolumesAdminNegativeTest-232521603 None] Volume volume-b2cb7c56-3cd4-4649-aa4b-cce045a765fc (b2cb7c56-3cd4-4649-aa4b-cce045a765fc): created successfully Sep 03 11:13:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-66a02c61-6f61-4530-83ae-180843ee4422 tempest-VolumesAdminNegativeTest-232521603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (307c4d98-c1e2-436e-b6f2-59544e9b7bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-66a02c61-6f61-4530-83ae-180843ee4422 tempest-VolumesAdminNegativeTest-232521603 None] Flow 'volume_create_manager' (9777afc8-d235-490c-bb0b-223231a308a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:09 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-66a02c61-6f61-4530-83ae-180843ee4422 tempest-VolumesAdminNegativeTest-232521603 None] Created volume successfully. Sep 03 11:13:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-082a377b-62d4-4a98-a93e-4c2c09c93a39 tempest-VolumesAdminNegativeTest-232521603 None] Acquiring lock "cinder-b2cb7c56-3cd4-4649-aa4b-cce045a765fc-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-082a377b-62d4-4a98-a93e-4c2c09c93a39 tempest-VolumesAdminNegativeTest-232521603 None] Lock "cinder-b2cb7c56-3cd4-4649-aa4b-cce045a765fc-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-082a377b-62d4-4a98-a93e-4c2c09c93a39 tempest-VolumesAdminNegativeTest-232521603 None] Acquiring lock "cinder-quobyte-b2cb7c56-3cd4-4649-aa4b-cce045a765fc" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:13:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-082a377b-62d4-4a98-a93e-4c2c09c93a39 tempest-VolumesAdminNegativeTest-232521603 None] Lock "cinder-quobyte-b2cb7c56-3cd4-4649-aa4b-cce045a765fc" acquired by "delete_volume" :: waited 0.024s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:13:10 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff2dd30-bb53-4db7-8925-631bbac84d9d]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:13:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-082a377b-62d4-4a98-a93e-4c2c09c93a39 tempest-VolumesAdminNegativeTest-232521603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b2cb7c56-3cd4-4649-aa4b-cce045a765fc {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:10 devstack sudo[88762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b2cb7c56-3cd4-4649-aa4b-cce045a765fc Sep 03 11:13:10 devstack sudo[88762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:10 devstack sudo[88762]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-082a377b-62d4-4a98-a93e-4c2c09c93a39 tempest-VolumesAdminNegativeTest-232521603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b2cb7c56-3cd4-4649-aa4b-cce045a765fc" returned: 0 in 0.499s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-082a377b-62d4-4a98-a93e-4c2c09c93a39 tempest-VolumesAdminNegativeTest-232521603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b2cb7c56-3cd4-4649-aa4b-cce045a765fc {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:11 devstack sudo[88769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b2cb7c56-3cd4-4649-aa4b-cce045a765fc Sep 03 11:13:11 devstack sudo[88769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:11 devstack sudo[88769]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-082a377b-62d4-4a98-a93e-4c2c09c93a39 tempest-VolumesAdminNegativeTest-232521603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b2cb7c56-3cd4-4649-aa4b-cce045a765fc" returned: 0 in 0.397s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:11 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-082a377b-62d4-4a98-a93e-4c2c09c93a39 tempest-VolumesAdminNegativeTest-232521603 None] Lock "cinder-quobyte-b2cb7c56-3cd4-4649-aa4b-cce045a765fc" released by "delete_volume" :: held 0.940s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:11 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-082a377b-62d4-4a98-a93e-4c2c09c93a39 tempest-VolumesAdminNegativeTest-232521603 None] Created reservations ['247a2e54-e471-4bd9-bd7f-79b10378d334', '3be43175-888a-4da6-9b7a-d83df230b505', 'a2770d79-1d2e-4118-a664-943660e780cf', '6ba9bd18-b040-4f01-ade2-8701a71e44c7'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:13:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-082a377b-62d4-4a98-a93e-4c2c09c93a39 tempest-VolumesAdminNegativeTest-232521603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-082a377b-62d4-4a98-a93e-4c2c09c93a39 tempest-VolumesAdminNegativeTest-232521603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-082a377b-62d4-4a98-a93e-4c2c09c93a39 tempest-VolumesAdminNegativeTest-232521603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-082a377b-62d4-4a98-a93e-4c2c09c93a39 tempest-VolumesAdminNegativeTest-232521603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-082a377b-62d4-4a98-a93e-4c2c09c93a39 tempest-VolumesAdminNegativeTest-232521603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-082a377b-62d4-4a98-a93e-4c2c09c93a39 tempest-VolumesAdminNegativeTest-232521603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:11 devstack sudo[88772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:13:11 devstack sudo[88772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:12 devstack sudo[88772]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-082a377b-62d4-4a98-a93e-4c2c09c93a39 tempest-VolumesAdminNegativeTest-232521603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.400s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:12 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-082a377b-62d4-4a98-a93e-4c2c09c93a39 tempest-VolumesAdminNegativeTest-232521603 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:13:12 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-082a377b-62d4-4a98-a93e-4c2c09c93a39 tempest-VolumesAdminNegativeTest-232521603 None] Deleted volume successfully. Sep 03 11:13:12 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-082a377b-62d4-4a98-a93e-4c2c09c93a39 tempest-VolumesAdminNegativeTest-232521603 None] Lock "cinder-b2cb7c56-3cd4-4649-aa4b-cce045a765fc-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:13:17 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:13:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:17 devstack sudo[88807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:13:17 devstack sudo[88807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:18 devstack sudo[88807]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.277s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:18 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:13:18 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:13:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread count: 8 {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:13:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread info: [<_MainThread(MainThread, started 139554943000704)>, , , , , , , ] {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:13:21 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=17,cinder:UPDATE=26,cinder:DELETE=2,cinder:INSERT=5 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:13:22 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=26,cinder:UPDATE=21,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:13:22 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbc902ab-5827-4b33-ac54-ccc70af91388 tempest-ServerActionsTestOtherA-914104622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:13:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-dbc902ab-5827-4b33-ac54-ccc70af91388 tempest-ServerActionsTestOtherA-914104622 None] Flow 'volume_create_manager' (2517929f-ecf1-44ec-aa76-6814b1af24c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-dbc902ab-5827-4b33-ac54-ccc70af91388 tempest-ServerActionsTestOtherA-914104622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37f6edc3-9933-4c54-ba4e-e57512e8ea4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-dbc902ab-5827-4b33-ac54-ccc70af91388 tempest-ServerActionsTestOtherA-914104622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37f6edc3-9933-4c54-ba4e-e57512e8ea4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1305071145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe5ee465-bdd3-4908-a270-c42487448c64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31a5439975e54962a5c8b30af3d0b213',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:23Z,use_quota=True,user_id='1626a63865fd44769359e6a112645437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-dbc902ab-5827-4b33-ac54-ccc70af91388 tempest-ServerActionsTestOtherA-914104622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (951984e1-9bec-4d39-8e65-5ad1fecacd87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-dbc902ab-5827-4b33-ac54-ccc70af91388 tempest-ServerActionsTestOtherA-914104622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (951984e1-9bec-4d39-8e65-5ad1fecacd87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-dbc902ab-5827-4b33-ac54-ccc70af91388 tempest-ServerActionsTestOtherA-914104622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d84e9b-b506-472a-93e1-08dc3aabf779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-dbc902ab-5827-4b33-ac54-ccc70af91388 tempest-ServerActionsTestOtherA-914104622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4d84e9b-b506-472a-93e1-08dc3aabf779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe5ee465-bdd3-4908-a270-c42487448c64', 'volume_name': 'volume-fe5ee465-bdd3-4908-a270-c42487448c64', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-dbc902ab-5827-4b33-ac54-ccc70af91388 tempest-ServerActionsTestOtherA-914104622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bdf7ebc-1b17-4b87-8c8c-276fc8ebb134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-dbc902ab-5827-4b33-ac54-ccc70af91388 tempest-ServerActionsTestOtherA-914104622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bdf7ebc-1b17-4b87-8c8c-276fc8ebb134) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-dbc902ab-5827-4b33-ac54-ccc70af91388 tempest-ServerActionsTestOtherA-914104622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7364f755-8535-4299-9d32-8cb4b76e52e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:22 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-dbc902ab-5827-4b33-ac54-ccc70af91388 tempest-ServerActionsTestOtherA-914104622 None] Volume fe5ee465-bdd3-4908-a270-c42487448c64: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe5ee465-bdd3-4908-a270-c42487448c64', 'volume_size': 1} Sep 03 11:13:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-dbc902ab-5827-4b33-ac54-ccc70af91388 tempest-ServerActionsTestOtherA-914104622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-dbc902ab-5827-4b33-ac54-ccc70af91388 tempest-ServerActionsTestOtherA-914104622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:22 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-dbc902ab-5827-4b33-ac54-ccc70af91388 tempest-ServerActionsTestOtherA-914104622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1305071145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe5ee465-bdd3-4908-a270-c42487448c64,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31a5439975e54962a5c8b30af3d0b213',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:23Z,use_quota=True,user_id='1626a63865fd44769359e6a112645437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:13:22 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-dbc902ab-5827-4b33-ac54-ccc70af91388 tempest-ServerActionsTestOtherA-914104622 None] Creating volume fe5ee465-bdd3-4908-a270-c42487448c64 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:13:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-dbc902ab-5827-4b33-ac54-ccc70af91388 tempest-ServerActionsTestOtherA-914104622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-dbc902ab-5827-4b33-ac54-ccc70af91388 tempest-ServerActionsTestOtherA-914104622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:22 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-dbc902ab-5827-4b33-ac54-ccc70af91388 tempest-ServerActionsTestOtherA-914104622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:22 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-dbc902ab-5827-4b33-ac54-ccc70af91388 tempest-ServerActionsTestOtherA-914104622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-dbc902ab-5827-4b33-ac54-ccc70af91388 tempest-ServerActionsTestOtherA-914104622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:22 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-dbc902ab-5827-4b33-ac54-ccc70af91388 tempest-ServerActionsTestOtherA-914104622 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:13:22 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-dbc902ab-5827-4b33-ac54-ccc70af91388 tempest-ServerActionsTestOtherA-914104622 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:13:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-dbc902ab-5827-4b33-ac54-ccc70af91388 tempest-ServerActionsTestOtherA-914104622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fe5ee465-bdd3-4908-a270-c42487448c64 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:22 devstack sudo[88813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fe5ee465-bdd3-4908-a270-c42487448c64 1073741824 Sep 03 11:13:22 devstack sudo[88813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:23 devstack sudo[88813]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-dbc902ab-5827-4b33-ac54-ccc70af91388 tempest-ServerActionsTestOtherA-914104622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fe5ee465-bdd3-4908-a270-c42487448c64 1073741824" returned: 0 in 0.606s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-dbc902ab-5827-4b33-ac54-ccc70af91388 tempest-ServerActionsTestOtherA-914104622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fe5ee465-bdd3-4908-a270-c42487448c64 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:23 devstack sudo[88819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fe5ee465-bdd3-4908-a270-c42487448c64 Sep 03 11:13:23 devstack sudo[88819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:23 devstack sudo[88819]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-dbc902ab-5827-4b33-ac54-ccc70af91388 tempest-ServerActionsTestOtherA-914104622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fe5ee465-bdd3-4908-a270-c42487448c64" returned: 0 in 0.257s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:23 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-dbc902ab-5827-4b33-ac54-ccc70af91388 tempest-ServerActionsTestOtherA-914104622 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:13:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-dbc902ab-5827-4b33-ac54-ccc70af91388 tempest-ServerActionsTestOtherA-914104622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-dbc902ab-5827-4b33-ac54-ccc70af91388 tempest-ServerActionsTestOtherA-914104622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7364f755-8535-4299-9d32-8cb4b76e52e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe5ee465-bdd3-4908-a270-c42487448c64', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-dbc902ab-5827-4b33-ac54-ccc70af91388 tempest-ServerActionsTestOtherA-914104622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de957b91-c6f3-4b3e-a317-8c20f2d665c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:23 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-dbc902ab-5827-4b33-ac54-ccc70af91388 tempest-ServerActionsTestOtherA-914104622 None] Volume volume-fe5ee465-bdd3-4908-a270-c42487448c64 (fe5ee465-bdd3-4908-a270-c42487448c64): created successfully Sep 03 11:13:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-dbc902ab-5827-4b33-ac54-ccc70af91388 tempest-ServerActionsTestOtherA-914104622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de957b91-c6f3-4b3e-a317-8c20f2d665c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-dbc902ab-5827-4b33-ac54-ccc70af91388 tempest-ServerActionsTestOtherA-914104622 None] Flow 'volume_create_manager' (2517929f-ecf1-44ec-aa76-6814b1af24c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:23 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-dbc902ab-5827-4b33-ac54-ccc70af91388 tempest-ServerActionsTestOtherA-914104622 None] Created volume successfully. Sep 03 11:13:33 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:13:33 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=2,cinder:UPDATE=2,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:13:49 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bb6553a-b133-4599-b1f0-2c1490f80cfa tempest-TaggedAttachmentsTest-2046288793 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:13:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7bb6553a-b133-4599-b1f0-2c1490f80cfa tempest-TaggedAttachmentsTest-2046288793 None] Flow 'volume_create_manager' (eb722f75-04dc-4d90-ae38-ac9b65b35452) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7bb6553a-b133-4599-b1f0-2c1490f80cfa tempest-TaggedAttachmentsTest-2046288793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c313513a-7576-4573-8e5d-a6306dec1170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7bb6553a-b133-4599-b1f0-2c1490f80cfa tempest-TaggedAttachmentsTest-2046288793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c313513a-7576-4573-8e5d-a6306dec1170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-341087303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af5a3fd7-e087-403c-b1d5-d324e091a7fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='783ef9aa18e94a52bf58832fc2eb9d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:50Z,use_quota=True,user_id='2cdc5a1aaa304287ba38406b88685a37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7bb6553a-b133-4599-b1f0-2c1490f80cfa tempest-TaggedAttachmentsTest-2046288793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4887b60b-4f24-4d97-a6f0-03277a2f8f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7bb6553a-b133-4599-b1f0-2c1490f80cfa tempest-TaggedAttachmentsTest-2046288793 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4887b60b-4f24-4d97-a6f0-03277a2f8f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7bb6553a-b133-4599-b1f0-2c1490f80cfa tempest-TaggedAttachmentsTest-2046288793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92fbd2d1-014e-49e0-b31f-d8e155214a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7bb6553a-b133-4599-b1f0-2c1490f80cfa tempest-TaggedAttachmentsTest-2046288793 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92fbd2d1-014e-49e0-b31f-d8e155214a22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af5a3fd7-e087-403c-b1d5-d324e091a7fd', 'volume_name': 'volume-af5a3fd7-e087-403c-b1d5-d324e091a7fd', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7bb6553a-b133-4599-b1f0-2c1490f80cfa tempest-TaggedAttachmentsTest-2046288793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f31acef7-c3f2-4477-94cf-387d224ef3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7bb6553a-b133-4599-b1f0-2c1490f80cfa tempest-TaggedAttachmentsTest-2046288793 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f31acef7-c3f2-4477-94cf-387d224ef3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7bb6553a-b133-4599-b1f0-2c1490f80cfa tempest-TaggedAttachmentsTest-2046288793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6f50a20-e940-4a5f-9db1-40e5282051e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:50 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-7bb6553a-b133-4599-b1f0-2c1490f80cfa tempest-TaggedAttachmentsTest-2046288793 None] Volume af5a3fd7-e087-403c-b1d5-d324e091a7fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af5a3fd7-e087-403c-b1d5-d324e091a7fd', 'volume_size': 1} Sep 03 11:13:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7bb6553a-b133-4599-b1f0-2c1490f80cfa tempest-TaggedAttachmentsTest-2046288793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7bb6553a-b133-4599-b1f0-2c1490f80cfa tempest-TaggedAttachmentsTest-2046288793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:50 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7bb6553a-b133-4599-b1f0-2c1490f80cfa tempest-TaggedAttachmentsTest-2046288793 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-341087303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af5a3fd7-e087-403c-b1d5-d324e091a7fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='783ef9aa18e94a52bf58832fc2eb9d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:13:50Z,use_quota=True,user_id='2cdc5a1aaa304287ba38406b88685a37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:13:50 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-7bb6553a-b133-4599-b1f0-2c1490f80cfa tempest-TaggedAttachmentsTest-2046288793 None] Creating volume af5a3fd7-e087-403c-b1d5-d324e091a7fd {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:13:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7bb6553a-b133-4599-b1f0-2c1490f80cfa tempest-TaggedAttachmentsTest-2046288793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:13:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7bb6553a-b133-4599-b1f0-2c1490f80cfa tempest-TaggedAttachmentsTest-2046288793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:13:50 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7bb6553a-b133-4599-b1f0-2c1490f80cfa tempest-TaggedAttachmentsTest-2046288793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:13:50 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7bb6553a-b133-4599-b1f0-2c1490f80cfa tempest-TaggedAttachmentsTest-2046288793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:13:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7bb6553a-b133-4599-b1f0-2c1490f80cfa tempest-TaggedAttachmentsTest-2046288793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:50 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7bb6553a-b133-4599-b1f0-2c1490f80cfa tempest-TaggedAttachmentsTest-2046288793 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:13:50 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-7bb6553a-b133-4599-b1f0-2c1490f80cfa tempest-TaggedAttachmentsTest-2046288793 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:13:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7bb6553a-b133-4599-b1f0-2c1490f80cfa tempest-TaggedAttachmentsTest-2046288793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-af5a3fd7-e087-403c-b1d5-d324e091a7fd 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:50 devstack sudo[88903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-af5a3fd7-e087-403c-b1d5-d324e091a7fd 1073741824 Sep 03 11:13:50 devstack sudo[88903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:50 devstack sudo[88903]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7bb6553a-b133-4599-b1f0-2c1490f80cfa tempest-TaggedAttachmentsTest-2046288793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-af5a3fd7-e087-403c-b1d5-d324e091a7fd 1073741824" returned: 0 in 0.667s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7bb6553a-b133-4599-b1f0-2c1490f80cfa tempest-TaggedAttachmentsTest-2046288793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-af5a3fd7-e087-403c-b1d5-d324e091a7fd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:13:50 devstack sudo[88948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-af5a3fd7-e087-403c-b1d5-d324e091a7fd Sep 03 11:13:50 devstack sudo[88948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:13:51 devstack sudo[88948]: pam_unix(sudo:session): session closed for user root Sep 03 11:13:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7bb6553a-b133-4599-b1f0-2c1490f80cfa tempest-TaggedAttachmentsTest-2046288793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-af5a3fd7-e087-403c-b1d5-d324e091a7fd" returned: 0 in 0.495s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:13:51 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7bb6553a-b133-4599-b1f0-2c1490f80cfa tempest-TaggedAttachmentsTest-2046288793 None] <== create_volume: return (1289ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:13:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7bb6553a-b133-4599-b1f0-2c1490f80cfa tempest-TaggedAttachmentsTest-2046288793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:13:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7bb6553a-b133-4599-b1f0-2c1490f80cfa tempest-TaggedAttachmentsTest-2046288793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6f50a20-e940-4a5f-9db1-40e5282051e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af5a3fd7-e087-403c-b1d5-d324e091a7fd', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7bb6553a-b133-4599-b1f0-2c1490f80cfa tempest-TaggedAttachmentsTest-2046288793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70955e75-8c12-4d1c-9ee1-dd497cd2411f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:13:51 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-7bb6553a-b133-4599-b1f0-2c1490f80cfa tempest-TaggedAttachmentsTest-2046288793 None] Volume volume-af5a3fd7-e087-403c-b1d5-d324e091a7fd (af5a3fd7-e087-403c-b1d5-d324e091a7fd): created successfully Sep 03 11:13:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7bb6553a-b133-4599-b1f0-2c1490f80cfa tempest-TaggedAttachmentsTest-2046288793 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70955e75-8c12-4d1c-9ee1-dd497cd2411f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:13:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7bb6553a-b133-4599-b1f0-2c1490f80cfa tempest-TaggedAttachmentsTest-2046288793 None] Flow 'volume_create_manager' (eb722f75-04dc-4d90-ae38-ac9b65b35452) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:13:51 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-7bb6553a-b133-4599-b1f0-2c1490f80cfa tempest-TaggedAttachmentsTest-2046288793 None] Created volume successfully. Sep 03 11:14:01 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=3,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:14:01 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=2,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:14:17 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:14:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:14:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:14:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:18 devstack sudo[89318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:14:18 devstack sudo[89318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:19 devstack sudo[89318]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 1.190s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:19 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:14:19 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:14:19 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread count: 8 {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:14:19 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread info: [<_MainThread(MainThread, started 139554943000704)>, , , , , , , ] {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:14:25 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-58eca12a-17d8-49b5-8a84-128f0c69951a tempest-ServersNegativeTestJSON-748798677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:14:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-58eca12a-17d8-49b5-8a84-128f0c69951a tempest-ServersNegativeTestJSON-748798677 None] Flow 'volume_create_manager' (5c5afaa9-bf71-4fb8-aba3-d978ce926639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:14:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-58eca12a-17d8-49b5-8a84-128f0c69951a tempest-ServersNegativeTestJSON-748798677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70072146-c455-4191-bb00-c6ff3c05ad0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-58eca12a-17d8-49b5-8a84-128f0c69951a tempest-ServersNegativeTestJSON-748798677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70072146-c455-4191-bb00-c6ff3c05ad0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-235167905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a02815d-01b2-4b15-879c-65b67a509478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da6f99daea874cbc977c35acfe86fc1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:14:26Z,use_quota=True,user_id='eae238b5c73c4888be6ada859b40d9d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-58eca12a-17d8-49b5-8a84-128f0c69951a tempest-ServersNegativeTestJSON-748798677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4269b207-4fe7-43a0-8506-690f6f4d4aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-58eca12a-17d8-49b5-8a84-128f0c69951a tempest-ServersNegativeTestJSON-748798677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4269b207-4fe7-43a0-8506-690f6f4d4aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-58eca12a-17d8-49b5-8a84-128f0c69951a tempest-ServersNegativeTestJSON-748798677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76e33462-03b1-4ef5-a946-685de6b9cacf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-58eca12a-17d8-49b5-8a84-128f0c69951a tempest-ServersNegativeTestJSON-748798677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76e33462-03b1-4ef5-a946-685de6b9cacf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a02815d-01b2-4b15-879c-65b67a509478', 'volume_name': 'volume-7a02815d-01b2-4b15-879c-65b67a509478', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-58eca12a-17d8-49b5-8a84-128f0c69951a tempest-ServersNegativeTestJSON-748798677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76a63dda-c0b7-4640-a5d3-438e844b6781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-58eca12a-17d8-49b5-8a84-128f0c69951a tempest-ServersNegativeTestJSON-748798677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76a63dda-c0b7-4640-a5d3-438e844b6781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-58eca12a-17d8-49b5-8a84-128f0c69951a tempest-ServersNegativeTestJSON-748798677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d577af-ba62-40d8-bf1b-86165c06118b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:26 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-58eca12a-17d8-49b5-8a84-128f0c69951a tempest-ServersNegativeTestJSON-748798677 None] Volume 7a02815d-01b2-4b15-879c-65b67a509478: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a02815d-01b2-4b15-879c-65b67a509478', 'volume_size': 1} Sep 03 11:14:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-58eca12a-17d8-49b5-8a84-128f0c69951a tempest-ServersNegativeTestJSON-748798677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-58eca12a-17d8-49b5-8a84-128f0c69951a tempest-ServersNegativeTestJSON-748798677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:26 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-58eca12a-17d8-49b5-8a84-128f0c69951a tempest-ServersNegativeTestJSON-748798677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:14:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-235167905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a02815d-01b2-4b15-879c-65b67a509478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da6f99daea874cbc977c35acfe86fc1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:14:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:14:26Z,use_quota=True,user_id='eae238b5c73c4888be6ada859b40d9d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:14:26 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-58eca12a-17d8-49b5-8a84-128f0c69951a tempest-ServersNegativeTestJSON-748798677 None] Creating volume 7a02815d-01b2-4b15-879c-65b67a509478 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:14:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-58eca12a-17d8-49b5-8a84-128f0c69951a tempest-ServersNegativeTestJSON-748798677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-58eca12a-17d8-49b5-8a84-128f0c69951a tempest-ServersNegativeTestJSON-748798677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:26 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-58eca12a-17d8-49b5-8a84-128f0c69951a tempest-ServersNegativeTestJSON-748798677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:14:26 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-58eca12a-17d8-49b5-8a84-128f0c69951a tempest-ServersNegativeTestJSON-748798677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:14:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-58eca12a-17d8-49b5-8a84-128f0c69951a tempest-ServersNegativeTestJSON-748798677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:26 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-58eca12a-17d8-49b5-8a84-128f0c69951a tempest-ServersNegativeTestJSON-748798677 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:14:26 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-58eca12a-17d8-49b5-8a84-128f0c69951a tempest-ServersNegativeTestJSON-748798677 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:14:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-58eca12a-17d8-49b5-8a84-128f0c69951a tempest-ServersNegativeTestJSON-748798677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7a02815d-01b2-4b15-879c-65b67a509478 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:26 devstack sudo[89434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7a02815d-01b2-4b15-879c-65b67a509478 1073741824 Sep 03 11:14:26 devstack sudo[89434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:27 devstack sudo[89434]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-58eca12a-17d8-49b5-8a84-128f0c69951a tempest-ServersNegativeTestJSON-748798677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7a02815d-01b2-4b15-879c-65b67a509478 1073741824" returned: 0 in 1.278s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-58eca12a-17d8-49b5-8a84-128f0c69951a tempest-ServersNegativeTestJSON-748798677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7a02815d-01b2-4b15-879c-65b67a509478 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:27 devstack sudo[89446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7a02815d-01b2-4b15-879c-65b67a509478 Sep 03 11:14:27 devstack sudo[89446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:28 devstack sudo[89446]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-58eca12a-17d8-49b5-8a84-128f0c69951a tempest-ServersNegativeTestJSON-748798677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7a02815d-01b2-4b15-879c-65b67a509478" returned: 0 in 0.601s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:28 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-58eca12a-17d8-49b5-8a84-128f0c69951a tempest-ServersNegativeTestJSON-748798677 None] <== create_volume: return (2009ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:14:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-58eca12a-17d8-49b5-8a84-128f0c69951a tempest-ServersNegativeTestJSON-748798677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.018s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-58eca12a-17d8-49b5-8a84-128f0c69951a tempest-ServersNegativeTestJSON-748798677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29d577af-ba62-40d8-bf1b-86165c06118b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a02815d-01b2-4b15-879c-65b67a509478', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-58eca12a-17d8-49b5-8a84-128f0c69951a tempest-ServersNegativeTestJSON-748798677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dfbb593-bfd5-4e84-9aeb-30be84776977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:28 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-58eca12a-17d8-49b5-8a84-128f0c69951a tempest-ServersNegativeTestJSON-748798677 None] Volume volume-7a02815d-01b2-4b15-879c-65b67a509478 (7a02815d-01b2-4b15-879c-65b67a509478): created successfully Sep 03 11:14:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-58eca12a-17d8-49b5-8a84-128f0c69951a tempest-ServersNegativeTestJSON-748798677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dfbb593-bfd5-4e84-9aeb-30be84776977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-58eca12a-17d8-49b5-8a84-128f0c69951a tempest-ServersNegativeTestJSON-748798677 None] Flow 'volume_create_manager' (5c5afaa9-bf71-4fb8-aba3-d978ce926639) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:14:28 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-58eca12a-17d8-49b5-8a84-128f0c69951a tempest-ServersNegativeTestJSON-748798677 None] Created volume successfully. Sep 03 11:14:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-1c22ed84-1200-41b5-9278-dfd40552aafa req-d4bef55b-2bd3-4d60-8b22-fad572f80439 tempest-ServerActionsTestOtherA-914104622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-1c22ed84-1200-41b5-9278-dfd40552aafa req-d4bef55b-2bd3-4d60-8b22-fad572f80439 tempest-ServerActionsTestOtherA-914104622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-1c22ed84-1200-41b5-9278-dfd40552aafa req-d4bef55b-2bd3-4d60-8b22-fad572f80439 tempest-ServerActionsTestOtherA-914104622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-1c22ed84-1200-41b5-9278-dfd40552aafa req-d4bef55b-2bd3-4d60-8b22-fad572f80439 tempest-ServerActionsTestOtherA-914104622 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912', 'name': 'volume-fe5ee465-bdd3-4908-a270-c42487448c64', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fc105936-5630-4c22-9091-c14e8614ce84', 'enforce_multipath': True} {{(pid=87038) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:14:30 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-1c22ed84-1200-41b5-9278-dfd40552aafa req-d4bef55b-2bd3-4d60-8b22-fad572f80439 tempest-ServerActionsTestOtherA-914104622 None] attachment_update completed successfully. Sep 03 11:14:32 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-e88e1c1d-47f5-4085-9cec-d8108f3ef7f5 tempest-ServersNegativeTestJSON-748798677 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:14:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e88e1c1d-47f5-4085-9cec-d8108f3ef7f5 tempest-ServersNegativeTestJSON-748798677 None] Flow 'volume_create_manager' (40423fcb-d146-4702-8a40-752b1339b2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:14:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e88e1c1d-47f5-4085-9cec-d8108f3ef7f5 tempest-ServersNegativeTestJSON-748798677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a5ef50d-176a-4c4f-a97f-d8f4f5e52584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e88e1c1d-47f5-4085-9cec-d8108f3ef7f5 tempest-ServersNegativeTestJSON-748798677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a5ef50d-176a-4c4f-a97f-d8f4f5e52584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2119888379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dad84c2-04bd-47d0-a4ea-10428b781f7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da6f99daea874cbc977c35acfe86fc1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:14:32Z,use_quota=True,user_id='eae238b5c73c4888be6ada859b40d9d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e88e1c1d-47f5-4085-9cec-d8108f3ef7f5 tempest-ServersNegativeTestJSON-748798677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d14c9902-0480-4503-81e4-fd9d1a268de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e88e1c1d-47f5-4085-9cec-d8108f3ef7f5 tempest-ServersNegativeTestJSON-748798677 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d14c9902-0480-4503-81e4-fd9d1a268de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e88e1c1d-47f5-4085-9cec-d8108f3ef7f5 tempest-ServersNegativeTestJSON-748798677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fba71b6-5b73-4172-854d-504db271984a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e88e1c1d-47f5-4085-9cec-d8108f3ef7f5 tempest-ServersNegativeTestJSON-748798677 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fba71b6-5b73-4172-854d-504db271984a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dad84c2-04bd-47d0-a4ea-10428b781f7a', 'volume_name': 'volume-2dad84c2-04bd-47d0-a4ea-10428b781f7a', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e88e1c1d-47f5-4085-9cec-d8108f3ef7f5 tempest-ServersNegativeTestJSON-748798677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b4e0b4-4c01-4bce-b3fb-6727514fd67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e88e1c1d-47f5-4085-9cec-d8108f3ef7f5 tempest-ServersNegativeTestJSON-748798677 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (82b4e0b4-4c01-4bce-b3fb-6727514fd67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e88e1c1d-47f5-4085-9cec-d8108f3ef7f5 tempest-ServersNegativeTestJSON-748798677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ee2122f-8676-4be4-b8d7-1630e8db1b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:32 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-e88e1c1d-47f5-4085-9cec-d8108f3ef7f5 tempest-ServersNegativeTestJSON-748798677 None] Volume 2dad84c2-04bd-47d0-a4ea-10428b781f7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dad84c2-04bd-47d0-a4ea-10428b781f7a', 'volume_size': 1} Sep 03 11:14:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e88e1c1d-47f5-4085-9cec-d8108f3ef7f5 tempest-ServersNegativeTestJSON-748798677 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e88e1c1d-47f5-4085-9cec-d8108f3ef7f5 tempest-ServersNegativeTestJSON-748798677 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e88e1c1d-47f5-4085-9cec-d8108f3ef7f5 tempest-ServersNegativeTestJSON-748798677 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:14:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2119888379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dad84c2-04bd-47d0-a4ea-10428b781f7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da6f99daea874cbc977c35acfe86fc1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:14:32Z,use_quota=True,user_id='eae238b5c73c4888be6ada859b40d9d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:14:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-e88e1c1d-47f5-4085-9cec-d8108f3ef7f5 tempest-ServersNegativeTestJSON-748798677 None] Creating volume 2dad84c2-04bd-47d0-a4ea-10428b781f7a {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:14:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e88e1c1d-47f5-4085-9cec-d8108f3ef7f5 tempest-ServersNegativeTestJSON-748798677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e88e1c1d-47f5-4085-9cec-d8108f3ef7f5 tempest-ServersNegativeTestJSON-748798677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e88e1c1d-47f5-4085-9cec-d8108f3ef7f5 tempest-ServersNegativeTestJSON-748798677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:14:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e88e1c1d-47f5-4085-9cec-d8108f3ef7f5 tempest-ServersNegativeTestJSON-748798677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:14:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e88e1c1d-47f5-4085-9cec-d8108f3ef7f5 tempest-ServersNegativeTestJSON-748798677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e88e1c1d-47f5-4085-9cec-d8108f3ef7f5 tempest-ServersNegativeTestJSON-748798677 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:14:32 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-e88e1c1d-47f5-4085-9cec-d8108f3ef7f5 tempest-ServersNegativeTestJSON-748798677 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:14:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e88e1c1d-47f5-4085-9cec-d8108f3ef7f5 tempest-ServersNegativeTestJSON-748798677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2dad84c2-04bd-47d0-a4ea-10428b781f7a 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:32 devstack sudo[89887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2dad84c2-04bd-47d0-a4ea-10428b781f7a 1073741824 Sep 03 11:14:32 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:33 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e88e1c1d-47f5-4085-9cec-d8108f3ef7f5 tempest-ServersNegativeTestJSON-748798677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2dad84c2-04bd-47d0-a4ea-10428b781f7a 1073741824" returned: 0 in 0.749s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e88e1c1d-47f5-4085-9cec-d8108f3ef7f5 tempest-ServersNegativeTestJSON-748798677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2dad84c2-04bd-47d0-a4ea-10428b781f7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:33 devstack sudo[89892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2dad84c2-04bd-47d0-a4ea-10428b781f7a Sep 03 11:14:33 devstack sudo[89892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:33 devstack sudo[89892]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e88e1c1d-47f5-4085-9cec-d8108f3ef7f5 tempest-ServersNegativeTestJSON-748798677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2dad84c2-04bd-47d0-a4ea-10428b781f7a" returned: 0 in 0.614s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:33 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e88e1c1d-47f5-4085-9cec-d8108f3ef7f5 tempest-ServersNegativeTestJSON-748798677 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:14:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e88e1c1d-47f5-4085-9cec-d8108f3ef7f5 tempest-ServersNegativeTestJSON-748798677 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:33 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e88e1c1d-47f5-4085-9cec-d8108f3ef7f5 tempest-ServersNegativeTestJSON-748798677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ee2122f-8676-4be4-b8d7-1630e8db1b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dad84c2-04bd-47d0-a4ea-10428b781f7a', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:33 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e88e1c1d-47f5-4085-9cec-d8108f3ef7f5 tempest-ServersNegativeTestJSON-748798677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71aeabbd-0cef-423d-af6d-9da5c97fafec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:33 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-e88e1c1d-47f5-4085-9cec-d8108f3ef7f5 tempest-ServersNegativeTestJSON-748798677 None] Volume volume-2dad84c2-04bd-47d0-a4ea-10428b781f7a (2dad84c2-04bd-47d0-a4ea-10428b781f7a): created successfully Sep 03 11:14:33 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e88e1c1d-47f5-4085-9cec-d8108f3ef7f5 tempest-ServersNegativeTestJSON-748798677 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71aeabbd-0cef-423d-af6d-9da5c97fafec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:34 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e88e1c1d-47f5-4085-9cec-d8108f3ef7f5 tempest-ServersNegativeTestJSON-748798677 None] Flow 'volume_create_manager' (40423fcb-d146-4702-8a40-752b1339b2d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:14:34 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-e88e1c1d-47f5-4085-9cec-d8108f3ef7f5 tempest-ServersNegativeTestJSON-748798677 None] Created volume successfully. Sep 03 11:14:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-979d678d-9d06-470c-b7aa-a6306ba16da2 tempest-ServersNegativeTestJSON-748798677 None] Acquiring lock "cinder-2dad84c2-04bd-47d0-a4ea-10428b781f7a-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-979d678d-9d06-470c-b7aa-a6306ba16da2 tempest-ServersNegativeTestJSON-748798677 None] Lock "cinder-2dad84c2-04bd-47d0-a4ea-10428b781f7a-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-979d678d-9d06-470c-b7aa-a6306ba16da2 tempest-ServersNegativeTestJSON-748798677 None] Acquiring lock "cinder-quobyte-2dad84c2-04bd-47d0-a4ea-10428b781f7a" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-979d678d-9d06-470c-b7aa-a6306ba16da2 tempest-ServersNegativeTestJSON-748798677 None] Lock "cinder-quobyte-2dad84c2-04bd-47d0-a4ea-10428b781f7a" acquired by "delete_volume" :: waited 0.039s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:35 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[115a94ad-c0b3-4c6d-b144-617593e38d04]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:14:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-979d678d-9d06-470c-b7aa-a6306ba16da2 tempest-ServersNegativeTestJSON-748798677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2dad84c2-04bd-47d0-a4ea-10428b781f7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:35 devstack sudo[89928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2dad84c2-04bd-47d0-a4ea-10428b781f7a Sep 03 11:14:35 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:36 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-979d678d-9d06-470c-b7aa-a6306ba16da2 tempest-ServersNegativeTestJSON-748798677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2dad84c2-04bd-47d0-a4ea-10428b781f7a" returned: 0 in 0.748s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-979d678d-9d06-470c-b7aa-a6306ba16da2 tempest-ServersNegativeTestJSON-748798677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2dad84c2-04bd-47d0-a4ea-10428b781f7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:36 devstack sudo[89943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2dad84c2-04bd-47d0-a4ea-10428b781f7a Sep 03 11:14:36 devstack sudo[89943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:36 devstack sudo[89943]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-979d678d-9d06-470c-b7aa-a6306ba16da2 tempest-ServersNegativeTestJSON-748798677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2dad84c2-04bd-47d0-a4ea-10428b781f7a" returned: 0 in 0.299s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-979d678d-9d06-470c-b7aa-a6306ba16da2 tempest-ServersNegativeTestJSON-748798677 None] Lock "cinder-quobyte-2dad84c2-04bd-47d0-a4ea-10428b781f7a" released by "delete_volume" :: held 1.161s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:36 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-979d678d-9d06-470c-b7aa-a6306ba16da2 tempest-ServersNegativeTestJSON-748798677 None] Created reservations ['8650b6f2-13e4-4474-a449-c5810cd6440d', '5f7e2ad8-e62b-4f95-80f7-905a324e2dfb', '32c91096-540d-4d4c-8b2a-11a6f97c0ebd', 'f3d8f66a-9df5-4875-a712-d400a45f1380'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:14:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-979d678d-9d06-470c-b7aa-a6306ba16da2 tempest-ServersNegativeTestJSON-748798677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-979d678d-9d06-470c-b7aa-a6306ba16da2 tempest-ServersNegativeTestJSON-748798677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:36 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-979d678d-9d06-470c-b7aa-a6306ba16da2 tempest-ServersNegativeTestJSON-748798677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:14:36 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-979d678d-9d06-470c-b7aa-a6306ba16da2 tempest-ServersNegativeTestJSON-748798677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:14:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-979d678d-9d06-470c-b7aa-a6306ba16da2 tempest-ServersNegativeTestJSON-748798677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-979d678d-9d06-470c-b7aa-a6306ba16da2 tempest-ServersNegativeTestJSON-748798677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:36 devstack sudo[89965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:14:36 devstack sudo[89965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:37 devstack sudo[89965]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-979d678d-9d06-470c-b7aa-a6306ba16da2 tempest-ServersNegativeTestJSON-748798677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.351s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:37 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-979d678d-9d06-470c-b7aa-a6306ba16da2 tempest-ServersNegativeTestJSON-748798677 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:14:37 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-979d678d-9d06-470c-b7aa-a6306ba16da2 tempest-ServersNegativeTestJSON-748798677 None] Deleted volume successfully. Sep 03 11:14:37 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-979d678d-9d06-470c-b7aa-a6306ba16da2 tempest-ServersNegativeTestJSON-748798677 None] Lock "cinder-2dad84c2-04bd-47d0-a4ea-10428b781f7a-delete_volume" released by "delete_volume" :: held 1.921s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:37 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-2144095c-6eab-49e5-8379-7e6a20d63171 req-07bb8f48-52a6-44d2-b70a-c0e8125db0c9 tempest-ServerActionsTestOtherA-914104622 None] Terminate volume connection completed successfully. Sep 03 11:14:37 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-2144095c-6eab-49e5-8379-7e6a20d63171 req-07bb8f48-52a6-44d2-b70a-c0e8125db0c9 tempest-ServerActionsTestOtherA-914104622 None] Deleting attachment fc105936-5630-4c22-9091-c14e8614ce84. {{(pid=87038) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:14:37 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-7ad6804f-e8a2-4e3a-8d4e-8c372e7e0e33 tempest-ServersNegativeTestJSON-748798677 None] Acquiring lock "cinder-7a02815d-01b2-4b15-879c-65b67a509478-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:37 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-7ad6804f-e8a2-4e3a-8d4e-8c372e7e0e33 tempest-ServersNegativeTestJSON-748798677 None] Lock "cinder-7a02815d-01b2-4b15-879c-65b67a509478-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:37 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-7ad6804f-e8a2-4e3a-8d4e-8c372e7e0e33 tempest-ServersNegativeTestJSON-748798677 None] Acquiring lock "cinder-quobyte-7a02815d-01b2-4b15-879c-65b67a509478" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:14:37 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-7ad6804f-e8a2-4e3a-8d4e-8c372e7e0e33 tempest-ServersNegativeTestJSON-748798677 None] Lock "cinder-quobyte-7a02815d-01b2-4b15-879c-65b67a509478" acquired by "delete_volume" :: waited 0.044s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:14:37 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b831edd-4058-49d8-b8dc-be87e967b1bf]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:14:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7ad6804f-e8a2-4e3a-8d4e-8c372e7e0e33 tempest-ServersNegativeTestJSON-748798677 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7a02815d-01b2-4b15-879c-65b67a509478 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:38 devstack sudo[90020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7a02815d-01b2-4b15-879c-65b67a509478 Sep 03 11:14:38 devstack sudo[90020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-2144095c-6eab-49e5-8379-7e6a20d63171 req-14c8fd82-e631-4662-a897-943286b24101 tempest-ServerActionsTestOtherA-914104622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-2144095c-6eab-49e5-8379-7e6a20d63171 req-14c8fd82-e631-4662-a897-943286b24101 tempest-ServerActionsTestOtherA-914104622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-2144095c-6eab-49e5-8379-7e6a20d63171 req-14c8fd82-e631-4662-a897-943286b24101 tempest-ServerActionsTestOtherA-914104622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:38 devstack sudo[90020]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7ad6804f-e8a2-4e3a-8d4e-8c372e7e0e33 tempest-ServersNegativeTestJSON-748798677 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7a02815d-01b2-4b15-879c-65b67a509478" returned: 0 in 1.050s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7ad6804f-e8a2-4e3a-8d4e-8c372e7e0e33 tempest-ServersNegativeTestJSON-748798677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7a02815d-01b2-4b15-879c-65b67a509478 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:38 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-2144095c-6eab-49e5-8379-7e6a20d63171 req-14c8fd82-e631-4662-a897-943286b24101 tempest-ServerActionsTestOtherA-914104622 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912', 'name': 'volume-fe5ee465-bdd3-4908-a270-c42487448c64', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9ef37f3a-15d0-409f-8be3-6c4bac6dea4e', 'enforce_multipath': True} {{(pid=87038) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:14:39 devstack sudo[90042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7a02815d-01b2-4b15-879c-65b67a509478 Sep 03 11:14:39 devstack sudo[90042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:39 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-2144095c-6eab-49e5-8379-7e6a20d63171 req-14c8fd82-e631-4662-a897-943286b24101 tempest-ServerActionsTestOtherA-914104622 None] attachment_update completed successfully. Sep 03 11:14:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7ad6804f-e8a2-4e3a-8d4e-8c372e7e0e33 tempest-ServersNegativeTestJSON-748798677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7a02815d-01b2-4b15-879c-65b67a509478" returned: 0 in 0.569s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:39 devstack sudo[90042]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:39 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-7ad6804f-e8a2-4e3a-8d4e-8c372e7e0e33 tempest-ServersNegativeTestJSON-748798677 None] Lock "cinder-quobyte-7a02815d-01b2-4b15-879c-65b67a509478" released by "delete_volume" :: held 1.721s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:39 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-7ad6804f-e8a2-4e3a-8d4e-8c372e7e0e33 tempest-ServersNegativeTestJSON-748798677 None] Created reservations ['1970ebcf-0217-419f-a6db-1911239efb2a', '552eb0eb-db0b-4bdc-84de-936ca21cee23', 'f41bd3e7-553f-4e74-8959-0e822da305b1', '68990115-65d5-40aa-80c9-ac255727d11b'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:14:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7ad6804f-e8a2-4e3a-8d4e-8c372e7e0e33 tempest-ServersNegativeTestJSON-748798677 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7ad6804f-e8a2-4e3a-8d4e-8c372e7e0e33 tempest-ServersNegativeTestJSON-748798677 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7ad6804f-e8a2-4e3a-8d4e-8c372e7e0e33 tempest-ServersNegativeTestJSON-748798677 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:14:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7ad6804f-e8a2-4e3a-8d4e-8c372e7e0e33 tempest-ServersNegativeTestJSON-748798677 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:14:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7ad6804f-e8a2-4e3a-8d4e-8c372e7e0e33 tempest-ServersNegativeTestJSON-748798677 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7ad6804f-e8a2-4e3a-8d4e-8c372e7e0e33 tempest-ServersNegativeTestJSON-748798677 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:39 devstack sudo[90046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:14:39 devstack sudo[90046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:40 devstack sudo[90046]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7ad6804f-e8a2-4e3a-8d4e-8c372e7e0e33 tempest-ServersNegativeTestJSON-748798677 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.347s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:40 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-7ad6804f-e8a2-4e3a-8d4e-8c372e7e0e33 tempest-ServersNegativeTestJSON-748798677 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:14:40 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-7ad6804f-e8a2-4e3a-8d4e-8c372e7e0e33 tempest-ServersNegativeTestJSON-748798677 None] Deleted volume successfully. Sep 03 11:14:40 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-7ad6804f-e8a2-4e3a-8d4e-8c372e7e0e33 tempest-ServersNegativeTestJSON-748798677 None] Lock "cinder-7a02815d-01b2-4b15-879c-65b67a509478-delete_volume" released by "delete_volume" :: held 2.412s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:14:44 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d71b403-d039-44ef-873a-4129bdc580eb tempest-ServerRescueNegativeTestJSON-1861478855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:14:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7d71b403-d039-44ef-873a-4129bdc580eb tempest-ServerRescueNegativeTestJSON-1861478855 None] Flow 'volume_create_manager' (c14f60de-3fe9-4e36-802a-3b6d9f81e874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:14:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7d71b403-d039-44ef-873a-4129bdc580eb tempest-ServerRescueNegativeTestJSON-1861478855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a43e64-1dc9-46aa-a25e-6df06a399dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7d71b403-d039-44ef-873a-4129bdc580eb tempest-ServerRescueNegativeTestJSON-1861478855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4a43e64-1dc9-46aa-a25e-6df06a399dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1902784020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e708f914-2119-4003-b7a0-bebf1fef9319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9c289c47fa2433dadf03a02e6807151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:14:44Z,use_quota=True,user_id='cbb1f811b3db44f5bc476ba2ba4de975',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7d71b403-d039-44ef-873a-4129bdc580eb tempest-ServerRescueNegativeTestJSON-1861478855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a58b4067-2004-48b9-8f4c-a56caad6b1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7d71b403-d039-44ef-873a-4129bdc580eb tempest-ServerRescueNegativeTestJSON-1861478855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a58b4067-2004-48b9-8f4c-a56caad6b1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7d71b403-d039-44ef-873a-4129bdc580eb tempest-ServerRescueNegativeTestJSON-1861478855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cff5cfc-0ee7-4085-9726-86fe1ab6b5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7d71b403-d039-44ef-873a-4129bdc580eb tempest-ServerRescueNegativeTestJSON-1861478855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cff5cfc-0ee7-4085-9726-86fe1ab6b5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e708f914-2119-4003-b7a0-bebf1fef9319', 'volume_name': 'volume-e708f914-2119-4003-b7a0-bebf1fef9319', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7d71b403-d039-44ef-873a-4129bdc580eb tempest-ServerRescueNegativeTestJSON-1861478855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b47a89c-f582-480f-9b23-87adf713c344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7d71b403-d039-44ef-873a-4129bdc580eb tempest-ServerRescueNegativeTestJSON-1861478855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b47a89c-f582-480f-9b23-87adf713c344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7d71b403-d039-44ef-873a-4129bdc580eb tempest-ServerRescueNegativeTestJSON-1861478855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9a7a9b3-d2e6-47ac-8fe0-899ad6349f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:44 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-7d71b403-d039-44ef-873a-4129bdc580eb tempest-ServerRescueNegativeTestJSON-1861478855 None] Volume e708f914-2119-4003-b7a0-bebf1fef9319: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e708f914-2119-4003-b7a0-bebf1fef9319', 'volume_size': 1} Sep 03 11:14:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7d71b403-d039-44ef-873a-4129bdc580eb tempest-ServerRescueNegativeTestJSON-1861478855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7d71b403-d039-44ef-873a-4129bdc580eb tempest-ServerRescueNegativeTestJSON-1861478855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7d71b403-d039-44ef-873a-4129bdc580eb tempest-ServerRescueNegativeTestJSON-1861478855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1902784020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e708f914-2119-4003-b7a0-bebf1fef9319,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9c289c47fa2433dadf03a02e6807151',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:14:44Z,use_quota=True,user_id='cbb1f811b3db44f5bc476ba2ba4de975',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:14:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-7d71b403-d039-44ef-873a-4129bdc580eb tempest-ServerRescueNegativeTestJSON-1861478855 None] Creating volume e708f914-2119-4003-b7a0-bebf1fef9319 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:14:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7d71b403-d039-44ef-873a-4129bdc580eb tempest-ServerRescueNegativeTestJSON-1861478855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7d71b403-d039-44ef-873a-4129bdc580eb tempest-ServerRescueNegativeTestJSON-1861478855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7d71b403-d039-44ef-873a-4129bdc580eb tempest-ServerRescueNegativeTestJSON-1861478855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:14:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7d71b403-d039-44ef-873a-4129bdc580eb tempest-ServerRescueNegativeTestJSON-1861478855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:14:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7d71b403-d039-44ef-873a-4129bdc580eb tempest-ServerRescueNegativeTestJSON-1861478855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7d71b403-d039-44ef-873a-4129bdc580eb tempest-ServerRescueNegativeTestJSON-1861478855 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:14:44 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-7d71b403-d039-44ef-873a-4129bdc580eb tempest-ServerRescueNegativeTestJSON-1861478855 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:14:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7d71b403-d039-44ef-873a-4129bdc580eb tempest-ServerRescueNegativeTestJSON-1861478855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e708f914-2119-4003-b7a0-bebf1fef9319 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:44 devstack sudo[90579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e708f914-2119-4003-b7a0-bebf1fef9319 1073741824 Sep 03 11:14:44 devstack sudo[90579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:45 devstack sudo[90579]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7d71b403-d039-44ef-873a-4129bdc580eb tempest-ServerRescueNegativeTestJSON-1861478855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e708f914-2119-4003-b7a0-bebf1fef9319 1073741824" returned: 0 in 1.051s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7d71b403-d039-44ef-873a-4129bdc580eb tempest-ServerRescueNegativeTestJSON-1861478855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e708f914-2119-4003-b7a0-bebf1fef9319 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:14:45 devstack sudo[90596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e708f914-2119-4003-b7a0-bebf1fef9319 Sep 03 11:14:45 devstack sudo[90596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:14:46 devstack sudo[90596]: pam_unix(sudo:session): session closed for user root Sep 03 11:14:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7d71b403-d039-44ef-873a-4129bdc580eb tempest-ServerRescueNegativeTestJSON-1861478855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e708f914-2119-4003-b7a0-bebf1fef9319" returned: 0 in 0.695s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:14:46 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7d71b403-d039-44ef-873a-4129bdc580eb tempest-ServerRescueNegativeTestJSON-1861478855 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:14:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7d71b403-d039-44ef-873a-4129bdc580eb tempest-ServerRescueNegativeTestJSON-1861478855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:46 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7d71b403-d039-44ef-873a-4129bdc580eb tempest-ServerRescueNegativeTestJSON-1861478855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9a7a9b3-d2e6-47ac-8fe0-899ad6349f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e708f914-2119-4003-b7a0-bebf1fef9319', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:46 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7d71b403-d039-44ef-873a-4129bdc580eb tempest-ServerRescueNegativeTestJSON-1861478855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33fda821-1acb-4cfc-93ff-91f2c7364d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:14:46 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-7d71b403-d039-44ef-873a-4129bdc580eb tempest-ServerRescueNegativeTestJSON-1861478855 None] Volume volume-e708f914-2119-4003-b7a0-bebf1fef9319 (e708f914-2119-4003-b7a0-bebf1fef9319): created successfully Sep 03 11:14:46 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7d71b403-d039-44ef-873a-4129bdc580eb tempest-ServerRescueNegativeTestJSON-1861478855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33fda821-1acb-4cfc-93ff-91f2c7364d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:14:46 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7d71b403-d039-44ef-873a-4129bdc580eb tempest-ServerRescueNegativeTestJSON-1861478855 None] Flow 'volume_create_manager' (c14f60de-3fe9-4e36-802a-3b6d9f81e874) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:14:46 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-7d71b403-d039-44ef-873a-4129bdc580eb tempest-ServerRescueNegativeTestJSON-1861478855 None] Created volume successfully. Sep 03 11:14:56 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:UPDATE=32,cinder:SELECT=30,cinder:DELETE=1,cinder:INSERT=6 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:14:56 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=30,cinder:INSERT=5,cinder:UPDATE=24,cinder:DELETE=4 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:14:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-801948c2-51e8-4a9f-a360-00273b55d843 req-34ec52e5-d317-4f40-a505-c33a1af48436 tempest-TaggedAttachmentsTest-2046288793 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:14:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-801948c2-51e8-4a9f-a360-00273b55d843 req-34ec52e5-d317-4f40-a505-c33a1af48436 tempest-TaggedAttachmentsTest-2046288793 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:14:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-801948c2-51e8-4a9f-a360-00273b55d843 req-34ec52e5-d317-4f40-a505-c33a1af48436 tempest-TaggedAttachmentsTest-2046288793 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.048s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:14:57 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-801948c2-51e8-4a9f-a360-00273b55d843 req-34ec52e5-d317-4f40-a505-c33a1af48436 tempest-TaggedAttachmentsTest-2046288793 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912', 'name': 'volume-af5a3fd7-e087-403c-b1d5-d324e091a7fd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a99263b9-d7c6-49c1-84be-e719f42d3cb1', 'enforce_multipath': True} {{(pid=87038) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:14:57 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-801948c2-51e8-4a9f-a360-00273b55d843 req-34ec52e5-d317-4f40-a505-c33a1af48436 tempest-TaggedAttachmentsTest-2046288793 None] attachment_update completed successfully. Sep 03 11:15:00 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-65d44f88-33cd-4518-942b-5f2a15b67172 req-23944b26-1e50-486a-9681-1d19ec40e7ea tempest-TaggedAttachmentsTest-2046288793 None] Terminate volume connection completed successfully. Sep 03 11:15:00 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-65d44f88-33cd-4518-942b-5f2a15b67172 req-23944b26-1e50-486a-9681-1d19ec40e7ea tempest-TaggedAttachmentsTest-2046288793 None] Deleting attachment a99263b9-d7c6-49c1-84be-e719f42d3cb1. {{(pid=87038) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:15:02 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4aee5d8e-ab03-435b-a6c9-8f56ae8c5d1b tempest-ServerRescueNegativeTestJSON-1861478855 None] Acquiring lock "cinder-e708f914-2119-4003-b7a0-bebf1fef9319-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:15:02 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4aee5d8e-ab03-435b-a6c9-8f56ae8c5d1b tempest-ServerRescueNegativeTestJSON-1861478855 None] Lock "cinder-e708f914-2119-4003-b7a0-bebf1fef9319-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:15:02 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4aee5d8e-ab03-435b-a6c9-8f56ae8c5d1b tempest-ServerRescueNegativeTestJSON-1861478855 None] Acquiring lock "cinder-quobyte-e708f914-2119-4003-b7a0-bebf1fef9319" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:15:02 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4aee5d8e-ab03-435b-a6c9-8f56ae8c5d1b tempest-ServerRescueNegativeTestJSON-1861478855 None] Lock "cinder-quobyte-e708f914-2119-4003-b7a0-bebf1fef9319" acquired by "delete_volume" :: waited 0.047s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:15:02 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24ff852-fe99-4833-b188-63a056013c13]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:15:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4aee5d8e-ab03-435b-a6c9-8f56ae8c5d1b tempest-ServerRescueNegativeTestJSON-1861478855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e708f914-2119-4003-b7a0-bebf1fef9319 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:03 devstack sudo[90862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e708f914-2119-4003-b7a0-bebf1fef9319 Sep 03 11:15:03 devstack sudo[90862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:03 devstack sudo[90862]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4aee5d8e-ab03-435b-a6c9-8f56ae8c5d1b tempest-ServerRescueNegativeTestJSON-1861478855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e708f914-2119-4003-b7a0-bebf1fef9319" returned: 0 in 0.731s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4aee5d8e-ab03-435b-a6c9-8f56ae8c5d1b tempest-ServerRescueNegativeTestJSON-1861478855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e708f914-2119-4003-b7a0-bebf1fef9319 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:03 devstack sudo[90869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e708f914-2119-4003-b7a0-bebf1fef9319 Sep 03 11:15:03 devstack sudo[90869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:04 devstack sudo[90869]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4aee5d8e-ab03-435b-a6c9-8f56ae8c5d1b tempest-ServerRescueNegativeTestJSON-1861478855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e708f914-2119-4003-b7a0-bebf1fef9319" returned: 0 in 0.668s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:04 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4aee5d8e-ab03-435b-a6c9-8f56ae8c5d1b tempest-ServerRescueNegativeTestJSON-1861478855 None] Lock "cinder-quobyte-e708f914-2119-4003-b7a0-bebf1fef9319" released by "delete_volume" :: held 1.526s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:15:04 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-4aee5d8e-ab03-435b-a6c9-8f56ae8c5d1b tempest-ServerRescueNegativeTestJSON-1861478855 None] Created reservations ['2f54aab7-6b3f-4922-b0f2-24d1e9ded52c', '6597a777-d1bb-49f3-8e5d-b98e0902acb6', '218896f7-6313-4ee2-8c96-10308d809580', '165498cc-b255-4e5a-8917-cb717730132f'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:15:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4aee5d8e-ab03-435b-a6c9-8f56ae8c5d1b tempest-ServerRescueNegativeTestJSON-1861478855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:15:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4aee5d8e-ab03-435b-a6c9-8f56ae8c5d1b tempest-ServerRescueNegativeTestJSON-1861478855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:15:04 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4aee5d8e-ab03-435b-a6c9-8f56ae8c5d1b tempest-ServerRescueNegativeTestJSON-1861478855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:15:04 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4aee5d8e-ab03-435b-a6c9-8f56ae8c5d1b tempest-ServerRescueNegativeTestJSON-1861478855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:15:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4aee5d8e-ab03-435b-a6c9-8f56ae8c5d1b tempest-ServerRescueNegativeTestJSON-1861478855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:15:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4aee5d8e-ab03-435b-a6c9-8f56ae8c5d1b tempest-ServerRescueNegativeTestJSON-1861478855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:04 devstack sudo[90874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:15:04 devstack sudo[90874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:04 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d05dcc2-4a5c-4ae7-8429-2a4095728fee tempest-VolumesTestJSON-1259992027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:15:04 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3d05dcc2-4a5c-4ae7-8429-2a4095728fee tempest-VolumesTestJSON-1259992027 None] Flow 'volume_create_manager' (f472ded2-8f65-4b07-9edc-d69bf9a4fc75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:15:04 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3d05dcc2-4a5c-4ae7-8429-2a4095728fee tempest-VolumesTestJSON-1259992027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b7cf2e6-0fbb-4668-9567-7184f57c8eb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:04 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3d05dcc2-4a5c-4ae7-8429-2a4095728fee tempest-VolumesTestJSON-1259992027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3b7cf2e6-0fbb-4668-9567-7184f57c8eb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-804294706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17429fd9-ba22-4153-8a0d-cec9becf216b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fc2e2b8e2b124a7585ecc88d4a42a27a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:15:05Z,use_quota=True,user_id='ddc82dfe80924b76a060af818cf7df71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:04 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3d05dcc2-4a5c-4ae7-8429-2a4095728fee tempest-VolumesTestJSON-1259992027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (090166e6-0711-414e-ba7d-9db7095a19c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:04 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3d05dcc2-4a5c-4ae7-8429-2a4095728fee tempest-VolumesTestJSON-1259992027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (090166e6-0711-414e-ba7d-9db7095a19c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:04 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3d05dcc2-4a5c-4ae7-8429-2a4095728fee tempest-VolumesTestJSON-1259992027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8970922c-c6f6-4a32-8456-af041cb71d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:04 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3d05dcc2-4a5c-4ae7-8429-2a4095728fee tempest-VolumesTestJSON-1259992027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8970922c-c6f6-4a32-8456-af041cb71d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17429fd9-ba22-4153-8a0d-cec9becf216b', 'volume_name': 'volume-17429fd9-ba22-4153-8a0d-cec9becf216b', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:04 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3d05dcc2-4a5c-4ae7-8429-2a4095728fee tempest-VolumesTestJSON-1259992027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0295171d-5a86-41e9-aa2b-6af74c2f0c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:04 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3d05dcc2-4a5c-4ae7-8429-2a4095728fee tempest-VolumesTestJSON-1259992027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0295171d-5a86-41e9-aa2b-6af74c2f0c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:04 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3d05dcc2-4a5c-4ae7-8429-2a4095728fee tempest-VolumesTestJSON-1259992027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb478c47-0f28-4e53-be37-431f550e73ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:04 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-3d05dcc2-4a5c-4ae7-8429-2a4095728fee tempest-VolumesTestJSON-1259992027 None] Volume 17429fd9-ba22-4153-8a0d-cec9becf216b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17429fd9-ba22-4153-8a0d-cec9becf216b', 'volume_size': 1} Sep 03 11:15:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3d05dcc2-4a5c-4ae7-8429-2a4095728fee tempest-VolumesTestJSON-1259992027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:15:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3d05dcc2-4a5c-4ae7-8429-2a4095728fee tempest-VolumesTestJSON-1259992027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:15:04 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-3d05dcc2-4a5c-4ae7-8429-2a4095728fee tempest-VolumesTestJSON-1259992027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-804294706',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17429fd9-ba22-4153-8a0d-cec9becf216b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fc2e2b8e2b124a7585ecc88d4a42a27a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:15:05Z,use_quota=True,user_id='ddc82dfe80924b76a060af818cf7df71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:15:04 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-3d05dcc2-4a5c-4ae7-8429-2a4095728fee tempest-VolumesTestJSON-1259992027 None] Creating volume 17429fd9-ba22-4153-8a0d-cec9becf216b {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:15:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3d05dcc2-4a5c-4ae7-8429-2a4095728fee tempest-VolumesTestJSON-1259992027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:15:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3d05dcc2-4a5c-4ae7-8429-2a4095728fee tempest-VolumesTestJSON-1259992027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:15:04 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-3d05dcc2-4a5c-4ae7-8429-2a4095728fee tempest-VolumesTestJSON-1259992027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:15:04 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-3d05dcc2-4a5c-4ae7-8429-2a4095728fee tempest-VolumesTestJSON-1259992027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:15:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3d05dcc2-4a5c-4ae7-8429-2a4095728fee tempest-VolumesTestJSON-1259992027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:15:04 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-3d05dcc2-4a5c-4ae7-8429-2a4095728fee tempest-VolumesTestJSON-1259992027 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:15:04 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-3d05dcc2-4a5c-4ae7-8429-2a4095728fee tempest-VolumesTestJSON-1259992027 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:15:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3d05dcc2-4a5c-4ae7-8429-2a4095728fee tempest-VolumesTestJSON-1259992027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-17429fd9-ba22-4153-8a0d-cec9becf216b 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:04 devstack sudo[90877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-17429fd9-ba22-4153-8a0d-cec9becf216b 1073741824 Sep 03 11:15:04 devstack sudo[90877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:04 devstack sudo[90874]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4aee5d8e-ab03-435b-a6c9-8f56ae8c5d1b tempest-ServerRescueNegativeTestJSON-1861478855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.399s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:05 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-4aee5d8e-ab03-435b-a6c9-8f56ae8c5d1b tempest-ServerRescueNegativeTestJSON-1861478855 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:15:05 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-4aee5d8e-ab03-435b-a6c9-8f56ae8c5d1b tempest-ServerRescueNegativeTestJSON-1861478855 None] Deleted volume successfully. Sep 03 11:15:05 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4aee5d8e-ab03-435b-a6c9-8f56ae8c5d1b tempest-ServerRescueNegativeTestJSON-1861478855 None] Lock "cinder-e708f914-2119-4003-b7a0-bebf1fef9319-delete_volume" released by "delete_volume" :: held 2.470s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:15:05 devstack sudo[90877]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3d05dcc2-4a5c-4ae7-8429-2a4095728fee tempest-VolumesTestJSON-1259992027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-17429fd9-ba22-4153-8a0d-cec9becf216b 1073741824" returned: 0 in 0.822s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3d05dcc2-4a5c-4ae7-8429-2a4095728fee tempest-VolumesTestJSON-1259992027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-17429fd9-ba22-4153-8a0d-cec9becf216b {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:05 devstack sudo[90885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-17429fd9-ba22-4153-8a0d-cec9becf216b Sep 03 11:15:05 devstack sudo[90885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:06 devstack sudo[90885]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3d05dcc2-4a5c-4ae7-8429-2a4095728fee tempest-VolumesTestJSON-1259992027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-17429fd9-ba22-4153-8a0d-cec9becf216b" returned: 0 in 0.431s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:06 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-3d05dcc2-4a5c-4ae7-8429-2a4095728fee tempest-VolumesTestJSON-1259992027 None] <== create_volume: return (1304ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:15:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3d05dcc2-4a5c-4ae7-8429-2a4095728fee tempest-VolumesTestJSON-1259992027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.310s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:15:06 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3d05dcc2-4a5c-4ae7-8429-2a4095728fee tempest-VolumesTestJSON-1259992027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb478c47-0f28-4e53-be37-431f550e73ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17429fd9-ba22-4153-8a0d-cec9becf216b', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:06 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3d05dcc2-4a5c-4ae7-8429-2a4095728fee tempest-VolumesTestJSON-1259992027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69c7af82-24aa-48df-955e-14593f34d852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:06 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-3d05dcc2-4a5c-4ae7-8429-2a4095728fee tempest-VolumesTestJSON-1259992027 None] Volume volume-17429fd9-ba22-4153-8a0d-cec9becf216b (17429fd9-ba22-4153-8a0d-cec9becf216b): created successfully Sep 03 11:15:06 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3d05dcc2-4a5c-4ae7-8429-2a4095728fee tempest-VolumesTestJSON-1259992027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69c7af82-24aa-48df-955e-14593f34d852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:06 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3d05dcc2-4a5c-4ae7-8429-2a4095728fee tempest-VolumesTestJSON-1259992027 None] Flow 'volume_create_manager' (f472ded2-8f65-4b07-9edc-d69bf9a4fc75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:15:06 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-3d05dcc2-4a5c-4ae7-8429-2a4095728fee tempest-VolumesTestJSON-1259992027 None] Created volume successfully. Sep 03 11:15:08 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-22701273-a01f-482e-8e72-4d61bf769975 tempest-VolumesTestJSON-1259992027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:15:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-22701273-a01f-482e-8e72-4d61bf769975 tempest-VolumesTestJSON-1259992027 None] Flow 'volume_create_manager' (fd114f77-7fa9-4187-817f-af31d1b72c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:15:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-22701273-a01f-482e-8e72-4d61bf769975 tempest-VolumesTestJSON-1259992027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7acfc3e-f6bf-4081-b72a-4423b02273c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-22701273-a01f-482e-8e72-4d61bf769975 tempest-VolumesTestJSON-1259992027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f7acfc3e-f6bf-4081-b72a-4423b02273c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1168846666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56f8021f-fb5c-42a3-98fa-7f81b86e6ef8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fc2e2b8e2b124a7585ecc88d4a42a27a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:15:08Z,use_quota=True,user_id='ddc82dfe80924b76a060af818cf7df71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-22701273-a01f-482e-8e72-4d61bf769975 tempest-VolumesTestJSON-1259992027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5095665-4603-4bbd-99a2-8a96cde71aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-22701273-a01f-482e-8e72-4d61bf769975 tempest-VolumesTestJSON-1259992027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5095665-4603-4bbd-99a2-8a96cde71aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-22701273-a01f-482e-8e72-4d61bf769975 tempest-VolumesTestJSON-1259992027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6f4e104-eec2-443e-83bc-22f540a39b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-22701273-a01f-482e-8e72-4d61bf769975 tempest-VolumesTestJSON-1259992027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6f4e104-eec2-443e-83bc-22f540a39b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56f8021f-fb5c-42a3-98fa-7f81b86e6ef8', 'volume_name': 'volume-56f8021f-fb5c-42a3-98fa-7f81b86e6ef8', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-22701273-a01f-482e-8e72-4d61bf769975 tempest-VolumesTestJSON-1259992027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac3bbd6-6e33-4e8c-9015-962bac7f74b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-22701273-a01f-482e-8e72-4d61bf769975 tempest-VolumesTestJSON-1259992027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac3bbd6-6e33-4e8c-9015-962bac7f74b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-22701273-a01f-482e-8e72-4d61bf769975 tempest-VolumesTestJSON-1259992027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7a5b59d-6ff1-4845-9f00-06b9aeb05a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:08 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-22701273-a01f-482e-8e72-4d61bf769975 tempest-VolumesTestJSON-1259992027 None] Volume 56f8021f-fb5c-42a3-98fa-7f81b86e6ef8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56f8021f-fb5c-42a3-98fa-7f81b86e6ef8', 'volume_size': 1} Sep 03 11:15:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-22701273-a01f-482e-8e72-4d61bf769975 tempest-VolumesTestJSON-1259992027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:15:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-22701273-a01f-482e-8e72-4d61bf769975 tempest-VolumesTestJSON-1259992027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:15:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-22701273-a01f-482e-8e72-4d61bf769975 tempest-VolumesTestJSON-1259992027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1168846666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56f8021f-fb5c-42a3-98fa-7f81b86e6ef8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fc2e2b8e2b124a7585ecc88d4a42a27a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:15:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:15:08Z,use_quota=True,user_id='ddc82dfe80924b76a060af818cf7df71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:15:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-22701273-a01f-482e-8e72-4d61bf769975 tempest-VolumesTestJSON-1259992027 None] Creating volume 56f8021f-fb5c-42a3-98fa-7f81b86e6ef8 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:15:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-22701273-a01f-482e-8e72-4d61bf769975 tempest-VolumesTestJSON-1259992027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:15:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-22701273-a01f-482e-8e72-4d61bf769975 tempest-VolumesTestJSON-1259992027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:15:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-22701273-a01f-482e-8e72-4d61bf769975 tempest-VolumesTestJSON-1259992027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:15:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-22701273-a01f-482e-8e72-4d61bf769975 tempest-VolumesTestJSON-1259992027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:15:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-22701273-a01f-482e-8e72-4d61bf769975 tempest-VolumesTestJSON-1259992027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:15:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-22701273-a01f-482e-8e72-4d61bf769975 tempest-VolumesTestJSON-1259992027 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:15:08 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-22701273-a01f-482e-8e72-4d61bf769975 tempest-VolumesTestJSON-1259992027 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:15:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-22701273-a01f-482e-8e72-4d61bf769975 tempest-VolumesTestJSON-1259992027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-56f8021f-fb5c-42a3-98fa-7f81b86e6ef8 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:08 devstack sudo[90939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-56f8021f-fb5c-42a3-98fa-7f81b86e6ef8 1073741824 Sep 03 11:15:08 devstack sudo[90939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:09 devstack sudo[90939]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-22701273-a01f-482e-8e72-4d61bf769975 tempest-VolumesTestJSON-1259992027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-56f8021f-fb5c-42a3-98fa-7f81b86e6ef8 1073741824" returned: 0 in 0.837s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-22701273-a01f-482e-8e72-4d61bf769975 tempest-VolumesTestJSON-1259992027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-56f8021f-fb5c-42a3-98fa-7f81b86e6ef8 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:09 devstack sudo[90981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-56f8021f-fb5c-42a3-98fa-7f81b86e6ef8 Sep 03 11:15:09 devstack sudo[90981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:09 devstack sudo[90981]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-22701273-a01f-482e-8e72-4d61bf769975 tempest-VolumesTestJSON-1259992027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-56f8021f-fb5c-42a3-98fa-7f81b86e6ef8" returned: 0 in 0.460s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-22701273-a01f-482e-8e72-4d61bf769975 tempest-VolumesTestJSON-1259992027 None] <== create_volume: return (1391ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:15:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-22701273-a01f-482e-8e72-4d61bf769975 tempest-VolumesTestJSON-1259992027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:15:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-22701273-a01f-482e-8e72-4d61bf769975 tempest-VolumesTestJSON-1259992027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7a5b59d-6ff1-4845-9f00-06b9aeb05a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56f8021f-fb5c-42a3-98fa-7f81b86e6ef8', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-22701273-a01f-482e-8e72-4d61bf769975 tempest-VolumesTestJSON-1259992027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59a8026c-0654-47db-a2b0-6287f16bb762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:09 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-22701273-a01f-482e-8e72-4d61bf769975 tempest-VolumesTestJSON-1259992027 None] Volume volume-56f8021f-fb5c-42a3-98fa-7f81b86e6ef8 (56f8021f-fb5c-42a3-98fa-7f81b86e6ef8): created successfully Sep 03 11:15:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-22701273-a01f-482e-8e72-4d61bf769975 tempest-VolumesTestJSON-1259992027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59a8026c-0654-47db-a2b0-6287f16bb762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-22701273-a01f-482e-8e72-4d61bf769975 tempest-VolumesTestJSON-1259992027 None] Flow 'volume_create_manager' (fd114f77-7fa9-4187-817f-af31d1b72c04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:15:09 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-22701273-a01f-482e-8e72-4d61bf769975 tempest-VolumesTestJSON-1259992027 None] Created volume successfully. Sep 03 11:15:11 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-979fa738-995d-4b37-860a-19037e9f7cfa tempest-VolumesTestJSON-1259992027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:15:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-979fa738-995d-4b37-860a-19037e9f7cfa tempest-VolumesTestJSON-1259992027 None] Flow 'volume_create_manager' (1b2b457e-8f60-4f87-b989-28346d1b24f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:15:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-979fa738-995d-4b37-860a-19037e9f7cfa tempest-VolumesTestJSON-1259992027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a3aee3-b51c-448f-a168-3d8053451940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-979fa738-995d-4b37-860a-19037e9f7cfa tempest-VolumesTestJSON-1259992027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55a3aee3-b51c-448f-a168-3d8053451940) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1477028433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b0e5e9c-e345-4283-86ee-ea7a843697e5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fc2e2b8e2b124a7585ecc88d4a42a27a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:15:11Z,use_quota=True,user_id='ddc82dfe80924b76a060af818cf7df71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-979fa738-995d-4b37-860a-19037e9f7cfa tempest-VolumesTestJSON-1259992027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74715e54-7cc2-4b80-813e-0e04553bb53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-979fa738-995d-4b37-860a-19037e9f7cfa tempest-VolumesTestJSON-1259992027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74715e54-7cc2-4b80-813e-0e04553bb53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-979fa738-995d-4b37-860a-19037e9f7cfa tempest-VolumesTestJSON-1259992027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a1bcb98-a1a6-48af-93d3-c1a6cf412946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-979fa738-995d-4b37-860a-19037e9f7cfa tempest-VolumesTestJSON-1259992027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a1bcb98-a1a6-48af-93d3-c1a6cf412946) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b0e5e9c-e345-4283-86ee-ea7a843697e5', 'volume_name': 'volume-5b0e5e9c-e345-4283-86ee-ea7a843697e5', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-979fa738-995d-4b37-860a-19037e9f7cfa tempest-VolumesTestJSON-1259992027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (131750e1-c1e0-4cd8-a212-d96c1692b146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-979fa738-995d-4b37-860a-19037e9f7cfa tempest-VolumesTestJSON-1259992027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (131750e1-c1e0-4cd8-a212-d96c1692b146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-979fa738-995d-4b37-860a-19037e9f7cfa tempest-VolumesTestJSON-1259992027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fba5f3bd-ef75-40b0-8db7-045245506eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:11 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-979fa738-995d-4b37-860a-19037e9f7cfa tempest-VolumesTestJSON-1259992027 None] Volume 5b0e5e9c-e345-4283-86ee-ea7a843697e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b0e5e9c-e345-4283-86ee-ea7a843697e5', 'volume_size': 1} Sep 03 11:15:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-979fa738-995d-4b37-860a-19037e9f7cfa tempest-VolumesTestJSON-1259992027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:15:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-979fa738-995d-4b37-860a-19037e9f7cfa tempest-VolumesTestJSON-1259992027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:15:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-979fa738-995d-4b37-860a-19037e9f7cfa tempest-VolumesTestJSON-1259992027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1477028433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b0e5e9c-e345-4283-86ee-ea7a843697e5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fc2e2b8e2b124a7585ecc88d4a42a27a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:15:11Z,use_quota=True,user_id='ddc82dfe80924b76a060af818cf7df71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:15:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-979fa738-995d-4b37-860a-19037e9f7cfa tempest-VolumesTestJSON-1259992027 None] Creating volume 5b0e5e9c-e345-4283-86ee-ea7a843697e5 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:15:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-979fa738-995d-4b37-860a-19037e9f7cfa tempest-VolumesTestJSON-1259992027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:15:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-979fa738-995d-4b37-860a-19037e9f7cfa tempest-VolumesTestJSON-1259992027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:15:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-979fa738-995d-4b37-860a-19037e9f7cfa tempest-VolumesTestJSON-1259992027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:15:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-979fa738-995d-4b37-860a-19037e9f7cfa tempest-VolumesTestJSON-1259992027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:15:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-979fa738-995d-4b37-860a-19037e9f7cfa tempest-VolumesTestJSON-1259992027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:15:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-979fa738-995d-4b37-860a-19037e9f7cfa tempest-VolumesTestJSON-1259992027 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:15:11 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-979fa738-995d-4b37-860a-19037e9f7cfa tempest-VolumesTestJSON-1259992027 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:15:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-979fa738-995d-4b37-860a-19037e9f7cfa tempest-VolumesTestJSON-1259992027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5b0e5e9c-e345-4283-86ee-ea7a843697e5 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:11 devstack sudo[91005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5b0e5e9c-e345-4283-86ee-ea7a843697e5 1073741824 Sep 03 11:15:11 devstack sudo[91005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:12 devstack sudo[91005]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-979fa738-995d-4b37-860a-19037e9f7cfa tempest-VolumesTestJSON-1259992027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5b0e5e9c-e345-4283-86ee-ea7a843697e5 1073741824" returned: 0 in 0.942s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-979fa738-995d-4b37-860a-19037e9f7cfa tempest-VolumesTestJSON-1259992027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5b0e5e9c-e345-4283-86ee-ea7a843697e5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:12 devstack sudo[91016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5b0e5e9c-e345-4283-86ee-ea7a843697e5 Sep 03 11:15:12 devstack sudo[91016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:12 devstack sudo[91016]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-979fa738-995d-4b37-860a-19037e9f7cfa tempest-VolumesTestJSON-1259992027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5b0e5e9c-e345-4283-86ee-ea7a843697e5" returned: 0 in 0.497s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-979fa738-995d-4b37-860a-19037e9f7cfa tempest-VolumesTestJSON-1259992027 None] <== create_volume: return (1516ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:15:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-979fa738-995d-4b37-860a-19037e9f7cfa tempest-VolumesTestJSON-1259992027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.528s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:15:13 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-979fa738-995d-4b37-860a-19037e9f7cfa tempest-VolumesTestJSON-1259992027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fba5f3bd-ef75-40b0-8db7-045245506eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b0e5e9c-e345-4283-86ee-ea7a843697e5', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:13 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-979fa738-995d-4b37-860a-19037e9f7cfa tempest-VolumesTestJSON-1259992027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f080177-fd4c-49bf-b9ba-1b6da58b7062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:13 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-979fa738-995d-4b37-860a-19037e9f7cfa tempest-VolumesTestJSON-1259992027 None] Volume volume-5b0e5e9c-e345-4283-86ee-ea7a843697e5 (5b0e5e9c-e345-4283-86ee-ea7a843697e5): created successfully Sep 03 11:15:13 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-979fa738-995d-4b37-860a-19037e9f7cfa tempest-VolumesTestJSON-1259992027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f080177-fd4c-49bf-b9ba-1b6da58b7062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:13 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-979fa738-995d-4b37-860a-19037e9f7cfa tempest-VolumesTestJSON-1259992027 None] Flow 'volume_create_manager' (1b2b457e-8f60-4f87-b989-28346d1b24f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:15:13 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-979fa738-995d-4b37-860a-19037e9f7cfa tempest-VolumesTestJSON-1259992027 None] Created volume successfully. Sep 03 11:15:14 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-ede5dfd3-ba70-4667-9172-f722ca938fc7 req-2b509445-9aab-451d-80b9-9e227b1b7e13 tempest-ServerActionsTestOtherA-914104622 None] Terminate volume connection completed successfully. Sep 03 11:15:14 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-ede5dfd3-ba70-4667-9172-f722ca938fc7 req-2b509445-9aab-451d-80b9-9e227b1b7e13 tempest-ServerActionsTestOtherA-914104622 None] Deleting attachment 9ef37f3a-15d0-409f-8be3-6c4bac6dea4e. {{(pid=87038) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:15:15 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-44c90f33-38e2-4f89-8892-0ddbe5f35367 tempest-VolumesTestJSON-1259992027 None] Acquiring lock "cinder-5b0e5e9c-e345-4283-86ee-ea7a843697e5-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:15:15 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-44c90f33-38e2-4f89-8892-0ddbe5f35367 tempest-VolumesTestJSON-1259992027 None] Lock "cinder-5b0e5e9c-e345-4283-86ee-ea7a843697e5-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:15:15 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-44c90f33-38e2-4f89-8892-0ddbe5f35367 tempest-VolumesTestJSON-1259992027 None] Acquiring lock "cinder-quobyte-5b0e5e9c-e345-4283-86ee-ea7a843697e5" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:15:15 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-44c90f33-38e2-4f89-8892-0ddbe5f35367 tempest-VolumesTestJSON-1259992027 None] Lock "cinder-quobyte-5b0e5e9c-e345-4283-86ee-ea7a843697e5" acquired by "delete_volume" :: waited 0.028s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:15:15 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fc2903-b34e-4ef4-ba92-947d5cc64156]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:15:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-44c90f33-38e2-4f89-8892-0ddbe5f35367 tempest-VolumesTestJSON-1259992027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5b0e5e9c-e345-4283-86ee-ea7a843697e5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:15 devstack sudo[91027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5b0e5e9c-e345-4283-86ee-ea7a843697e5 Sep 03 11:15:15 devstack sudo[91027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:15 devstack sudo[91027]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-44c90f33-38e2-4f89-8892-0ddbe5f35367 tempest-VolumesTestJSON-1259992027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5b0e5e9c-e345-4283-86ee-ea7a843697e5" returned: 0 in 0.489s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-44c90f33-38e2-4f89-8892-0ddbe5f35367 tempest-VolumesTestJSON-1259992027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5b0e5e9c-e345-4283-86ee-ea7a843697e5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:15 devstack sudo[91034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5b0e5e9c-e345-4283-86ee-ea7a843697e5 Sep 03 11:15:15 devstack sudo[91034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:16 devstack sudo[91034]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-44c90f33-38e2-4f89-8892-0ddbe5f35367 tempest-VolumesTestJSON-1259992027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5b0e5e9c-e345-4283-86ee-ea7a843697e5" returned: 0 in 0.439s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:16 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-44c90f33-38e2-4f89-8892-0ddbe5f35367 tempest-VolumesTestJSON-1259992027 None] Lock "cinder-quobyte-5b0e5e9c-e345-4283-86ee-ea7a843697e5" released by "delete_volume" :: held 0.997s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:15:16 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-44c90f33-38e2-4f89-8892-0ddbe5f35367 tempest-VolumesTestJSON-1259992027 None] Created reservations ['8e50539d-4d90-4916-b281-e1f80cdf0f40', '67590520-bbc4-4389-ab70-e7109f52b4cf', 'f9c652d6-ff77-4811-ace6-02d18696cc1f', 'e50c770f-e9f2-4d0b-b73e-5c2f5dc29f8f'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:15:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-44c90f33-38e2-4f89-8892-0ddbe5f35367 tempest-VolumesTestJSON-1259992027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:15:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-44c90f33-38e2-4f89-8892-0ddbe5f35367 tempest-VolumesTestJSON-1259992027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:15:16 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-44c90f33-38e2-4f89-8892-0ddbe5f35367 tempest-VolumesTestJSON-1259992027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:15:16 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-44c90f33-38e2-4f89-8892-0ddbe5f35367 tempest-VolumesTestJSON-1259992027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:15:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-44c90f33-38e2-4f89-8892-0ddbe5f35367 tempest-VolumesTestJSON-1259992027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:15:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-44c90f33-38e2-4f89-8892-0ddbe5f35367 tempest-VolumesTestJSON-1259992027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:16 devstack sudo[91059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:15:16 devstack sudo[91059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:16 devstack sudo[91059]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-44c90f33-38e2-4f89-8892-0ddbe5f35367 tempest-VolumesTestJSON-1259992027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.284s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:16 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-44c90f33-38e2-4f89-8892-0ddbe5f35367 tempest-VolumesTestJSON-1259992027 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:15:16 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-44c90f33-38e2-4f89-8892-0ddbe5f35367 tempest-VolumesTestJSON-1259992027 None] Deleted volume successfully. Sep 03 11:15:16 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-44c90f33-38e2-4f89-8892-0ddbe5f35367 tempest-VolumesTestJSON-1259992027 None] Lock "cinder-5b0e5e9c-e345-4283-86ee-ea7a843697e5-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:15:17 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ccccfb1d-9728-401c-bdbc-be6e7b8866cb tempest-VolumesTestJSON-1259992027 None] Acquiring lock "cinder-56f8021f-fb5c-42a3-98fa-7f81b86e6ef8-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:15:17 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ccccfb1d-9728-401c-bdbc-be6e7b8866cb tempest-VolumesTestJSON-1259992027 None] Lock "cinder-56f8021f-fb5c-42a3-98fa-7f81b86e6ef8-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:15:17 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ccccfb1d-9728-401c-bdbc-be6e7b8866cb tempest-VolumesTestJSON-1259992027 None] Acquiring lock "cinder-quobyte-56f8021f-fb5c-42a3-98fa-7f81b86e6ef8" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:15:17 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ccccfb1d-9728-401c-bdbc-be6e7b8866cb tempest-VolumesTestJSON-1259992027 None] Lock "cinder-quobyte-56f8021f-fb5c-42a3-98fa-7f81b86e6ef8" acquired by "delete_volume" :: waited 0.028s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:15:17 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[d21ec7de-5e58-456b-b2a1-03096a482c8d]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:15:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ccccfb1d-9728-401c-bdbc-be6e7b8866cb tempest-VolumesTestJSON-1259992027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-56f8021f-fb5c-42a3-98fa-7f81b86e6ef8 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:17 devstack sudo[91067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-56f8021f-fb5c-42a3-98fa-7f81b86e6ef8 Sep 03 11:15:17 devstack sudo[91067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:17 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:15:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:15:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:15:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:15:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:15:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:15:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:17 devstack sudo[91074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:15:17 devstack sudo[91074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:17 devstack sudo[91067]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ccccfb1d-9728-401c-bdbc-be6e7b8866cb tempest-VolumesTestJSON-1259992027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-56f8021f-fb5c-42a3-98fa-7f81b86e6ef8" returned: 0 in 0.500s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ccccfb1d-9728-401c-bdbc-be6e7b8866cb tempest-VolumesTestJSON-1259992027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-56f8021f-fb5c-42a3-98fa-7f81b86e6ef8 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:18 devstack sudo[91076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-56f8021f-fb5c-42a3-98fa-7f81b86e6ef8 Sep 03 11:15:18 devstack sudo[91076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:18 devstack sudo[91076]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ccccfb1d-9728-401c-bdbc-be6e7b8866cb tempest-VolumesTestJSON-1259992027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-56f8021f-fb5c-42a3-98fa-7f81b86e6ef8" returned: 0 in 0.317s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:18 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ccccfb1d-9728-401c-bdbc-be6e7b8866cb tempest-VolumesTestJSON-1259992027 None] Lock "cinder-quobyte-56f8021f-fb5c-42a3-98fa-7f81b86e6ef8" released by "delete_volume" :: held 0.865s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:15:18 devstack sudo[91074]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.456s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:18 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:15:18 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-ccccfb1d-9728-401c-bdbc-be6e7b8866cb tempest-VolumesTestJSON-1259992027 None] Created reservations ['5b37e3aa-ba43-4df4-935c-ccc7a5da1835', '122a1765-8120-48bf-a567-bdd0aad75555', '5b7fcaf2-e9fe-4092-a447-3d827851bef2', 'ce2c75dc-4c60-4342-8fa7-85ddda16eb5f'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:15:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ccccfb1d-9728-401c-bdbc-be6e7b8866cb tempest-VolumesTestJSON-1259992027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:15:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ccccfb1d-9728-401c-bdbc-be6e7b8866cb tempest-VolumesTestJSON-1259992027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:15:18 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ccccfb1d-9728-401c-bdbc-be6e7b8866cb tempest-VolumesTestJSON-1259992027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:15:18 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ccccfb1d-9728-401c-bdbc-be6e7b8866cb tempest-VolumesTestJSON-1259992027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:15:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ccccfb1d-9728-401c-bdbc-be6e7b8866cb tempest-VolumesTestJSON-1259992027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:15:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ccccfb1d-9728-401c-bdbc-be6e7b8866cb tempest-VolumesTestJSON-1259992027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:18 devstack sudo[91081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:15:18 devstack sudo[91081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:18 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-62b99c02-9e4e-412a-809d-6fdc49a45056 tempest-VolumesTestJSON-1259992027 None] Acquiring lock "cinder-17429fd9-ba22-4153-8a0d-cec9becf216b-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:15:18 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-62b99c02-9e4e-412a-809d-6fdc49a45056 tempest-VolumesTestJSON-1259992027 None] Lock "cinder-17429fd9-ba22-4153-8a0d-cec9becf216b-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:15:18 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-62b99c02-9e4e-412a-809d-6fdc49a45056 tempest-VolumesTestJSON-1259992027 None] Acquiring lock "cinder-quobyte-17429fd9-ba22-4153-8a0d-cec9becf216b" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:15:18 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-62b99c02-9e4e-412a-809d-6fdc49a45056 tempest-VolumesTestJSON-1259992027 None] Lock "cinder-quobyte-17429fd9-ba22-4153-8a0d-cec9becf216b" acquired by "delete_volume" :: waited 0.028s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:15:18 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d94eac4-5788-4595-827b-8556c33b4782]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:15:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-62b99c02-9e4e-412a-809d-6fdc49a45056 tempest-VolumesTestJSON-1259992027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-17429fd9-ba22-4153-8a0d-cec9becf216b {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:18 devstack sudo[91081]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ccccfb1d-9728-401c-bdbc-be6e7b8866cb tempest-VolumesTestJSON-1259992027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.391s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:18 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-ccccfb1d-9728-401c-bdbc-be6e7b8866cb tempest-VolumesTestJSON-1259992027 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:15:18 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-ccccfb1d-9728-401c-bdbc-be6e7b8866cb tempest-VolumesTestJSON-1259992027 None] Deleted volume successfully. Sep 03 11:15:18 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-0b04fb4b-ec9c-4833-b8d0-fa373e52f387 tempest-TaggedAttachmentsTest-2046288793 None] Acquiring lock "cinder-af5a3fd7-e087-403c-b1d5-d324e091a7fd-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:15:18 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ccccfb1d-9728-401c-bdbc-be6e7b8866cb tempest-VolumesTestJSON-1259992027 None] Lock "cinder-56f8021f-fb5c-42a3-98fa-7f81b86e6ef8-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:15:18 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-0b04fb4b-ec9c-4833-b8d0-fa373e52f387 tempest-TaggedAttachmentsTest-2046288793 None] Lock "cinder-af5a3fd7-e087-403c-b1d5-d324e091a7fd-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:15:19 devstack sudo[91085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-17429fd9-ba22-4153-8a0d-cec9becf216b Sep 03 11:15:19 devstack sudo[91085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:19 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-0b04fb4b-ec9c-4833-b8d0-fa373e52f387 tempest-TaggedAttachmentsTest-2046288793 None] Acquiring lock "cinder-quobyte-af5a3fd7-e087-403c-b1d5-d324e091a7fd" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:15:19 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-0b04fb4b-ec9c-4833-b8d0-fa373e52f387 tempest-TaggedAttachmentsTest-2046288793 None] Lock "cinder-quobyte-af5a3fd7-e087-403c-b1d5-d324e091a7fd" acquired by "delete_volume" :: waited 0.019s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:15:19 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4f791d-5efe-4bc1-b737-f1ff79a77b2b]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:15:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0b04fb4b-ec9c-4833-b8d0-fa373e52f387 tempest-TaggedAttachmentsTest-2046288793 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-af5a3fd7-e087-403c-b1d5-d324e091a7fd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:19 devstack sudo[91087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-af5a3fd7-e087-403c-b1d5-d324e091a7fd Sep 03 11:15:19 devstack sudo[91087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:19 devstack sudo[91085]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-62b99c02-9e4e-412a-809d-6fdc49a45056 tempest-VolumesTestJSON-1259992027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-17429fd9-ba22-4153-8a0d-cec9becf216b" returned: 0 in 0.499s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-62b99c02-9e4e-412a-809d-6fdc49a45056 tempest-VolumesTestJSON-1259992027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-17429fd9-ba22-4153-8a0d-cec9becf216b {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:19 devstack sudo[91092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-17429fd9-ba22-4153-8a0d-cec9becf216b Sep 03 11:15:19 devstack sudo[91092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:19 devstack sudo[91087]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0b04fb4b-ec9c-4833-b8d0-fa373e52f387 tempest-TaggedAttachmentsTest-2046288793 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-af5a3fd7-e087-403c-b1d5-d324e091a7fd" returned: 0 in 0.432s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0b04fb4b-ec9c-4833-b8d0-fa373e52f387 tempest-TaggedAttachmentsTest-2046288793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-af5a3fd7-e087-403c-b1d5-d324e091a7fd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:19 devstack sudo[91097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-af5a3fd7-e087-403c-b1d5-d324e091a7fd Sep 03 11:15:19 devstack sudo[91097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:19 devstack sudo[91092]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-62b99c02-9e4e-412a-809d-6fdc49a45056 tempest-VolumesTestJSON-1259992027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-17429fd9-ba22-4153-8a0d-cec9becf216b" returned: 0 in 0.262s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:19 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-62b99c02-9e4e-412a-809d-6fdc49a45056 tempest-VolumesTestJSON-1259992027 None] Lock "cinder-quobyte-17429fd9-ba22-4153-8a0d-cec9becf216b" released by "delete_volume" :: held 0.827s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:15:19 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-62b99c02-9e4e-412a-809d-6fdc49a45056 tempest-VolumesTestJSON-1259992027 None] Created reservations ['52df6674-1690-46b4-96cd-99b384015cf9', '0332f891-41f7-4417-90a2-a3cd0666a6eb', '677cc2c1-fd85-4dee-ba5c-841a8f547898', 'f897592c-8f31-4ded-a983-174c38315ebc'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:15:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-62b99c02-9e4e-412a-809d-6fdc49a45056 tempest-VolumesTestJSON-1259992027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:15:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-62b99c02-9e4e-412a-809d-6fdc49a45056 tempest-VolumesTestJSON-1259992027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:15:19 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-62b99c02-9e4e-412a-809d-6fdc49a45056 tempest-VolumesTestJSON-1259992027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:15:19 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-62b99c02-9e4e-412a-809d-6fdc49a45056 tempest-VolumesTestJSON-1259992027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:15:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-62b99c02-9e4e-412a-809d-6fdc49a45056 tempest-VolumesTestJSON-1259992027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:15:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-62b99c02-9e4e-412a-809d-6fdc49a45056 tempest-VolumesTestJSON-1259992027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:19 devstack sudo[91101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:15:19 devstack sudo[91101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:19 devstack sudo[91097]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0b04fb4b-ec9c-4833-b8d0-fa373e52f387 tempest-TaggedAttachmentsTest-2046288793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-af5a3fd7-e087-403c-b1d5-d324e091a7fd" returned: 0 in 0.325s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:19 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-0b04fb4b-ec9c-4833-b8d0-fa373e52f387 tempest-TaggedAttachmentsTest-2046288793 None] Lock "cinder-quobyte-af5a3fd7-e087-403c-b1d5-d324e091a7fd" released by "delete_volume" :: held 0.835s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:15:19 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-0b04fb4b-ec9c-4833-b8d0-fa373e52f387 tempest-TaggedAttachmentsTest-2046288793 None] Created reservations ['f5baaad0-4611-49e5-b425-bdf0b496bc02', '2b3a33cb-e355-4847-b0cc-7fd6ab7f80ae', '61e82854-abb7-42be-ba4e-08e88643485e', '4c7e0b4a-1715-4591-8414-f620331353f5'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:15:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0b04fb4b-ec9c-4833-b8d0-fa373e52f387 tempest-TaggedAttachmentsTest-2046288793 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:15:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0b04fb4b-ec9c-4833-b8d0-fa373e52f387 tempest-TaggedAttachmentsTest-2046288793 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:15:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0b04fb4b-ec9c-4833-b8d0-fa373e52f387 tempest-TaggedAttachmentsTest-2046288793 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:15:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0b04fb4b-ec9c-4833-b8d0-fa373e52f387 tempest-TaggedAttachmentsTest-2046288793 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:15:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0b04fb4b-ec9c-4833-b8d0-fa373e52f387 tempest-TaggedAttachmentsTest-2046288793 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:15:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0b04fb4b-ec9c-4833-b8d0-fa373e52f387 tempest-TaggedAttachmentsTest-2046288793 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:20 devstack sudo[91101]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-62b99c02-9e4e-412a-809d-6fdc49a45056 tempest-VolumesTestJSON-1259992027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.414s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:20 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-62b99c02-9e4e-412a-809d-6fdc49a45056 tempest-VolumesTestJSON-1259992027 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:15:20 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-62b99c02-9e4e-412a-809d-6fdc49a45056 tempest-VolumesTestJSON-1259992027 None] Deleted volume successfully. Sep 03 11:15:20 devstack sudo[91105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:15:20 devstack sudo[91105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:20 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-62b99c02-9e4e-412a-809d-6fdc49a45056 tempest-VolumesTestJSON-1259992027 None] Lock "cinder-17429fd9-ba22-4153-8a0d-cec9becf216b-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:15:20 devstack sudo[91105]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0b04fb4b-ec9c-4833-b8d0-fa373e52f387 tempest-TaggedAttachmentsTest-2046288793 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.411s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:20 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-0b04fb4b-ec9c-4833-b8d0-fa373e52f387 tempest-TaggedAttachmentsTest-2046288793 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:15:20 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-0b04fb4b-ec9c-4833-b8d0-fa373e52f387 tempest-TaggedAttachmentsTest-2046288793 None] Deleted volume successfully. Sep 03 11:15:20 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-0b04fb4b-ec9c-4833-b8d0-fa373e52f387 tempest-TaggedAttachmentsTest-2046288793 None] Lock "cinder-af5a3fd7-e087-403c-b1d5-d324e091a7fd-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:15:24 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:15:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Flow 'volume_create_manager' (1164213a-8588-4e62-b491-6a7235cbc4cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:15:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff2ea67-123a-47f5-bb56-49d588a771fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ff2ea67-123a-47f5-bb56-49d588a771fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-65470307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5222a549-c61d-41a2-a4fb-7e81ec07333d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31a5439975e54962a5c8b30af3d0b213',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:15:24Z,use_quota=True,user_id='1626a63865fd44769359e6a112645437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2290aadd-1ff6-4f04-8602-4a00ccdf0190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2290aadd-1ff6-4f04-8602-4a00ccdf0190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc389d12-367b-48a5-adb8-03c3ef548a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:24 devstack cinder-volume[87038]: DEBUG cinder.image.glance [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Creating Keystone auth plugin from conf {{(pid=87038) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 11:15:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc389d12-367b-48a5-adb8-03c3ef548a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5222a549-c61d-41a2-a4fb-7e81ec07333d', 'volume_name': 'volume-5222a549-c61d-41a2-a4fb-7e81ec07333d', 'volume_size': 1, 'image_id': 'e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72db6f41ce954ca898cc9f539a1cd3c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'created_at': datetime.datetime(2026, 9, 3, 9, 7, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 7, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279ab673-b199-4d5f-99f7-46a3cbe0d067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (279ab673-b199-4d5f-99f7-46a3cbe0d067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac8f6cf-4a78-4472-b5f6-d48d56d90f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:25 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Volume 5222a549-c61d-41a2-a4fb-7e81ec07333d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5222a549-c61d-41a2-a4fb-7e81ec07333d', 'volume_size': 1, 'image_id': 'e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72db6f41ce954ca898cc9f539a1cd3c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'created_at': datetime.datetime(2026, 9, 3, 9, 7, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 7, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 03 11:15:25 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Trying to clone 5222a549-c61d-41a2-a4fb-7e81ec07333d from image e1b59027-cb2e-4dc7-b35a-2801c7a053de at location (None, [{'url': 'file:///opt/stack/data/glance/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'metadata': {}}]). {{(pid=87038) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 11:15:25 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de__6zph_l_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87038) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 11:15:25 devstack cinder-volume[87038]: INFO cinder.image.image_utils [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Image download 20.69 MB at 20.69 MB/s Sep 03 11:15:25 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[76310d5e-b03f-4a6e-aa17-18ab54376c1e]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:15:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de__6zph_l_devstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:26 devstack sudo[91130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de__6zph_l_devstack@QuobyteHD Sep 03 11:15:26 devstack sudo[91130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:26 devstack sudo[91130]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de__6zph_l_devstack@QuobyteHD" returned: 0 in 0.422s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:26 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Temporary image e1b59027-cb2e-4dc7-b35a-2801c7a053de is fetched for user 1626a63865fd44769359e6a112645437. {{(pid=87038) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 11:15:26 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f543ab-8e07-4394-a1e4-d5cc1a9919a7]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:15:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de__6zph_l_devstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:26 devstack sudo[91136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de__6zph_l_devstack@QuobyteHD Sep 03 11:15:26 devstack sudo[91136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:26 devstack sudo[91136]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de__6zph_l_devstack@QuobyteHD" returned: 0 in 0.385s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:15:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:15:26 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:15:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-65470307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5222a549-c61d-41a2-a4fb-7e81ec07333d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31a5439975e54962a5c8b30af3d0b213',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:15:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:15:24Z,use_quota=True,user_id='1626a63865fd44769359e6a112645437',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:15:26 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Creating volume 5222a549-c61d-41a2-a4fb-7e81ec07333d {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:15:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:15:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:15:26 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:15:26 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:15:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:15:26 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:15:26 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:15:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5222a549-c61d-41a2-a4fb-7e81ec07333d 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:26 devstack sudo[91141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5222a549-c61d-41a2-a4fb-7e81ec07333d 1073741824 Sep 03 11:15:26 devstack sudo[91141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:27 devstack sudo[91141]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5222a549-c61d-41a2-a4fb-7e81ec07333d 1073741824" returned: 0 in 0.548s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5222a549-c61d-41a2-a4fb-7e81ec07333d {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:27 devstack sudo[91148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5222a549-c61d-41a2-a4fb-7e81ec07333d Sep 03 11:15:27 devstack sudo[91148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:27 devstack sudo[91148]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5222a549-c61d-41a2-a4fb-7e81ec07333d" returned: 0 in 0.260s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:15:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:15:27 devstack cinder-volume[87038]: DEBUG cinder.volume.volume_utils [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Attempting download of e1b59027-cb2e-4dc7-b35a-2801c7a053de ((None, [{'url': 'file:///opt/stack/data/glance/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'metadata': {}}])) to volume 5222a549-c61d-41a2-a4fb-7e81ec07333d. {{(pid=87038) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 11:15:27 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1ecddf-6406-4e9c-9686-f88f114406a3]: (4, 'raw') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:15:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1b59027-cb2e-4dc7-b35a-2801c7a053de_b1o515u3 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:27 devstack sudo[91151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1b59027-cb2e-4dc7-b35a-2801c7a053de_b1o515u3 Sep 03 11:15:27 devstack sudo[91151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:28 devstack sudo[91151]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1b59027-cb2e-4dc7-b35a-2801c7a053de_b1o515u3" returned: 0 in 0.407s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1b59027-cb2e-4dc7-b35a-2801c7a053de_b1o515u3 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:28 devstack sudo[91156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1b59027-cb2e-4dc7-b35a-2801c7a053de_b1o515u3 Sep 03 11:15:28 devstack sudo[91156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:28 devstack sudo[91156]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1b59027-cb2e-4dc7-b35a-2801c7a053de_b1o515u3" returned: 1 in 0.371s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1b59027-cb2e-4dc7-b35a-2801c7a053de_b1o515u3' failed. Not Retrying. {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:15:28 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad65bfa-bbd7-4f14-a1a9-35c48ab19211]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:15:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de__6zph_l_devstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:28 devstack sudo[91160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de__6zph_l_devstack@QuobyteHD Sep 03 11:15:28 devstack sudo[91160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:28 devstack sudo[91160]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de__6zph_l_devstack@QuobyteHD" returned: 0 in 0.358s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:28 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] e1b59027-cb2e-4dc7-b35a-2801c7a053de was qcow2, converting to qcow2 {{(pid=87038) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 11:15:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de__6zph_l_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5222a549-c61d-41a2-a4fb-7e81ec07333d {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:29 devstack sudo[91166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de__6zph_l_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5222a549-c61d-41a2-a4fb-7e81ec07333d Sep 03 11:15:29 devstack sudo[91166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:31 devstack sudo[91166]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de__6zph_l_devstack@QuobyteHD /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5222a549-c61d-41a2-a4fb-7e81ec07333d" returned: 0 in 2.076s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:31 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de__6zph_l_devstack@QuobyteHD, size 112.00 MB, duration 2.08 sec, destination /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5222a549-c61d-41a2-a4fb-7e81ec07333d {{(pid=87038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:15:31 devstack cinder-volume[87038]: INFO cinder.image.image_utils [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Converted 112.00 MB image at 53.92 MB/s Sep 03 11:15:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5222a549-c61d-41a2-a4fb-7e81ec07333d 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:31 devstack sudo[91174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5222a549-c61d-41a2-a4fb-7e81ec07333d 1G Sep 03 11:15:31 devstack sudo[91174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:31 devstack sudo[91174]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5222a549-c61d-41a2-a4fb-7e81ec07333d 1G" returned: 0 in 0.391s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:31 devstack cinder-volume[87038]: DEBUG cinder.volume.volume_utils [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Downloaded image e1b59027-cb2e-4dc7-b35a-2801c7a053de ((None, [{'url': 'file:///opt/stack/data/glance/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'metadata': {}}])) to volume 5222a549-c61d-41a2-a4fb-7e81ec07333d successfully. {{(pid=87038) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 11:15:31 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Temporary image e1b59027-cb2e-4dc7-b35a-2801c7a053de for user 1626a63865fd44769359e6a112645437 is deleted. {{(pid=87038) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 11:15:31 devstack cinder-volume[87038]: DEBUG cinder.volume.volume_utils [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Marking volume 5222a549-c61d-41a2-a4fb-7e81ec07333d as bootable. {{(pid=87038) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 11:15:31 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Copying metadata from image e1b59027-cb2e-4dc7-b35a-2801c7a053de to 5222a549-c61d-41a2-a4fb-7e81ec07333d. {{(pid=87038) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 11:15:31 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Creating volume glance metadata for volume 5222a549-c61d-41a2-a4fb-7e81ec07333d backed by image e1b59027-cb2e-4dc7-b35a-2801c7a053de with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87038) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 11:15:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eac8f6cf-4a78-4472-b5f6-d48d56d90f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5222a549-c61d-41a2-a4fb-7e81ec07333d', 'volume_size': 1, 'image_id': 'e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72db6f41ce954ca898cc9f539a1cd3c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'created_at': datetime.datetime(2026, 9, 3, 9, 7, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 7, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5acdbdfd-be7a-412a-8766-95137e3c64d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:15:31 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Volume volume-5222a549-c61d-41a2-a4fb-7e81ec07333d (5222a549-c61d-41a2-a4fb-7e81ec07333d): created successfully Sep 03 11:15:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5acdbdfd-be7a-412a-8766-95137e3c64d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:15:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Flow 'volume_create_manager' (1164213a-8588-4e62-b491-6a7235cbc4cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:15:31 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-12a7bff3-7f59-43b1-a6dd-01aafa87d4e5 tempest-ServerActionsTestOtherA-914104622 None] Created volume successfully. Sep 03 11:15:35 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-2df7ccee-c73e-4ccb-ad81-78887fa26806 tempest-GroupsV320Test-67646938 None] Group tempest-GroupsV320Test-Group-1060906655: creating Sep 03 11:15:35 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-2df7ccee-c73e-4ccb-ad81-78887fa26806 tempest-GroupsV320Test-67646938 None] Group tempest-GroupsV320Test-Group-1060906655: created successfully Sep 03 11:15:35 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-2df7ccee-c73e-4ccb-ad81-78887fa26806 tempest-GroupsV320Test-67646938 None] Create group completed successfully. Sep 03 11:15:37 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-15267b2b-b075-4da8-97e6-72a06459ba37 tempest-GroupsV320Test-67646938 None] Created reservations ['067513fa-bef2-434f-a920-8656b638a63b'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:15:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-15267b2b-b075-4da8-97e6-72a06459ba37 tempest-GroupsV320Test-67646938 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:15:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-15267b2b-b075-4da8-97e6-72a06459ba37 tempest-GroupsV320Test-67646938 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:15:37 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-15267b2b-b075-4da8-97e6-72a06459ba37 tempest-GroupsV320Test-67646938 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:15:37 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-15267b2b-b075-4da8-97e6-72a06459ba37 tempest-GroupsV320Test-67646938 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:15:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-15267b2b-b075-4da8-97e6-72a06459ba37 tempest-GroupsV320Test-67646938 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:15:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-15267b2b-b075-4da8-97e6-72a06459ba37 tempest-GroupsV320Test-67646938 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:15:37 devstack sudo[91197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:15:37 devstack sudo[91197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:15:38 devstack sudo[91197]: pam_unix(sudo:session): session closed for user root Sep 03 11:15:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-15267b2b-b075-4da8-97e6-72a06459ba37 tempest-GroupsV320Test-67646938 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.362s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:15:38 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-15267b2b-b075-4da8-97e6-72a06459ba37 tempest-GroupsV320Test-67646938 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:15:38 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-15267b2b-b075-4da8-97e6-72a06459ba37 tempest-GroupsV320Test-67646938 None] Delete group completed successfully. Sep 03 11:15:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-7388222e-811a-4580-917a-3f17c86df43d req-4c8d60bb-132c-49ff-8cfa-eb99b24ef9be tempest-ServerActionsTestOtherA-914104622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:15:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-7388222e-811a-4580-917a-3f17c86df43d req-4c8d60bb-132c-49ff-8cfa-eb99b24ef9be tempest-ServerActionsTestOtherA-914104622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:15:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-7388222e-811a-4580-917a-3f17c86df43d req-4c8d60bb-132c-49ff-8cfa-eb99b24ef9be tempest-ServerActionsTestOtherA-914104622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:15:38 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-7388222e-811a-4580-917a-3f17c86df43d req-4c8d60bb-132c-49ff-8cfa-eb99b24ef9be tempest-ServerActionsTestOtherA-914104622 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912', 'name': 'volume-5222a549-c61d-41a2-a4fb-7e81ec07333d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '26cadcb9-be0c-4b23-9774-6efa5aeae6d3', 'enforce_multipath': True} {{(pid=87038) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:15:38 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-7388222e-811a-4580-917a-3f17c86df43d req-4c8d60bb-132c-49ff-8cfa-eb99b24ef9be tempest-ServerActionsTestOtherA-914104622 None] attachment_update completed successfully. Sep 03 11:15:51 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=65,cinder:UPDATE=53,cinder:INSERT=20,cinder:DELETE=4 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:15:51 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=60,cinder:UPDATE=68,cinder:INSERT=18,cinder:DELETE=5 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:16:08 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-77dc2a76-1848-42a3-a476-bb30811708b7 tempest-VolumeQuotasAdminTestJSON-1893144618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:16:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-77dc2a76-1848-42a3-a476-bb30811708b7 tempest-VolumeQuotasAdminTestJSON-1893144618 None] Flow 'volume_create_manager' (34257e11-933b-426c-af0f-39fa877cd2ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:16:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-77dc2a76-1848-42a3-a476-bb30811708b7 tempest-VolumeQuotasAdminTestJSON-1893144618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (468dfd51-4a04-4cb9-9a7b-1d2cb796a3b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:16:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-77dc2a76-1848-42a3-a476-bb30811708b7 tempest-VolumeQuotasAdminTestJSON-1893144618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (468dfd51-4a04-4cb9-9a7b-1d2cb796a3b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1584110693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20816592-15ab-4669-bdb6-a090eda4a2fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f0590c8ce34adf81b657402eaf4ec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:16:08Z,use_quota=True,user_id='68fb7f587887403ea95b8936721b36e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:16:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-77dc2a76-1848-42a3-a476-bb30811708b7 tempest-VolumeQuotasAdminTestJSON-1893144618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (522d1e46-b511-4b3c-8d34-c3ce4d144a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:16:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-77dc2a76-1848-42a3-a476-bb30811708b7 tempest-VolumeQuotasAdminTestJSON-1893144618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (522d1e46-b511-4b3c-8d34-c3ce4d144a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:16:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-77dc2a76-1848-42a3-a476-bb30811708b7 tempest-VolumeQuotasAdminTestJSON-1893144618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbb46313-4f4a-4d6a-b8b0-b3f03b2de6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:16:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-77dc2a76-1848-42a3-a476-bb30811708b7 tempest-VolumeQuotasAdminTestJSON-1893144618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbb46313-4f4a-4d6a-b8b0-b3f03b2de6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20816592-15ab-4669-bdb6-a090eda4a2fb', 'volume_name': 'volume-20816592-15ab-4669-bdb6-a090eda4a2fb', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:16:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-77dc2a76-1848-42a3-a476-bb30811708b7 tempest-VolumeQuotasAdminTestJSON-1893144618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f141f8d-1610-4464-a1fa-f772fff591a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:16:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-77dc2a76-1848-42a3-a476-bb30811708b7 tempest-VolumeQuotasAdminTestJSON-1893144618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f141f8d-1610-4464-a1fa-f772fff591a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:16:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-77dc2a76-1848-42a3-a476-bb30811708b7 tempest-VolumeQuotasAdminTestJSON-1893144618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0a28cc7-746d-41c6-8133-784e308a9c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:16:08 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-77dc2a76-1848-42a3-a476-bb30811708b7 tempest-VolumeQuotasAdminTestJSON-1893144618 None] Volume 20816592-15ab-4669-bdb6-a090eda4a2fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20816592-15ab-4669-bdb6-a090eda4a2fb', 'volume_size': 1} Sep 03 11:16:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-77dc2a76-1848-42a3-a476-bb30811708b7 tempest-VolumeQuotasAdminTestJSON-1893144618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:16:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-77dc2a76-1848-42a3-a476-bb30811708b7 tempest-VolumeQuotasAdminTestJSON-1893144618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:16:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-77dc2a76-1848-42a3-a476-bb30811708b7 tempest-VolumeQuotasAdminTestJSON-1893144618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:16:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1584110693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20816592-15ab-4669-bdb6-a090eda4a2fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f0590c8ce34adf81b657402eaf4ec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:16:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:16:08Z,use_quota=True,user_id='68fb7f587887403ea95b8936721b36e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:16:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-77dc2a76-1848-42a3-a476-bb30811708b7 tempest-VolumeQuotasAdminTestJSON-1893144618 None] Creating volume 20816592-15ab-4669-bdb6-a090eda4a2fb {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:16:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-77dc2a76-1848-42a3-a476-bb30811708b7 tempest-VolumeQuotasAdminTestJSON-1893144618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:16:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-77dc2a76-1848-42a3-a476-bb30811708b7 tempest-VolumeQuotasAdminTestJSON-1893144618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:16:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-77dc2a76-1848-42a3-a476-bb30811708b7 tempest-VolumeQuotasAdminTestJSON-1893144618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:16:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-77dc2a76-1848-42a3-a476-bb30811708b7 tempest-VolumeQuotasAdminTestJSON-1893144618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:16:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-77dc2a76-1848-42a3-a476-bb30811708b7 tempest-VolumeQuotasAdminTestJSON-1893144618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:16:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-77dc2a76-1848-42a3-a476-bb30811708b7 tempest-VolumeQuotasAdminTestJSON-1893144618 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:16:08 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-77dc2a76-1848-42a3-a476-bb30811708b7 tempest-VolumeQuotasAdminTestJSON-1893144618 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:16:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-77dc2a76-1848-42a3-a476-bb30811708b7 tempest-VolumeQuotasAdminTestJSON-1893144618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-20816592-15ab-4669-bdb6-a090eda4a2fb 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:08 devstack sudo[91817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-20816592-15ab-4669-bdb6-a090eda4a2fb 1073741824 Sep 03 11:16:08 devstack sudo[91817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:09 devstack sudo[91817]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-77dc2a76-1848-42a3-a476-bb30811708b7 tempest-VolumeQuotasAdminTestJSON-1893144618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-20816592-15ab-4669-bdb6-a090eda4a2fb 1073741824" returned: 0 in 0.614s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-77dc2a76-1848-42a3-a476-bb30811708b7 tempest-VolumeQuotasAdminTestJSON-1893144618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-20816592-15ab-4669-bdb6-a090eda4a2fb {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:09 devstack sudo[91822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-20816592-15ab-4669-bdb6-a090eda4a2fb Sep 03 11:16:09 devstack sudo[91822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:09 devstack sudo[91822]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-77dc2a76-1848-42a3-a476-bb30811708b7 tempest-VolumeQuotasAdminTestJSON-1893144618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-20816592-15ab-4669-bdb6-a090eda4a2fb" returned: 0 in 0.478s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-77dc2a76-1848-42a3-a476-bb30811708b7 tempest-VolumeQuotasAdminTestJSON-1893144618 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:16:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-77dc2a76-1848-42a3-a476-bb30811708b7 tempest-VolumeQuotasAdminTestJSON-1893144618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.194s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:16:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-77dc2a76-1848-42a3-a476-bb30811708b7 tempest-VolumeQuotasAdminTestJSON-1893144618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0a28cc7-746d-41c6-8133-784e308a9c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20816592-15ab-4669-bdb6-a090eda4a2fb', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:16:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-77dc2a76-1848-42a3-a476-bb30811708b7 tempest-VolumeQuotasAdminTestJSON-1893144618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2daa78a-3378-4b24-a28c-b5d0dd3fa611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:16:09 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-77dc2a76-1848-42a3-a476-bb30811708b7 tempest-VolumeQuotasAdminTestJSON-1893144618 None] Volume volume-20816592-15ab-4669-bdb6-a090eda4a2fb (20816592-15ab-4669-bdb6-a090eda4a2fb): created successfully Sep 03 11:16:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-77dc2a76-1848-42a3-a476-bb30811708b7 tempest-VolumeQuotasAdminTestJSON-1893144618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2daa78a-3378-4b24-a28c-b5d0dd3fa611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:16:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-77dc2a76-1848-42a3-a476-bb30811708b7 tempest-VolumeQuotasAdminTestJSON-1893144618 None] Flow 'volume_create_manager' (34257e11-933b-426c-af0f-39fa877cd2ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:16:09 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-77dc2a76-1848-42a3-a476-bb30811708b7 tempest-VolumeQuotasAdminTestJSON-1893144618 None] Created volume successfully. Sep 03 11:16:10 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-98131092-1bcf-4003-a312-058d657e855a req-89ace31e-ec88-4dbf-9a6b-bd55aa4f6232 tempest-ServerActionsTestOtherA-914104622 None] Terminate volume connection completed successfully. Sep 03 11:16:10 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-98131092-1bcf-4003-a312-058d657e855a req-89ace31e-ec88-4dbf-9a6b-bd55aa4f6232 tempest-ServerActionsTestOtherA-914104622 None] Deleting attachment 26cadcb9-be0c-4b23-9774-6efa5aeae6d3. {{(pid=87038) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:16:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3f0c372b-3794-4685-96e4-3acbbdc0845a tempest-VolumeQuotasAdminTestJSON-1893144618 None] Acquiring lock "cinder-20816592-15ab-4669-bdb6-a090eda4a2fb-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:16:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3f0c372b-3794-4685-96e4-3acbbdc0845a tempest-VolumeQuotasAdminTestJSON-1893144618 None] Lock "cinder-20816592-15ab-4669-bdb6-a090eda4a2fb-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:16:11 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3f0c372b-3794-4685-96e4-3acbbdc0845a tempest-VolumeQuotasAdminTestJSON-1893144618 None] Acquiring lock "cinder-quobyte-20816592-15ab-4669-bdb6-a090eda4a2fb" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:16:11 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3f0c372b-3794-4685-96e4-3acbbdc0845a tempest-VolumeQuotasAdminTestJSON-1893144618 None] Lock "cinder-quobyte-20816592-15ab-4669-bdb6-a090eda4a2fb" acquired by "delete_volume" :: waited 0.021s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:16:11 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[b315c645-fb3c-4b3e-aa82-c753a14e1750]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:16:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3f0c372b-3794-4685-96e4-3acbbdc0845a tempest-VolumeQuotasAdminTestJSON-1893144618 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-20816592-15ab-4669-bdb6-a090eda4a2fb {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:11 devstack sudo[91886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-20816592-15ab-4669-bdb6-a090eda4a2fb Sep 03 11:16:11 devstack sudo[91886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:11 devstack sudo[91886]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3f0c372b-3794-4685-96e4-3acbbdc0845a tempest-VolumeQuotasAdminTestJSON-1893144618 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-20816592-15ab-4669-bdb6-a090eda4a2fb" returned: 0 in 0.614s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3f0c372b-3794-4685-96e4-3acbbdc0845a tempest-VolumeQuotasAdminTestJSON-1893144618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-20816592-15ab-4669-bdb6-a090eda4a2fb {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:11 devstack sudo[91906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-20816592-15ab-4669-bdb6-a090eda4a2fb Sep 03 11:16:11 devstack sudo[91906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:12 devstack sudo[91906]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3f0c372b-3794-4685-96e4-3acbbdc0845a tempest-VolumeQuotasAdminTestJSON-1893144618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-20816592-15ab-4669-bdb6-a090eda4a2fb" returned: 0 in 0.504s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:12 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3f0c372b-3794-4685-96e4-3acbbdc0845a tempest-VolumeQuotasAdminTestJSON-1893144618 None] Lock "cinder-quobyte-20816592-15ab-4669-bdb6-a090eda4a2fb" released by "delete_volume" :: held 1.183s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:16:12 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-3f0c372b-3794-4685-96e4-3acbbdc0845a tempest-VolumeQuotasAdminTestJSON-1893144618 None] Created reservations ['c2ce9c45-047a-4aaf-8018-92a008605874', '153ad543-856f-4e10-9637-80d7d06b4b2c', '03345ae9-fcf2-4c3e-aeec-c4277895d2de', '8299839e-7750-4778-9940-6146b49b4941'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:16:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3f0c372b-3794-4685-96e4-3acbbdc0845a tempest-VolumeQuotasAdminTestJSON-1893144618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:16:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3f0c372b-3794-4685-96e4-3acbbdc0845a tempest-VolumeQuotasAdminTestJSON-1893144618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:16:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-3f0c372b-3794-4685-96e4-3acbbdc0845a tempest-VolumeQuotasAdminTestJSON-1893144618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:16:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-3f0c372b-3794-4685-96e4-3acbbdc0845a tempest-VolumeQuotasAdminTestJSON-1893144618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:16:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3f0c372b-3794-4685-96e4-3acbbdc0845a tempest-VolumeQuotasAdminTestJSON-1893144618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:16:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3f0c372b-3794-4685-96e4-3acbbdc0845a tempest-VolumeQuotasAdminTestJSON-1893144618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:12 devstack sudo[91949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:16:12 devstack sudo[91949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:13 devstack sudo[91949]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3f0c372b-3794-4685-96e4-3acbbdc0845a tempest-VolumeQuotasAdminTestJSON-1893144618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.743s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:13 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-3f0c372b-3794-4685-96e4-3acbbdc0845a tempest-VolumeQuotasAdminTestJSON-1893144618 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:16:13 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-3f0c372b-3794-4685-96e4-3acbbdc0845a tempest-VolumeQuotasAdminTestJSON-1893144618 None] Deleted volume successfully. Sep 03 11:16:13 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3f0c372b-3794-4685-96e4-3acbbdc0845a tempest-VolumeQuotasAdminTestJSON-1893144618 None] Lock "cinder-20816592-15ab-4669-bdb6-a090eda4a2fb-delete_volume" released by "delete_volume" :: held 2.334s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:16:14 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5fc019e-aea4-4874-8cac-29b63f74f6ff tempest-VolumeQuotasAdminTestJSON-1893144618 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:16:14 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a5fc019e-aea4-4874-8cac-29b63f74f6ff tempest-VolumeQuotasAdminTestJSON-1893144618 None] Flow 'volume_create_manager' (954f7159-7fc9-43fb-96b5-aa534ceb6992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:16:14 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a5fc019e-aea4-4874-8cac-29b63f74f6ff tempest-VolumeQuotasAdminTestJSON-1893144618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83dcf938-4d28-4510-b198-bb8a3586042e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:16:14 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a5fc019e-aea4-4874-8cac-29b63f74f6ff tempest-VolumeQuotasAdminTestJSON-1893144618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83dcf938-4d28-4510-b198-bb8a3586042e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1573998383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e884f1c-5668-4884-b49e-a7fba5caa0ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f0590c8ce34adf81b657402eaf4ec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:16:14Z,use_quota=True,user_id='68fb7f587887403ea95b8936721b36e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:16:14 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a5fc019e-aea4-4874-8cac-29b63f74f6ff tempest-VolumeQuotasAdminTestJSON-1893144618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ff2999-4e6c-4190-a924-2dd2d7fc91b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:16:14 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a5fc019e-aea4-4874-8cac-29b63f74f6ff tempest-VolumeQuotasAdminTestJSON-1893144618 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68ff2999-4e6c-4190-a924-2dd2d7fc91b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:16:14 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a5fc019e-aea4-4874-8cac-29b63f74f6ff tempest-VolumeQuotasAdminTestJSON-1893144618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (012278ad-d323-4667-9aa7-db60ee5f4822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:16:14 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a5fc019e-aea4-4874-8cac-29b63f74f6ff tempest-VolumeQuotasAdminTestJSON-1893144618 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (012278ad-d323-4667-9aa7-db60ee5f4822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e884f1c-5668-4884-b49e-a7fba5caa0ad', 'volume_name': 'volume-0e884f1c-5668-4884-b49e-a7fba5caa0ad', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:16:14 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a5fc019e-aea4-4874-8cac-29b63f74f6ff tempest-VolumeQuotasAdminTestJSON-1893144618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf53b4e-77f9-4bd3-8f92-7ec30c558a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:16:14 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a5fc019e-aea4-4874-8cac-29b63f74f6ff tempest-VolumeQuotasAdminTestJSON-1893144618 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf53b4e-77f9-4bd3-8f92-7ec30c558a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:16:14 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a5fc019e-aea4-4874-8cac-29b63f74f6ff tempest-VolumeQuotasAdminTestJSON-1893144618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (450e4d36-d025-4385-83ac-bc4b7dcde112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:16:14 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-a5fc019e-aea4-4874-8cac-29b63f74f6ff tempest-VolumeQuotasAdminTestJSON-1893144618 None] Volume 0e884f1c-5668-4884-b49e-a7fba5caa0ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e884f1c-5668-4884-b49e-a7fba5caa0ad', 'volume_size': 1} Sep 03 11:16:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a5fc019e-aea4-4874-8cac-29b63f74f6ff tempest-VolumeQuotasAdminTestJSON-1893144618 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:16:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a5fc019e-aea4-4874-8cac-29b63f74f6ff tempest-VolumeQuotasAdminTestJSON-1893144618 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:16:14 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a5fc019e-aea4-4874-8cac-29b63f74f6ff tempest-VolumeQuotasAdminTestJSON-1893144618 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:16:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1573998383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e884f1c-5668-4884-b49e-a7fba5caa0ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a6f0590c8ce34adf81b657402eaf4ec8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:16:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:16:14Z,use_quota=True,user_id='68fb7f587887403ea95b8936721b36e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:16:14 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-a5fc019e-aea4-4874-8cac-29b63f74f6ff tempest-VolumeQuotasAdminTestJSON-1893144618 None] Creating volume 0e884f1c-5668-4884-b49e-a7fba5caa0ad {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:16:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a5fc019e-aea4-4874-8cac-29b63f74f6ff tempest-VolumeQuotasAdminTestJSON-1893144618 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:16:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a5fc019e-aea4-4874-8cac-29b63f74f6ff tempest-VolumeQuotasAdminTestJSON-1893144618 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:16:14 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a5fc019e-aea4-4874-8cac-29b63f74f6ff tempest-VolumeQuotasAdminTestJSON-1893144618 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:16:14 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a5fc019e-aea4-4874-8cac-29b63f74f6ff tempest-VolumeQuotasAdminTestJSON-1893144618 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:16:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a5fc019e-aea4-4874-8cac-29b63f74f6ff tempest-VolumeQuotasAdminTestJSON-1893144618 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:16:14 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a5fc019e-aea4-4874-8cac-29b63f74f6ff tempest-VolumeQuotasAdminTestJSON-1893144618 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:16:14 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-a5fc019e-aea4-4874-8cac-29b63f74f6ff tempest-VolumeQuotasAdminTestJSON-1893144618 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:16:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a5fc019e-aea4-4874-8cac-29b63f74f6ff tempest-VolumeQuotasAdminTestJSON-1893144618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0e884f1c-5668-4884-b49e-a7fba5caa0ad 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:14 devstack sudo[91996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0e884f1c-5668-4884-b49e-a7fba5caa0ad 1073741824 Sep 03 11:16:14 devstack sudo[91996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-98131092-1bcf-4003-a312-058d657e855a req-10c76077-0ac7-4269-b52d-a86e1c092e2e tempest-ServerActionsTestOtherA-914104622 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:16:14 devstack sudo[91996]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a5fc019e-aea4-4874-8cac-29b63f74f6ff tempest-VolumeQuotasAdminTestJSON-1893144618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0e884f1c-5668-4884-b49e-a7fba5caa0ad 1073741824" returned: 0 in 0.506s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a5fc019e-aea4-4874-8cac-29b63f74f6ff tempest-VolumeQuotasAdminTestJSON-1893144618 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0e884f1c-5668-4884-b49e-a7fba5caa0ad {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:15 devstack sudo[92003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0e884f1c-5668-4884-b49e-a7fba5caa0ad Sep 03 11:16:15 devstack sudo[92003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:15 devstack sudo[92003]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a5fc019e-aea4-4874-8cac-29b63f74f6ff tempest-VolumeQuotasAdminTestJSON-1893144618 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0e884f1c-5668-4884-b49e-a7fba5caa0ad" returned: 0 in 0.242s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:15 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a5fc019e-aea4-4874-8cac-29b63f74f6ff tempest-VolumeQuotasAdminTestJSON-1893144618 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:16:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a5fc019e-aea4-4874-8cac-29b63f74f6ff tempest-VolumeQuotasAdminTestJSON-1893144618 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:16:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-98131092-1bcf-4003-a312-058d657e855a req-10c76077-0ac7-4269-b52d-a86e1c092e2e tempest-ServerActionsTestOtherA-914104622 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.566s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:16:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a5fc019e-aea4-4874-8cac-29b63f74f6ff tempest-VolumeQuotasAdminTestJSON-1893144618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (450e4d36-d025-4385-83ac-bc4b7dcde112) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e884f1c-5668-4884-b49e-a7fba5caa0ad', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:16:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a5fc019e-aea4-4874-8cac-29b63f74f6ff tempest-VolumeQuotasAdminTestJSON-1893144618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75f0311f-c92c-44c8-9e15-4de0e3adf231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:16:15 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-a5fc019e-aea4-4874-8cac-29b63f74f6ff tempest-VolumeQuotasAdminTestJSON-1893144618 None] Volume volume-0e884f1c-5668-4884-b49e-a7fba5caa0ad (0e884f1c-5668-4884-b49e-a7fba5caa0ad): created successfully Sep 03 11:16:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a5fc019e-aea4-4874-8cac-29b63f74f6ff tempest-VolumeQuotasAdminTestJSON-1893144618 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75f0311f-c92c-44c8-9e15-4de0e3adf231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:16:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a5fc019e-aea4-4874-8cac-29b63f74f6ff tempest-VolumeQuotasAdminTestJSON-1893144618 None] Flow 'volume_create_manager' (954f7159-7fc9-43fb-96b5-aa534ceb6992) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:16:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-98131092-1bcf-4003-a312-058d657e855a req-10c76077-0ac7-4269-b52d-a86e1c092e2e tempest-ServerActionsTestOtherA-914104622 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.128s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:16:15 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-a5fc019e-aea4-4874-8cac-29b63f74f6ff tempest-VolumeQuotasAdminTestJSON-1893144618 None] Created volume successfully. Sep 03 11:16:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-98131092-1bcf-4003-a312-058d657e855a req-10c76077-0ac7-4269-b52d-a86e1c092e2e tempest-ServerActionsTestOtherA-914104622 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912', 'name': 'volume-5222a549-c61d-41a2-a4fb-7e81ec07333d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '847df2e9-7056-47d1-9cc3-6db8db18792a', 'enforce_multipath': True} {{(pid=87038) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:16:15 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-98131092-1bcf-4003-a312-058d657e855a req-10c76077-0ac7-4269-b52d-a86e1c092e2e tempest-ServerActionsTestOtherA-914104622 None] attachment_update completed successfully. Sep 03 11:16:17 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-a1907ae2-61c2-4845-b846-2298f47bcc3b tempest-VolumeQuotasAdminTestJSON-1858286103 None] Transfer volume completed successfully. Sep 03 11:16:17 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:16:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:16:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:16:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:16:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:16:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:16:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:17 devstack sudo[92428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:16:17 devstack sudo[92428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:18 devstack sudo[92428]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:18 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3b7c5338-f70e-4a0b-bab7-246b72d6c6a7 tempest-VolumeQuotasAdminTestJSON-1394292437 None] Acquiring lock "cinder-0e884f1c-5668-4884-b49e-a7fba5caa0ad-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:16:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.513s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:18 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:16:18 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:16:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread count: 28 {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:16:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread info: [<_MainThread(MainThread, started 139554943000704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:16:18 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3b7c5338-f70e-4a0b-bab7-246b72d6c6a7 tempest-VolumeQuotasAdminTestJSON-1394292437 None] Lock "cinder-0e884f1c-5668-4884-b49e-a7fba5caa0ad-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:16:18 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3b7c5338-f70e-4a0b-bab7-246b72d6c6a7 tempest-VolumeQuotasAdminTestJSON-1394292437 None] Acquiring lock "cinder-quobyte-0e884f1c-5668-4884-b49e-a7fba5caa0ad" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:16:18 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3b7c5338-f70e-4a0b-bab7-246b72d6c6a7 tempest-VolumeQuotasAdminTestJSON-1394292437 None] Lock "cinder-quobyte-0e884f1c-5668-4884-b49e-a7fba5caa0ad" acquired by "delete_volume" :: waited 0.041s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:16:18 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[6109df94-1184-4444-be5c-06cf0aacaa32]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:16:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3b7c5338-f70e-4a0b-bab7-246b72d6c6a7 tempest-VolumeQuotasAdminTestJSON-1394292437 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0e884f1c-5668-4884-b49e-a7fba5caa0ad {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:19 devstack sudo[92434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0e884f1c-5668-4884-b49e-a7fba5caa0ad Sep 03 11:16:19 devstack sudo[92434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:19 devstack sudo[92434]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3b7c5338-f70e-4a0b-bab7-246b72d6c6a7 tempest-VolumeQuotasAdminTestJSON-1394292437 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0e884f1c-5668-4884-b49e-a7fba5caa0ad" returned: 0 in 0.968s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3b7c5338-f70e-4a0b-bab7-246b72d6c6a7 tempest-VolumeQuotasAdminTestJSON-1394292437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0e884f1c-5668-4884-b49e-a7fba5caa0ad {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:19 devstack sudo[92439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0e884f1c-5668-4884-b49e-a7fba5caa0ad Sep 03 11:16:19 devstack sudo[92439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:20 devstack sudo[92439]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3b7c5338-f70e-4a0b-bab7-246b72d6c6a7 tempest-VolumeQuotasAdminTestJSON-1394292437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0e884f1c-5668-4884-b49e-a7fba5caa0ad" returned: 0 in 0.470s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:20 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3b7c5338-f70e-4a0b-bab7-246b72d6c6a7 tempest-VolumeQuotasAdminTestJSON-1394292437 None] Lock "cinder-quobyte-0e884f1c-5668-4884-b49e-a7fba5caa0ad" released by "delete_volume" :: held 1.534s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:16:20 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-3b7c5338-f70e-4a0b-bab7-246b72d6c6a7 tempest-VolumeQuotasAdminTestJSON-1394292437 None] Created reservations ['7d234036-efc9-48d5-8068-813df3dce66b', '2bdd06fd-2f1b-487e-a469-4cfd363fab03', '2839e4ad-3f6a-4ffd-b58b-36df0a96dab8', 'dbc001b2-5d03-459c-85ee-d70b75e7a498'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:16:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3b7c5338-f70e-4a0b-bab7-246b72d6c6a7 tempest-VolumeQuotasAdminTestJSON-1394292437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:16:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3b7c5338-f70e-4a0b-bab7-246b72d6c6a7 tempest-VolumeQuotasAdminTestJSON-1394292437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:16:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-3b7c5338-f70e-4a0b-bab7-246b72d6c6a7 tempest-VolumeQuotasAdminTestJSON-1394292437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:16:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-3b7c5338-f70e-4a0b-bab7-246b72d6c6a7 tempest-VolumeQuotasAdminTestJSON-1394292437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:16:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3b7c5338-f70e-4a0b-bab7-246b72d6c6a7 tempest-VolumeQuotasAdminTestJSON-1394292437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:16:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3b7c5338-f70e-4a0b-bab7-246b72d6c6a7 tempest-VolumeQuotasAdminTestJSON-1394292437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:20 devstack sudo[92443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:16:20 devstack sudo[92443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:20 devstack sudo[92443]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3b7c5338-f70e-4a0b-bab7-246b72d6c6a7 tempest-VolumeQuotasAdminTestJSON-1394292437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.470s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:20 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-3b7c5338-f70e-4a0b-bab7-246b72d6c6a7 tempest-VolumeQuotasAdminTestJSON-1394292437 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:16:20 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-3b7c5338-f70e-4a0b-bab7-246b72d6c6a7 tempest-VolumeQuotasAdminTestJSON-1394292437 None] Deleted volume successfully. Sep 03 11:16:20 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3b7c5338-f70e-4a0b-bab7-246b72d6c6a7 tempest-VolumeQuotasAdminTestJSON-1394292437 None] Lock "cinder-0e884f1c-5668-4884-b49e-a7fba5caa0ad-delete_volume" released by "delete_volume" :: held 2.461s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:16:25 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-76d5cf2a-3311-4cc8-9acb-af64c14e8367 tempest-AttachVolumeShelveTestJSON-1102155481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:16:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-76d5cf2a-3311-4cc8-9acb-af64c14e8367 tempest-AttachVolumeShelveTestJSON-1102155481 None] Flow 'volume_create_manager' (55548e5a-cc7b-4af5-ba59-18e285eb6d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:16:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-76d5cf2a-3311-4cc8-9acb-af64c14e8367 tempest-AttachVolumeShelveTestJSON-1102155481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6ecc108-7669-40ef-bd2e-39e988394ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:16:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-76d5cf2a-3311-4cc8-9acb-af64c14e8367 tempest-AttachVolumeShelveTestJSON-1102155481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6ecc108-7669-40ef-bd2e-39e988394ee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1189137329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41764751-5ee1-4894-ab75-d3902623add7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f6b6d26cf44437af2583e922cdedfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:16:25Z,use_quota=True,user_id='50ca6e5a72924ff88ddceda00719bcc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:16:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-76d5cf2a-3311-4cc8-9acb-af64c14e8367 tempest-AttachVolumeShelveTestJSON-1102155481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b3f783-79f2-426c-aa7d-a3e3e983e11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:16:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-76d5cf2a-3311-4cc8-9acb-af64c14e8367 tempest-AttachVolumeShelveTestJSON-1102155481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8b3f783-79f2-426c-aa7d-a3e3e983e11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:16:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-76d5cf2a-3311-4cc8-9acb-af64c14e8367 tempest-AttachVolumeShelveTestJSON-1102155481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da69d0de-b5e1-49d1-a6b5-5c5fa0f9e8e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:16:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-76d5cf2a-3311-4cc8-9acb-af64c14e8367 tempest-AttachVolumeShelveTestJSON-1102155481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da69d0de-b5e1-49d1-a6b5-5c5fa0f9e8e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41764751-5ee1-4894-ab75-d3902623add7', 'volume_name': 'volume-41764751-5ee1-4894-ab75-d3902623add7', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:16:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-76d5cf2a-3311-4cc8-9acb-af64c14e8367 tempest-AttachVolumeShelveTestJSON-1102155481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a759d7f-78da-4936-9e5c-946e3d1e3eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:16:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-76d5cf2a-3311-4cc8-9acb-af64c14e8367 tempest-AttachVolumeShelveTestJSON-1102155481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a759d7f-78da-4936-9e5c-946e3d1e3eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:16:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-76d5cf2a-3311-4cc8-9acb-af64c14e8367 tempest-AttachVolumeShelveTestJSON-1102155481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53f73bb1-f847-406e-ba0a-7631d4b2d5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:16:25 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-76d5cf2a-3311-4cc8-9acb-af64c14e8367 tempest-AttachVolumeShelveTestJSON-1102155481 None] Volume 41764751-5ee1-4894-ab75-d3902623add7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41764751-5ee1-4894-ab75-d3902623add7', 'volume_size': 1} Sep 03 11:16:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-76d5cf2a-3311-4cc8-9acb-af64c14e8367 tempest-AttachVolumeShelveTestJSON-1102155481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:16:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-76d5cf2a-3311-4cc8-9acb-af64c14e8367 tempest-AttachVolumeShelveTestJSON-1102155481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:16:25 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-76d5cf2a-3311-4cc8-9acb-af64c14e8367 tempest-AttachVolumeShelveTestJSON-1102155481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:16:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1189137329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41764751-5ee1-4894-ab75-d3902623add7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f6b6d26cf44437af2583e922cdedfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:16:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:16:25Z,use_quota=True,user_id='50ca6e5a72924ff88ddceda00719bcc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:16:25 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-76d5cf2a-3311-4cc8-9acb-af64c14e8367 tempest-AttachVolumeShelveTestJSON-1102155481 None] Creating volume 41764751-5ee1-4894-ab75-d3902623add7 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:16:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-76d5cf2a-3311-4cc8-9acb-af64c14e8367 tempest-AttachVolumeShelveTestJSON-1102155481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:16:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-76d5cf2a-3311-4cc8-9acb-af64c14e8367 tempest-AttachVolumeShelveTestJSON-1102155481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:16:25 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-76d5cf2a-3311-4cc8-9acb-af64c14e8367 tempest-AttachVolumeShelveTestJSON-1102155481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:16:25 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-76d5cf2a-3311-4cc8-9acb-af64c14e8367 tempest-AttachVolumeShelveTestJSON-1102155481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:16:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-76d5cf2a-3311-4cc8-9acb-af64c14e8367 tempest-AttachVolumeShelveTestJSON-1102155481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:16:25 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-76d5cf2a-3311-4cc8-9acb-af64c14e8367 tempest-AttachVolumeShelveTestJSON-1102155481 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:16:25 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-76d5cf2a-3311-4cc8-9acb-af64c14e8367 tempest-AttachVolumeShelveTestJSON-1102155481 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:16:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-76d5cf2a-3311-4cc8-9acb-af64c14e8367 tempest-AttachVolumeShelveTestJSON-1102155481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-41764751-5ee1-4894-ab75-d3902623add7 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:25 devstack sudo[92450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-41764751-5ee1-4894-ab75-d3902623add7 1073741824 Sep 03 11:16:25 devstack sudo[92450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:26 devstack sudo[92450]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-76d5cf2a-3311-4cc8-9acb-af64c14e8367 tempest-AttachVolumeShelveTestJSON-1102155481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-41764751-5ee1-4894-ab75-d3902623add7 1073741824" returned: 0 in 0.675s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-76d5cf2a-3311-4cc8-9acb-af64c14e8367 tempest-AttachVolumeShelveTestJSON-1102155481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-41764751-5ee1-4894-ab75-d3902623add7 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:26 devstack sudo[92456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-41764751-5ee1-4894-ab75-d3902623add7 Sep 03 11:16:26 devstack sudo[92456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:26 devstack sudo[92456]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-76d5cf2a-3311-4cc8-9acb-af64c14e8367 tempest-AttachVolumeShelveTestJSON-1102155481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-41764751-5ee1-4894-ab75-d3902623add7" returned: 0 in 0.373s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:26 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-76d5cf2a-3311-4cc8-9acb-af64c14e8367 tempest-AttachVolumeShelveTestJSON-1102155481 None] <== create_volume: return (1154ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:16:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-76d5cf2a-3311-4cc8-9acb-af64c14e8367 tempest-AttachVolumeShelveTestJSON-1102155481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.156s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:16:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-76d5cf2a-3311-4cc8-9acb-af64c14e8367 tempest-AttachVolumeShelveTestJSON-1102155481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53f73bb1-f847-406e-ba0a-7631d4b2d5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41764751-5ee1-4894-ab75-d3902623add7', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:16:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-76d5cf2a-3311-4cc8-9acb-af64c14e8367 tempest-AttachVolumeShelveTestJSON-1102155481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03492077-5f47-42e1-84a6-cf7dfbaa8822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:16:26 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-76d5cf2a-3311-4cc8-9acb-af64c14e8367 tempest-AttachVolumeShelveTestJSON-1102155481 None] Volume volume-41764751-5ee1-4894-ab75-d3902623add7 (41764751-5ee1-4894-ab75-d3902623add7): created successfully Sep 03 11:16:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-76d5cf2a-3311-4cc8-9acb-af64c14e8367 tempest-AttachVolumeShelveTestJSON-1102155481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03492077-5f47-42e1-84a6-cf7dfbaa8822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:16:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-76d5cf2a-3311-4cc8-9acb-af64c14e8367 tempest-AttachVolumeShelveTestJSON-1102155481 None] Flow 'volume_create_manager' (55548e5a-cc7b-4af5-ba59-18e285eb6d4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:16:26 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-76d5cf2a-3311-4cc8-9acb-af64c14e8367 tempest-AttachVolumeShelveTestJSON-1102155481 None] Created volume successfully. Sep 03 11:16:31 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-79490236-56e6-44db-afee-1c54606629e9 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:16:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-79490236-56e6-44db-afee-1c54606629e9 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Flow 'volume_create_manager' (705ba85b-0b21-4eca-9b87-1d518981f824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:16:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-79490236-56e6-44db-afee-1c54606629e9 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b864fff4-4cd4-4ae7-adac-0b5332ea0346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:16:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-79490236-56e6-44db-afee-1c54606629e9 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b864fff4-4cd4-4ae7-adac-0b5332ea0346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-33883531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04e3fe46-a85b-46e6-a576-d4f875828e8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f388b69d658a47eeae8e0c21375cce2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:16:31Z,use_quota=True,user_id='d74ddac29cc9481d8955884f180d2592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(162f3100-8c40-46ba-9d60-f64ae3b9076e),volume_type_id=162f3100-8c40-46ba-9d60-f64ae3b9076e)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:16:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-79490236-56e6-44db-afee-1c54606629e9 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30216efb-a405-4962-98ad-2cc26dcecd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:16:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-79490236-56e6-44db-afee-1c54606629e9 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30216efb-a405-4962-98ad-2cc26dcecd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:16:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-79490236-56e6-44db-afee-1c54606629e9 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e195bcec-5e05-423f-a63f-1d2fc5af297c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:16:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-79490236-56e6-44db-afee-1c54606629e9 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e195bcec-5e05-423f-a63f-1d2fc5af297c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04e3fe46-a85b-46e6-a576-d4f875828e8b', 'volume_name': 'volume-04e3fe46-a85b-46e6-a576-d4f875828e8b', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:16:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-79490236-56e6-44db-afee-1c54606629e9 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4532a1b-9222-4b91-af4c-48ead944be08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:16:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-79490236-56e6-44db-afee-1c54606629e9 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4532a1b-9222-4b91-af4c-48ead944be08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:16:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-79490236-56e6-44db-afee-1c54606629e9 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6cab768-75b4-4b3e-927a-25fa661d3dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:16:31 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-79490236-56e6-44db-afee-1c54606629e9 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Volume 04e3fe46-a85b-46e6-a576-d4f875828e8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04e3fe46-a85b-46e6-a576-d4f875828e8b', 'volume_size': 1} Sep 03 11:16:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-79490236-56e6-44db-afee-1c54606629e9 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:16:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-79490236-56e6-44db-afee-1c54606629e9 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:16:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-79490236-56e6-44db-afee-1c54606629e9 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:16:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-33883531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04e3fe46-a85b-46e6-a576-d4f875828e8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f388b69d658a47eeae8e0c21375cce2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:16:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:16:31Z,use_quota=True,user_id='d74ddac29cc9481d8955884f180d2592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(162f3100-8c40-46ba-9d60-f64ae3b9076e),volume_type_id=162f3100-8c40-46ba-9d60-f64ae3b9076e)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:16:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-79490236-56e6-44db-afee-1c54606629e9 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Creating volume 04e3fe46-a85b-46e6-a576-d4f875828e8b {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:16:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-79490236-56e6-44db-afee-1c54606629e9 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:16:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-79490236-56e6-44db-afee-1c54606629e9 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:16:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-79490236-56e6-44db-afee-1c54606629e9 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:16:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-79490236-56e6-44db-afee-1c54606629e9 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:16:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-79490236-56e6-44db-afee-1c54606629e9 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:16:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-79490236-56e6-44db-afee-1c54606629e9 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:16:31 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-79490236-56e6-44db-afee-1c54606629e9 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:16:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-79490236-56e6-44db-afee-1c54606629e9 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-04e3fe46-a85b-46e6-a576-d4f875828e8b 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:31 devstack sudo[92502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-04e3fe46-a85b-46e6-a576-d4f875828e8b 1073741824 Sep 03 11:16:31 devstack sudo[92502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:31 devstack sudo[92502]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-79490236-56e6-44db-afee-1c54606629e9 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-04e3fe46-a85b-46e6-a576-d4f875828e8b 1073741824" returned: 0 in 0.512s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-79490236-56e6-44db-afee-1c54606629e9 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-04e3fe46-a85b-46e6-a576-d4f875828e8b {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:32 devstack sudo[92508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-04e3fe46-a85b-46e6-a576-d4f875828e8b Sep 03 11:16:32 devstack sudo[92508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:32 devstack sudo[92508]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-79490236-56e6-44db-afee-1c54606629e9 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-04e3fe46-a85b-46e6-a576-d4f875828e8b" returned: 0 in 0.300s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-79490236-56e6-44db-afee-1c54606629e9 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:16:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-79490236-56e6-44db-afee-1c54606629e9 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.891s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:16:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-79490236-56e6-44db-afee-1c54606629e9 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6cab768-75b4-4b3e-927a-25fa661d3dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04e3fe46-a85b-46e6-a576-d4f875828e8b', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:16:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-79490236-56e6-44db-afee-1c54606629e9 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0a6f4f-3aaa-4328-97be-5cb1a320a730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:16:32 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-79490236-56e6-44db-afee-1c54606629e9 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Volume volume-04e3fe46-a85b-46e6-a576-d4f875828e8b (04e3fe46-a85b-46e6-a576-d4f875828e8b): created successfully Sep 03 11:16:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-79490236-56e6-44db-afee-1c54606629e9 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0a6f4f-3aaa-4328-97be-5cb1a320a730) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:16:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-79490236-56e6-44db-afee-1c54606629e9 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Flow 'volume_create_manager' (705ba85b-0b21-4eca-9b87-1d518981f824) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:16:32 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-79490236-56e6-44db-afee-1c54606629e9 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Created volume successfully. Sep 03 11:16:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-eb1e9d10-dc5f-4ea5-a7a5-47ed25a7f955 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:16:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-eb1e9d10-dc5f-4ea5-a7a5-47ed25a7f955 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:16:33 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-eb1e9d10-dc5f-4ea5-a7a5-47ed25a7f955 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:16:33 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-eb1e9d10-dc5f-4ea5-a7a5-47ed25a7f955 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:16:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-eb1e9d10-dc5f-4ea5-a7a5-47ed25a7f955 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:16:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-eb1e9d10-dc5f-4ea5-a7a5-47ed25a7f955 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:33 devstack sudo[92514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:16:33 devstack sudo[92514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:34 devstack sudo[92514]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-eb1e9d10-dc5f-4ea5-a7a5-47ed25a7f955 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.277s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:34 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-eb1e9d10-dc5f-4ea5-a7a5-47ed25a7f955 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:16:34 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-eb1e9d10-dc5f-4ea5-a7a5-47ed25a7f955 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Retype volume completed successfully. Sep 03 11:16:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-61c2edfa-40f9-4429-8e3b-a13762447596 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Acquiring lock "cinder-04e3fe46-a85b-46e6-a576-d4f875828e8b-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:16:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-61c2edfa-40f9-4429-8e3b-a13762447596 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Lock "cinder-04e3fe46-a85b-46e6-a576-d4f875828e8b-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:16:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-61c2edfa-40f9-4429-8e3b-a13762447596 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Acquiring lock "cinder-quobyte-04e3fe46-a85b-46e6-a576-d4f875828e8b" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:16:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-61c2edfa-40f9-4429-8e3b-a13762447596 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Lock "cinder-quobyte-04e3fe46-a85b-46e6-a576-d4f875828e8b" acquired by "delete_volume" :: waited 0.017s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:16:35 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[5900122f-3526-4cf2-a75c-cb97dceff40b]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:16:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-61c2edfa-40f9-4429-8e3b-a13762447596 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-04e3fe46-a85b-46e6-a576-d4f875828e8b {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:35 devstack sudo[92540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-04e3fe46-a85b-46e6-a576-d4f875828e8b Sep 03 11:16:35 devstack sudo[92540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:35 devstack sudo[92540]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-61c2edfa-40f9-4429-8e3b-a13762447596 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-04e3fe46-a85b-46e6-a576-d4f875828e8b" returned: 0 in 0.535s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-61c2edfa-40f9-4429-8e3b-a13762447596 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-04e3fe46-a85b-46e6-a576-d4f875828e8b {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:36 devstack sudo[92573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-04e3fe46-a85b-46e6-a576-d4f875828e8b Sep 03 11:16:36 devstack sudo[92573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:36 devstack sudo[92573]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-61c2edfa-40f9-4429-8e3b-a13762447596 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-04e3fe46-a85b-46e6-a576-d4f875828e8b" returned: 0 in 0.405s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-61c2edfa-40f9-4429-8e3b-a13762447596 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Lock "cinder-quobyte-04e3fe46-a85b-46e6-a576-d4f875828e8b" released by "delete_volume" :: held 1.002s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:16:36 devstack cinder-volume[87038]: WARNING cinder.quota [None req-61c2edfa-40f9-4429-8e3b-a13762447596 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:16:36 devstack cinder-volume[87038]: WARNING cinder.quota [None req-61c2edfa-40f9-4429-8e3b-a13762447596 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:16:36 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-61c2edfa-40f9-4429-8e3b-a13762447596 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Created reservations ['68b6af21-b4fd-4e62-acba-ca9309ebdb30', 'ab8e0943-0bcb-4a47-baef-3d2e85e71c4f', '06f05c68-749b-4d2f-b013-5defba4e3c0c', '3905183a-009a-46f5-b59a-46e0fb1d0b1e'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:16:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-61c2edfa-40f9-4429-8e3b-a13762447596 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:16:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-61c2edfa-40f9-4429-8e3b-a13762447596 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:16:36 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-61c2edfa-40f9-4429-8e3b-a13762447596 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:16:36 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-61c2edfa-40f9-4429-8e3b-a13762447596 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:16:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-61c2edfa-40f9-4429-8e3b-a13762447596 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:16:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-61c2edfa-40f9-4429-8e3b-a13762447596 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:36 devstack sudo[92576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:16:36 devstack sudo[92576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:36 devstack sudo[92576]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-61c2edfa-40f9-4429-8e3b-a13762447596 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.283s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:36 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-61c2edfa-40f9-4429-8e3b-a13762447596 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:16:36 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-61c2edfa-40f9-4429-8e3b-a13762447596 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Deleted volume successfully. Sep 03 11:16:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-61c2edfa-40f9-4429-8e3b-a13762447596 tempest-VolumeRetypeWithoutMigrationTest-1619099401 None] Lock "cinder-04e3fe46-a85b-46e6-a576-d4f875828e8b-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:16:37 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-e3625927-8907-4c20-8b42-47dfc0c90b41 req-ff9f318c-5516-4051-8d19-f4b08ef42f19 tempest-AttachVolumeShelveTestJSON-1102155481 None] No connector for attachment 5f9f2ba9-5e75-4c5b-acb9-a9a30de88502; skipping storage backend terminate_connection call. {{(pid=87038) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 03 11:16:37 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-e3625927-8907-4c20-8b42-47dfc0c90b41 req-ff9f318c-5516-4051-8d19-f4b08ef42f19 tempest-AttachVolumeShelveTestJSON-1102155481 None] Deleting attachment 5f9f2ba9-5e75-4c5b-acb9-a9a30de88502. {{(pid=87038) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:16:38 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-2617de6f-1e00-4b7f-b0fa-c6c87027ebe5 tempest-AttachVolumeTestJSON-470983266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:16:38 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2617de6f-1e00-4b7f-b0fa-c6c87027ebe5 tempest-AttachVolumeTestJSON-470983266 None] Flow 'volume_create_manager' (282e1459-aa9a-42fd-a66b-42bf3d3ca936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:16:38 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2617de6f-1e00-4b7f-b0fa-c6c87027ebe5 tempest-AttachVolumeTestJSON-470983266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af639db-76f4-42f8-b5e8-7fa01fc3bf06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:16:38 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2617de6f-1e00-4b7f-b0fa-c6c87027ebe5 tempest-AttachVolumeTestJSON-470983266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7af639db-76f4-42f8-b5e8-7fa01fc3bf06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1800399838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a1fe29f-2bfa-41e0-981b-e2c9f37ce95c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='640bae814fcc4d0093f0b97d498922d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:16:39Z,use_quota=True,user_id='904f07e50f244f6aa0e0658a81e4d444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:16:38 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2617de6f-1e00-4b7f-b0fa-c6c87027ebe5 tempest-AttachVolumeTestJSON-470983266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (826bdd93-77d2-4bcf-87b4-0727d1732308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:16:38 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2617de6f-1e00-4b7f-b0fa-c6c87027ebe5 tempest-AttachVolumeTestJSON-470983266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (826bdd93-77d2-4bcf-87b4-0727d1732308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:16:38 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2617de6f-1e00-4b7f-b0fa-c6c87027ebe5 tempest-AttachVolumeTestJSON-470983266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd051ba9-22dd-4fcb-b9a2-4c64a598c1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:16:38 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2617de6f-1e00-4b7f-b0fa-c6c87027ebe5 tempest-AttachVolumeTestJSON-470983266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd051ba9-22dd-4fcb-b9a2-4c64a598c1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a1fe29f-2bfa-41e0-981b-e2c9f37ce95c', 'volume_name': 'volume-7a1fe29f-2bfa-41e0-981b-e2c9f37ce95c', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:16:38 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2617de6f-1e00-4b7f-b0fa-c6c87027ebe5 tempest-AttachVolumeTestJSON-470983266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d298ec-af4d-4b21-b562-e835918c87d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:16:38 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2617de6f-1e00-4b7f-b0fa-c6c87027ebe5 tempest-AttachVolumeTestJSON-470983266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36d298ec-af4d-4b21-b562-e835918c87d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:16:38 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2617de6f-1e00-4b7f-b0fa-c6c87027ebe5 tempest-AttachVolumeTestJSON-470983266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f3604fd-f83a-4bc0-89c4-996343119f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:16:38 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-2617de6f-1e00-4b7f-b0fa-c6c87027ebe5 tempest-AttachVolumeTestJSON-470983266 None] Volume 7a1fe29f-2bfa-41e0-981b-e2c9f37ce95c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a1fe29f-2bfa-41e0-981b-e2c9f37ce95c', 'volume_size': 1} Sep 03 11:16:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2617de6f-1e00-4b7f-b0fa-c6c87027ebe5 tempest-AttachVolumeTestJSON-470983266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:16:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2617de6f-1e00-4b7f-b0fa-c6c87027ebe5 tempest-AttachVolumeTestJSON-470983266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:16:38 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2617de6f-1e00-4b7f-b0fa-c6c87027ebe5 tempest-AttachVolumeTestJSON-470983266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:16:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1800399838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a1fe29f-2bfa-41e0-981b-e2c9f37ce95c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='640bae814fcc4d0093f0b97d498922d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:16:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:16:39Z,use_quota=True,user_id='904f07e50f244f6aa0e0658a81e4d444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:16:38 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-2617de6f-1e00-4b7f-b0fa-c6c87027ebe5 tempest-AttachVolumeTestJSON-470983266 None] Creating volume 7a1fe29f-2bfa-41e0-981b-e2c9f37ce95c {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:16:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2617de6f-1e00-4b7f-b0fa-c6c87027ebe5 tempest-AttachVolumeTestJSON-470983266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:16:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2617de6f-1e00-4b7f-b0fa-c6c87027ebe5 tempest-AttachVolumeTestJSON-470983266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:16:38 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2617de6f-1e00-4b7f-b0fa-c6c87027ebe5 tempest-AttachVolumeTestJSON-470983266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:16:38 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2617de6f-1e00-4b7f-b0fa-c6c87027ebe5 tempest-AttachVolumeTestJSON-470983266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:16:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2617de6f-1e00-4b7f-b0fa-c6c87027ebe5 tempest-AttachVolumeTestJSON-470983266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:16:38 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2617de6f-1e00-4b7f-b0fa-c6c87027ebe5 tempest-AttachVolumeTestJSON-470983266 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:16:38 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-2617de6f-1e00-4b7f-b0fa-c6c87027ebe5 tempest-AttachVolumeTestJSON-470983266 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:16:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2617de6f-1e00-4b7f-b0fa-c6c87027ebe5 tempest-AttachVolumeTestJSON-470983266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7a1fe29f-2bfa-41e0-981b-e2c9f37ce95c 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:38 devstack sudo[92592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7a1fe29f-2bfa-41e0-981b-e2c9f37ce95c 1073741824 Sep 03 11:16:38 devstack sudo[92592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:39 devstack sudo[92592]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2617de6f-1e00-4b7f-b0fa-c6c87027ebe5 tempest-AttachVolumeTestJSON-470983266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7a1fe29f-2bfa-41e0-981b-e2c9f37ce95c 1073741824" returned: 0 in 0.545s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2617de6f-1e00-4b7f-b0fa-c6c87027ebe5 tempest-AttachVolumeTestJSON-470983266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7a1fe29f-2bfa-41e0-981b-e2c9f37ce95c {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:39 devstack sudo[92598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7a1fe29f-2bfa-41e0-981b-e2c9f37ce95c Sep 03 11:16:39 devstack sudo[92598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:39 devstack sudo[92598]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2617de6f-1e00-4b7f-b0fa-c6c87027ebe5 tempest-AttachVolumeTestJSON-470983266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7a1fe29f-2bfa-41e0-981b-e2c9f37ce95c" returned: 0 in 0.280s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2617de6f-1e00-4b7f-b0fa-c6c87027ebe5 tempest-AttachVolumeTestJSON-470983266 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:16:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2617de6f-1e00-4b7f-b0fa-c6c87027ebe5 tempest-AttachVolumeTestJSON-470983266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.886s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:16:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2617de6f-1e00-4b7f-b0fa-c6c87027ebe5 tempest-AttachVolumeTestJSON-470983266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f3604fd-f83a-4bc0-89c4-996343119f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a1fe29f-2bfa-41e0-981b-e2c9f37ce95c', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:16:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2617de6f-1e00-4b7f-b0fa-c6c87027ebe5 tempest-AttachVolumeTestJSON-470983266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7abfb59d-6bfa-40ca-b5f0-6ef10d69736d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:16:39 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-2617de6f-1e00-4b7f-b0fa-c6c87027ebe5 tempest-AttachVolumeTestJSON-470983266 None] Volume volume-7a1fe29f-2bfa-41e0-981b-e2c9f37ce95c (7a1fe29f-2bfa-41e0-981b-e2c9f37ce95c): created successfully Sep 03 11:16:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2617de6f-1e00-4b7f-b0fa-c6c87027ebe5 tempest-AttachVolumeTestJSON-470983266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7abfb59d-6bfa-40ca-b5f0-6ef10d69736d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:16:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2617de6f-1e00-4b7f-b0fa-c6c87027ebe5 tempest-AttachVolumeTestJSON-470983266 None] Flow 'volume_create_manager' (282e1459-aa9a-42fd-a66b-42bf3d3ca936) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:16:39 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-2617de6f-1e00-4b7f-b0fa-c6c87027ebe5 tempest-AttachVolumeTestJSON-470983266 None] Created volume successfully. Sep 03 11:16:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-e735add1-5c9a-49de-a960-6e6e98a924d3 req-a9522ebf-0e8e-40ea-8e06-aeaa254575bc tempest-AttachVolumeTestJSON-470983266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:16:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-e735add1-5c9a-49de-a960-6e6e98a924d3 req-a9522ebf-0e8e-40ea-8e06-aeaa254575bc tempest-AttachVolumeTestJSON-470983266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:16:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-e735add1-5c9a-49de-a960-6e6e98a924d3 req-a9522ebf-0e8e-40ea-8e06-aeaa254575bc tempest-AttachVolumeTestJSON-470983266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:16:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-e735add1-5c9a-49de-a960-6e6e98a924d3 req-a9522ebf-0e8e-40ea-8e06-aeaa254575bc tempest-AttachVolumeTestJSON-470983266 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912', 'name': 'volume-7a1fe29f-2bfa-41e0-981b-e2c9f37ce95c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4e36ef8b-3075-4ffe-8c52-a4b7629fadff', 'enforce_multipath': True} {{(pid=87038) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:16:41 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-e735add1-5c9a-49de-a960-6e6e98a924d3 req-a9522ebf-0e8e-40ea-8e06-aeaa254575bc tempest-AttachVolumeTestJSON-470983266 None] attachment_update completed successfully. Sep 03 11:16:43 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:16:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Flow 'volume_create_manager' (c6becac3-9237-419f-aaec-48ff295f2fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:16:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93980533-c40c-413b-b41e-3183b8245d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:16:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93980533-c40c-413b-b41e-3183b8245d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-40908686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03de23ab-8148-4063-b880-22e7183c28ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b41e42ef968e4949b8b17df3f0141de8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:16:44Z,use_quota=True,user_id='31e7b95ee8e246f5a7de1afd7e301ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:16:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6b16f95-4871-4f1d-9526-85a5241e1f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:16:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6b16f95-4871-4f1d-9526-85a5241e1f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:16:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9439e2f4-1bc3-4334-b893-08e2cce5b828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:16:44 devstack cinder-volume[87038]: DEBUG cinder.image.glance [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Creating Keystone auth plugin from conf {{(pid=87038) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 11:16:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9439e2f4-1bc3-4334-b893-08e2cce5b828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '03de23ab-8148-4063-b880-22e7183c28ad', 'volume_name': 'volume-03de23ab-8148-4063-b880-22e7183c28ad', 'volume_size': 1, 'image_id': 'e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72db6f41ce954ca898cc9f539a1cd3c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'created_at': datetime.datetime(2026, 9, 3, 9, 7, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 7, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:16:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78af5f77-f754-415e-bba7-670ecdd701d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:16:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78af5f77-f754-415e-bba7-670ecdd701d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:16:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd2bd22f-50ed-49ca-a6b1-13aaee7cbcac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:16:44 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Volume 03de23ab-8148-4063-b880-22e7183c28ad: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-03de23ab-8148-4063-b880-22e7183c28ad', 'volume_size': 1, 'image_id': 'e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72db6f41ce954ca898cc9f539a1cd3c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'created_at': datetime.datetime(2026, 9, 3, 9, 7, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 7, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 03 11:16:44 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Trying to clone 03de23ab-8148-4063-b880-22e7183c28ad from image e1b59027-cb2e-4dc7-b35a-2801c7a053de at location (None, [{'url': 'file:///opt/stack/data/glance/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'metadata': {}}]). {{(pid=87038) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 11:16:44 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_07onvdy2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87038) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 11:16:44 devstack cinder-volume[87038]: INFO cinder.image.image_utils [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Image download 20.69 MB at 20.69 MB/s Sep 03 11:16:45 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0037b4-47a8-4ad8-8e75-e9e37099d45e]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:16:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_07onvdy2devstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:45 devstack sudo[92654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_07onvdy2devstack@QuobyteHD Sep 03 11:16:45 devstack sudo[92654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:45 devstack sudo[92654]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_07onvdy2devstack@QuobyteHD" returned: 0 in 0.358s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:45 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Temporary image e1b59027-cb2e-4dc7-b35a-2801c7a053de is fetched for user 31e7b95ee8e246f5a7de1afd7e301ee8. {{(pid=87038) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 11:16:45 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4e3128-2c5a-4732-aba6-299e891e2a78]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:16:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_07onvdy2devstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:45 devstack sudo[92676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_07onvdy2devstack@QuobyteHD Sep 03 11:16:45 devstack sudo[92676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:45 devstack sudo[92676]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_07onvdy2devstack@QuobyteHD" returned: 0 in 0.452s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:16:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:16:45 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:16:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-40908686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03de23ab-8148-4063-b880-22e7183c28ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b41e42ef968e4949b8b17df3f0141de8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:16:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:16:44Z,use_quota=True,user_id='31e7b95ee8e246f5a7de1afd7e301ee8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:16:45 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Creating volume 03de23ab-8148-4063-b880-22e7183c28ad {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:16:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:16:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:16:45 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:16:45 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:16:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:16:45 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:16:45 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:16:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-03de23ab-8148-4063-b880-22e7183c28ad 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:46 devstack sudo[92693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-03de23ab-8148-4063-b880-22e7183c28ad 1073741824 Sep 03 11:16:46 devstack sudo[92693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:46 devstack sudo[92693]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-03de23ab-8148-4063-b880-22e7183c28ad 1073741824" returned: 0 in 0.721s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-03de23ab-8148-4063-b880-22e7183c28ad {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:46 devstack sudo[92732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-03de23ab-8148-4063-b880-22e7183c28ad Sep 03 11:16:46 devstack sudo[92732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:47 devstack sudo[92732]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-03de23ab-8148-4063-b880-22e7183c28ad" returned: 0 in 0.473s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:47 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] <== create_volume: return (1262ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:16:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.267s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:16:47 devstack cinder-volume[87038]: DEBUG cinder.volume.volume_utils [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Attempting download of e1b59027-cb2e-4dc7-b35a-2801c7a053de ((None, [{'url': 'file:///opt/stack/data/glance/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'metadata': {}}])) to volume 03de23ab-8148-4063-b880-22e7183c28ad. {{(pid=87038) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 11:16:47 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7463114-fd04-454f-a317-fb56fcb2e4fb]: (4, 'raw') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:16:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1b59027-cb2e-4dc7-b35a-2801c7a053de_wk2gjlxs {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:47 devstack sudo[92735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1b59027-cb2e-4dc7-b35a-2801c7a053de_wk2gjlxs Sep 03 11:16:47 devstack sudo[92735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:47 devstack sudo[92735]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1b59027-cb2e-4dc7-b35a-2801c7a053de_wk2gjlxs" returned: 0 in 0.459s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1b59027-cb2e-4dc7-b35a-2801c7a053de_wk2gjlxs {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:48 devstack sudo[92743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1b59027-cb2e-4dc7-b35a-2801c7a053de_wk2gjlxs Sep 03 11:16:48 devstack sudo[92743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:48 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-44075b1e-c553-4be1-9187-e220462bf4c0 req-980a7ea4-a1c9-4062-93ec-332c4feeb44d tempest-ServerActionsTestOtherA-914104622 None] Terminate volume connection completed successfully. Sep 03 11:16:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-44075b1e-c553-4be1-9187-e220462bf4c0 req-980a7ea4-a1c9-4062-93ec-332c4feeb44d tempest-ServerActionsTestOtherA-914104622 None] Deleting attachment 847df2e9-7056-47d1-9cc3-6db8db18792a. {{(pid=87038) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:16:48 devstack sudo[92743]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1b59027-cb2e-4dc7-b35a-2801c7a053de_wk2gjlxs" returned: 1 in 0.533s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1b59027-cb2e-4dc7-b35a-2801c7a053de_wk2gjlxs' failed. Not Retrying. {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:16:48 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca746d4-02cb-4d45-b8bf-53df508a6ffb]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:16:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_07onvdy2devstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:48 devstack cinder-volume[87038]: DEBUG cinder.coordination [req-44075b1e-c553-4be1-9187-e220462bf4c0 req-e4faf48f-8761-4b9a-86c7-a912fa694161 tempest-ServerActionsTestOtherA-914104622 None] Acquiring lock "cinder-5222a549-c61d-41a2-a4fb-7e81ec07333d-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:16:48 devstack cinder-volume[87038]: DEBUG cinder.coordination [req-44075b1e-c553-4be1-9187-e220462bf4c0 req-e4faf48f-8761-4b9a-86c7-a912fa694161 tempest-ServerActionsTestOtherA-914104622 None] Lock "cinder-5222a549-c61d-41a2-a4fb-7e81ec07333d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:16:48 devstack sudo[92747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_07onvdy2devstack@QuobyteHD Sep 03 11:16:48 devstack sudo[92747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:48 devstack cinder-volume[87038]: DEBUG cinder.coordination [req-44075b1e-c553-4be1-9187-e220462bf4c0 req-e4faf48f-8761-4b9a-86c7-a912fa694161 tempest-ServerActionsTestOtherA-914104622 None] Acquiring lock "cinder-quobyte-5222a549-c61d-41a2-a4fb-7e81ec07333d" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:16:48 devstack cinder-volume[87038]: DEBUG cinder.coordination [req-44075b1e-c553-4be1-9187-e220462bf4c0 req-e4faf48f-8761-4b9a-86c7-a912fa694161 tempest-ServerActionsTestOtherA-914104622 None] Lock "cinder-quobyte-5222a549-c61d-41a2-a4fb-7e81ec07333d" acquired by "delete_volume" :: waited 0.046s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:16:48 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[232d4a6c-dd3b-4d5f-9ba4-562665c65308]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:16:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-44075b1e-c553-4be1-9187-e220462bf4c0 req-e4faf48f-8761-4b9a-86c7-a912fa694161 tempest-ServerActionsTestOtherA-914104622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5222a549-c61d-41a2-a4fb-7e81ec07333d {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:48 devstack sudo[92750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5222a549-c61d-41a2-a4fb-7e81ec07333d Sep 03 11:16:48 devstack sudo[92750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:49 devstack sudo[92747]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_07onvdy2devstack@QuobyteHD" returned: 0 in 0.678s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:49 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] e1b59027-cb2e-4dc7-b35a-2801c7a053de was qcow2, converting to qcow2 {{(pid=87038) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 11:16:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_07onvdy2devstack@QuobyteHD /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-03de23ab-8148-4063-b880-22e7183c28ad {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:49 devstack sudo[92765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_07onvdy2devstack@QuobyteHD /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-03de23ab-8148-4063-b880-22e7183c28ad Sep 03 11:16:49 devstack sudo[92765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:49 devstack sudo[92750]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-44075b1e-c553-4be1-9187-e220462bf4c0 req-e4faf48f-8761-4b9a-86c7-a912fa694161 tempest-ServerActionsTestOtherA-914104622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5222a549-c61d-41a2-a4fb-7e81ec07333d" returned: 0 in 0.785s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-44075b1e-c553-4be1-9187-e220462bf4c0 req-e4faf48f-8761-4b9a-86c7-a912fa694161 tempest-ServerActionsTestOtherA-914104622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5222a549-c61d-41a2-a4fb-7e81ec07333d {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:49 devstack sudo[92839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5222a549-c61d-41a2-a4fb-7e81ec07333d Sep 03 11:16:49 devstack sudo[92839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:50 devstack sudo[92839]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-44075b1e-c553-4be1-9187-e220462bf4c0 req-e4faf48f-8761-4b9a-86c7-a912fa694161 tempest-ServerActionsTestOtherA-914104622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5222a549-c61d-41a2-a4fb-7e81ec07333d" returned: 0 in 0.651s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:50 devstack cinder-volume[87038]: DEBUG cinder.coordination [req-44075b1e-c553-4be1-9187-e220462bf4c0 req-e4faf48f-8761-4b9a-86c7-a912fa694161 tempest-ServerActionsTestOtherA-914104622 None] Lock "cinder-quobyte-5222a549-c61d-41a2-a4fb-7e81ec07333d" released by "delete_volume" :: held 1.559s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:16:50 devstack cinder-volume[87038]: DEBUG cinder.quota [req-44075b1e-c553-4be1-9187-e220462bf4c0 req-e4faf48f-8761-4b9a-86c7-a912fa694161 tempest-ServerActionsTestOtherA-914104622 None] Created reservations ['ca4f3ec6-fcd0-432b-91ce-aef989450d3f', '05f9a8f4-26e5-4b5b-becb-af7b437b7880', 'a524c225-678c-46aa-8898-ab2f3d309545', '55027bb0-40b9-42f1-91d8-4a606a33ad92'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:16:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-44075b1e-c553-4be1-9187-e220462bf4c0 req-e4faf48f-8761-4b9a-86c7-a912fa694161 tempest-ServerActionsTestOtherA-914104622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:16:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-44075b1e-c553-4be1-9187-e220462bf4c0 req-e4faf48f-8761-4b9a-86c7-a912fa694161 tempest-ServerActionsTestOtherA-914104622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:16:50 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [req-44075b1e-c553-4be1-9187-e220462bf4c0 req-e4faf48f-8761-4b9a-86c7-a912fa694161 tempest-ServerActionsTestOtherA-914104622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:16:50 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [req-44075b1e-c553-4be1-9187-e220462bf4c0 req-e4faf48f-8761-4b9a-86c7-a912fa694161 tempest-ServerActionsTestOtherA-914104622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:16:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-44075b1e-c553-4be1-9187-e220462bf4c0 req-e4faf48f-8761-4b9a-86c7-a912fa694161 tempest-ServerActionsTestOtherA-914104622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:16:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-44075b1e-c553-4be1-9187-e220462bf4c0 req-e4faf48f-8761-4b9a-86c7-a912fa694161 tempest-ServerActionsTestOtherA-914104622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:50 devstack sudo[92884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:16:50 devstack sudo[92884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:50 devstack sudo[92884]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-44075b1e-c553-4be1-9187-e220462bf4c0 req-e4faf48f-8761-4b9a-86c7-a912fa694161 tempest-ServerActionsTestOtherA-914104622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.495s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:50 devstack cinder-volume[87038]: DEBUG cinder.manager [req-44075b1e-c553-4be1-9187-e220462bf4c0 req-e4faf48f-8761-4b9a-86c7-a912fa694161 tempest-ServerActionsTestOtherA-914104622 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:16:50 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-44075b1e-c553-4be1-9187-e220462bf4c0 req-e4faf48f-8761-4b9a-86c7-a912fa694161 tempest-ServerActionsTestOtherA-914104622 None] Deleted volume successfully. Sep 03 11:16:50 devstack cinder-volume[87038]: DEBUG cinder.coordination [req-44075b1e-c553-4be1-9187-e220462bf4c0 req-e4faf48f-8761-4b9a-86c7-a912fa694161 tempest-ServerActionsTestOtherA-914104622 None] Lock "cinder-5222a549-c61d-41a2-a4fb-7e81ec07333d-delete_volume" released by "delete_volume" :: held 2.450s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:16:51 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-37f9f01b-a4cb-4aa6-95e7-22e4dce0c369 tempest-ServerActionsTestOtherA-914104622 None] Acquiring lock "cinder-fe5ee465-bdd3-4908-a270-c42487448c64-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:16:51 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-37f9f01b-a4cb-4aa6-95e7-22e4dce0c369 tempest-ServerActionsTestOtherA-914104622 None] Lock "cinder-fe5ee465-bdd3-4908-a270-c42487448c64-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:16:51 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-37f9f01b-a4cb-4aa6-95e7-22e4dce0c369 tempest-ServerActionsTestOtherA-914104622 None] Acquiring lock "cinder-quobyte-fe5ee465-bdd3-4908-a270-c42487448c64" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:16:51 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-37f9f01b-a4cb-4aa6-95e7-22e4dce0c369 tempest-ServerActionsTestOtherA-914104622 None] Lock "cinder-quobyte-fe5ee465-bdd3-4908-a270-c42487448c64" acquired by "delete_volume" :: waited 0.026s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:16:51 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7470de-ce01-45b1-88b5-cb2f5c794da6]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:16:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-37f9f01b-a4cb-4aa6-95e7-22e4dce0c369 tempest-ServerActionsTestOtherA-914104622 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fe5ee465-bdd3-4908-a270-c42487448c64 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:51 devstack sudo[92930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fe5ee465-bdd3-4908-a270-c42487448c64 Sep 03 11:16:51 devstack sudo[92930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:51 devstack sudo[92930]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-37f9f01b-a4cb-4aa6-95e7-22e4dce0c369 tempest-ServerActionsTestOtherA-914104622 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fe5ee465-bdd3-4908-a270-c42487448c64" returned: 0 in 0.727s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-37f9f01b-a4cb-4aa6-95e7-22e4dce0c369 tempest-ServerActionsTestOtherA-914104622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fe5ee465-bdd3-4908-a270-c42487448c64 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:52 devstack sudo[93282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fe5ee465-bdd3-4908-a270-c42487448c64 Sep 03 11:16:52 devstack sudo[93282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:52 devstack sudo[93282]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-37f9f01b-a4cb-4aa6-95e7-22e4dce0c369 tempest-ServerActionsTestOtherA-914104622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fe5ee465-bdd3-4908-a270-c42487448c64" returned: 0 in 0.659s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:52 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-37f9f01b-a4cb-4aa6-95e7-22e4dce0c369 tempest-ServerActionsTestOtherA-914104622 None] Lock "cinder-quobyte-fe5ee465-bdd3-4908-a270-c42487448c64" released by "delete_volume" :: held 1.499s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:16:52 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-37f9f01b-a4cb-4aa6-95e7-22e4dce0c369 tempest-ServerActionsTestOtherA-914104622 None] Created reservations ['a4b96bd7-23a1-47a0-97a2-472aa9088011', '97beacf3-a834-452c-9a9f-5722ff025796', '4e959b0f-ff2a-4eb8-bd80-c1d23694dfda', '6aaa8791-b0c2-42c3-9e03-c40714e01ee9'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:16:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-37f9f01b-a4cb-4aa6-95e7-22e4dce0c369 tempest-ServerActionsTestOtherA-914104622 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:16:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-37f9f01b-a4cb-4aa6-95e7-22e4dce0c369 tempest-ServerActionsTestOtherA-914104622 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:16:53 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-37f9f01b-a4cb-4aa6-95e7-22e4dce0c369 tempest-ServerActionsTestOtherA-914104622 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:16:53 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-37f9f01b-a4cb-4aa6-95e7-22e4dce0c369 tempest-ServerActionsTestOtherA-914104622 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:16:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-37f9f01b-a4cb-4aa6-95e7-22e4dce0c369 tempest-ServerActionsTestOtherA-914104622 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:16:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-37f9f01b-a4cb-4aa6-95e7-22e4dce0c369 tempest-ServerActionsTestOtherA-914104622 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:53 devstack sudo[93312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:16:53 devstack sudo[93312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:53 devstack sudo[92765]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_07onvdy2devstack@QuobyteHD /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-03de23ab-8148-4063-b880-22e7183c28ad" returned: 0 in 4.261s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:53 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_07onvdy2devstack@QuobyteHD, size 112.00 MB, duration 4.26 sec, destination /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-03de23ab-8148-4063-b880-22e7183c28ad {{(pid=87038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:16:53 devstack cinder-volume[87038]: INFO cinder.image.image_utils [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Converted 112.00 MB image at 26.27 MB/s Sep 03 11:16:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-03de23ab-8148-4063-b880-22e7183c28ad 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:53 devstack sudo[93318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-03de23ab-8148-4063-b880-22e7183c28ad 1G Sep 03 11:16:53 devstack sudo[93318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:53 devstack sudo[93312]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-37f9f01b-a4cb-4aa6-95e7-22e4dce0c369 tempest-ServerActionsTestOtherA-914104622 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.634s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:53 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-37f9f01b-a4cb-4aa6-95e7-22e4dce0c369 tempest-ServerActionsTestOtherA-914104622 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:16:53 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-37f9f01b-a4cb-4aa6-95e7-22e4dce0c369 tempest-ServerActionsTestOtherA-914104622 None] Deleted volume successfully. Sep 03 11:16:53 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-37f9f01b-a4cb-4aa6-95e7-22e4dce0c369 tempest-ServerActionsTestOtherA-914104622 None] Lock "cinder-fe5ee465-bdd3-4908-a270-c42487448c64-delete_volume" released by "delete_volume" :: held 2.730s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:16:54 devstack sudo[93318]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-03de23ab-8148-4063-b880-22e7183c28ad 1G" returned: 0 in 0.757s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:54 devstack cinder-volume[87038]: DEBUG cinder.volume.volume_utils [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Downloaded image e1b59027-cb2e-4dc7-b35a-2801c7a053de ((None, [{'url': 'file:///opt/stack/data/glance/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'metadata': {}}])) to volume 03de23ab-8148-4063-b880-22e7183c28ad successfully. {{(pid=87038) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 11:16:54 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Temporary image e1b59027-cb2e-4dc7-b35a-2801c7a053de for user 31e7b95ee8e246f5a7de1afd7e301ee8 is deleted. {{(pid=87038) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 11:16:54 devstack cinder-volume[87038]: DEBUG cinder.volume.volume_utils [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Marking volume 03de23ab-8148-4063-b880-22e7183c28ad as bootable. {{(pid=87038) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 11:16:54 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Copying metadata from image e1b59027-cb2e-4dc7-b35a-2801c7a053de to 03de23ab-8148-4063-b880-22e7183c28ad. {{(pid=87038) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 11:16:54 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Creating volume glance metadata for volume 03de23ab-8148-4063-b880-22e7183c28ad backed by image e1b59027-cb2e-4dc7-b35a-2801c7a053de with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87038) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 11:16:54 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd2bd22f-50ed-49ca-a6b1-13aaee7cbcac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03de23ab-8148-4063-b880-22e7183c28ad', 'volume_size': 1, 'image_id': 'e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72db6f41ce954ca898cc9f539a1cd3c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'created_at': datetime.datetime(2026, 9, 3, 9, 7, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 7, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:16:54 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4819162-9e9b-4dee-9cb7-5876bdad1782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:16:54 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Volume volume-03de23ab-8148-4063-b880-22e7183c28ad (03de23ab-8148-4063-b880-22e7183c28ad): created successfully Sep 03 11:16:54 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4819162-9e9b-4dee-9cb7-5876bdad1782) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:16:54 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Flow 'volume_create_manager' (c6becac3-9237-419f-aaec-48ff295f2fe0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:16:54 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-7c091958-d762-40ae-941b-f16fff3cf0b6 tempest-VolumesImageMetadata-448401665 None] Created volume successfully. Sep 03 11:16:55 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-33118d3e-2e7a-4097-8fb4-47017477360e tempest-VolumesImageMetadata-448401665 None] Acquiring lock "cinder-03de23ab-8148-4063-b880-22e7183c28ad-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:16:55 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-33118d3e-2e7a-4097-8fb4-47017477360e tempest-VolumesImageMetadata-448401665 None] Lock "cinder-03de23ab-8148-4063-b880-22e7183c28ad-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:16:56 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-33118d3e-2e7a-4097-8fb4-47017477360e tempest-VolumesImageMetadata-448401665 None] Acquiring lock "cinder-quobyte-03de23ab-8148-4063-b880-22e7183c28ad" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:16:56 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-33118d3e-2e7a-4097-8fb4-47017477360e tempest-VolumesImageMetadata-448401665 None] Lock "cinder-quobyte-03de23ab-8148-4063-b880-22e7183c28ad" acquired by "delete_volume" :: waited 0.041s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:16:56 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb6fd20-892a-4bca-af2e-c7beebcf0c75]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:16:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-33118d3e-2e7a-4097-8fb4-47017477360e tempest-VolumesImageMetadata-448401665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-03de23ab-8148-4063-b880-22e7183c28ad {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:56 devstack sudo[93348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-03de23ab-8148-4063-b880-22e7183c28ad Sep 03 11:16:56 devstack sudo[93348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:56 devstack sudo[93348]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-33118d3e-2e7a-4097-8fb4-47017477360e tempest-VolumesImageMetadata-448401665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-03de23ab-8148-4063-b880-22e7183c28ad" returned: 0 in 0.593s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-33118d3e-2e7a-4097-8fb4-47017477360e tempest-VolumesImageMetadata-448401665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-03de23ab-8148-4063-b880-22e7183c28ad {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:56 devstack sudo[93354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-03de23ab-8148-4063-b880-22e7183c28ad Sep 03 11:16:56 devstack sudo[93354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:57 devstack sudo[93354]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-33118d3e-2e7a-4097-8fb4-47017477360e tempest-VolumesImageMetadata-448401665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-03de23ab-8148-4063-b880-22e7183c28ad" returned: 0 in 0.346s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:57 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-33118d3e-2e7a-4097-8fb4-47017477360e tempest-VolumesImageMetadata-448401665 None] Lock "cinder-quobyte-03de23ab-8148-4063-b880-22e7183c28ad" released by "delete_volume" :: held 1.045s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:16:57 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-33118d3e-2e7a-4097-8fb4-47017477360e tempest-VolumesImageMetadata-448401665 None] Created reservations ['061c92b5-310c-4737-bedf-4b5b367c2a0d', '05370bad-79f5-4d0d-aaf7-2705d45789be', '3517f565-0cd2-43cb-8ef9-c3784a1edfdf', 'd6810b64-d79a-4147-9244-bf3633f74d29'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:16:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-33118d3e-2e7a-4097-8fb4-47017477360e tempest-VolumesImageMetadata-448401665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:16:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-33118d3e-2e7a-4097-8fb4-47017477360e tempest-VolumesImageMetadata-448401665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:16:57 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-33118d3e-2e7a-4097-8fb4-47017477360e tempest-VolumesImageMetadata-448401665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:16:57 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-33118d3e-2e7a-4097-8fb4-47017477360e tempest-VolumesImageMetadata-448401665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:16:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-33118d3e-2e7a-4097-8fb4-47017477360e tempest-VolumesImageMetadata-448401665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:16:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-33118d3e-2e7a-4097-8fb4-47017477360e tempest-VolumesImageMetadata-448401665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:16:57 devstack sudo[93357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:16:57 devstack sudo[93357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:16:57 devstack sudo[93357]: pam_unix(sudo:session): session closed for user root Sep 03 11:16:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-33118d3e-2e7a-4097-8fb4-47017477360e tempest-VolumesImageMetadata-448401665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.319s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:16:57 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-33118d3e-2e7a-4097-8fb4-47017477360e tempest-VolumesImageMetadata-448401665 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:16:57 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-33118d3e-2e7a-4097-8fb4-47017477360e tempest-VolumesImageMetadata-448401665 None] Deleted volume successfully. Sep 03 11:16:57 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-33118d3e-2e7a-4097-8fb4-47017477360e tempest-VolumesImageMetadata-448401665 None] Lock "cinder-03de23ab-8148-4063-b880-22e7183c28ad-delete_volume" released by "delete_volume" :: held 1.763s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:17:02 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=76,cinder:UPDATE=73,cinder:INSERT=22,cinder:DELETE=5 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:17:02 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=71,cinder:UPDATE=78,cinder:INSERT=21,cinder:DELETE=7 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:17:02 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-11f0313a-1ad5-4979-9da1-311a09712c44 tempest-SnapshotMetadataTestJSON-1053855467 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:17:02 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-11f0313a-1ad5-4979-9da1-311a09712c44 tempest-SnapshotMetadataTestJSON-1053855467 None] Flow 'volume_create_manager' (0f205fa7-8a04-48ae-b378-5c9e963a1f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:17:02 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-11f0313a-1ad5-4979-9da1-311a09712c44 tempest-SnapshotMetadataTestJSON-1053855467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23182ee8-40ea-47fe-8613-f75f82187661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:17:02 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-11f0313a-1ad5-4979-9da1-311a09712c44 tempest-SnapshotMetadataTestJSON-1053855467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23182ee8-40ea-47fe-8613-f75f82187661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-726240221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636c99c97d104ab28a6449d6a388c005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:17:02Z,use_quota=True,user_id='998570f68a8c4764b9175ab60317530d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:17:02 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-11f0313a-1ad5-4979-9da1-311a09712c44 tempest-SnapshotMetadataTestJSON-1053855467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b6dd2dd-1d88-4a88-9e9a-c636f9519557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:17:02 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-11f0313a-1ad5-4979-9da1-311a09712c44 tempest-SnapshotMetadataTestJSON-1053855467 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b6dd2dd-1d88-4a88-9e9a-c636f9519557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:17:02 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-11f0313a-1ad5-4979-9da1-311a09712c44 tempest-SnapshotMetadataTestJSON-1053855467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2b3cfb5-5188-4f17-aa26-354353e45c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:17:02 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-11f0313a-1ad5-4979-9da1-311a09712c44 tempest-SnapshotMetadataTestJSON-1053855467 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2b3cfb5-5188-4f17-aa26-354353e45c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887', 'volume_name': 'volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:17:02 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-11f0313a-1ad5-4979-9da1-311a09712c44 tempest-SnapshotMetadataTestJSON-1053855467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51434fd6-bcc3-4420-8e32-b8518445ac76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:17:02 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-11f0313a-1ad5-4979-9da1-311a09712c44 tempest-SnapshotMetadataTestJSON-1053855467 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51434fd6-bcc3-4420-8e32-b8518445ac76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:17:02 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-11f0313a-1ad5-4979-9da1-311a09712c44 tempest-SnapshotMetadataTestJSON-1053855467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a9f97c1-221c-4940-8663-1f329ce3073c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:17:02 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-11f0313a-1ad5-4979-9da1-311a09712c44 tempest-SnapshotMetadataTestJSON-1053855467 None] Volume 5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887', 'volume_size': 1} Sep 03 11:17:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-11f0313a-1ad5-4979-9da1-311a09712c44 tempest-SnapshotMetadataTestJSON-1053855467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:17:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-11f0313a-1ad5-4979-9da1-311a09712c44 tempest-SnapshotMetadataTestJSON-1053855467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:17:02 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-11f0313a-1ad5-4979-9da1-311a09712c44 tempest-SnapshotMetadataTestJSON-1053855467 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:17:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-726240221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='636c99c97d104ab28a6449d6a388c005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:17:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:17:02Z,use_quota=True,user_id='998570f68a8c4764b9175ab60317530d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:17:02 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-11f0313a-1ad5-4979-9da1-311a09712c44 tempest-SnapshotMetadataTestJSON-1053855467 None] Creating volume 5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:17:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-11f0313a-1ad5-4979-9da1-311a09712c44 tempest-SnapshotMetadataTestJSON-1053855467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:17:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-11f0313a-1ad5-4979-9da1-311a09712c44 tempest-SnapshotMetadataTestJSON-1053855467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:17:02 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-11f0313a-1ad5-4979-9da1-311a09712c44 tempest-SnapshotMetadataTestJSON-1053855467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:17:02 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-11f0313a-1ad5-4979-9da1-311a09712c44 tempest-SnapshotMetadataTestJSON-1053855467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:17:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-11f0313a-1ad5-4979-9da1-311a09712c44 tempest-SnapshotMetadataTestJSON-1053855467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:17:02 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-11f0313a-1ad5-4979-9da1-311a09712c44 tempest-SnapshotMetadataTestJSON-1053855467 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:17:02 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-11f0313a-1ad5-4979-9da1-311a09712c44 tempest-SnapshotMetadataTestJSON-1053855467 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:17:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-11f0313a-1ad5-4979-9da1-311a09712c44 tempest-SnapshotMetadataTestJSON-1053855467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:02 devstack sudo[93365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887 1073741824 Sep 03 11:17:02 devstack sudo[93365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:03 devstack sudo[93365]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-11f0313a-1ad5-4979-9da1-311a09712c44 tempest-SnapshotMetadataTestJSON-1053855467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887 1073741824" returned: 0 in 0.589s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-11f0313a-1ad5-4979-9da1-311a09712c44 tempest-SnapshotMetadataTestJSON-1053855467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:03 devstack sudo[93371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887 Sep 03 11:17:03 devstack sudo[93371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:03 devstack sudo[93371]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-11f0313a-1ad5-4979-9da1-311a09712c44 tempest-SnapshotMetadataTestJSON-1053855467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887" returned: 0 in 0.293s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:03 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-11f0313a-1ad5-4979-9da1-311a09712c44 tempest-SnapshotMetadataTestJSON-1053855467 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:17:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-11f0313a-1ad5-4979-9da1-311a09712c44 tempest-SnapshotMetadataTestJSON-1053855467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:17:03 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-11f0313a-1ad5-4979-9da1-311a09712c44 tempest-SnapshotMetadataTestJSON-1053855467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a9f97c1-221c-4940-8663-1f329ce3073c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:17:03 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-11f0313a-1ad5-4979-9da1-311a09712c44 tempest-SnapshotMetadataTestJSON-1053855467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55edff13-d426-485e-8b1c-dc3c0f4f1e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:17:03 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-11f0313a-1ad5-4979-9da1-311a09712c44 tempest-SnapshotMetadataTestJSON-1053855467 None] Volume volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887 (5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887): created successfully Sep 03 11:17:03 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-11f0313a-1ad5-4979-9da1-311a09712c44 tempest-SnapshotMetadataTestJSON-1053855467 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55edff13-d426-485e-8b1c-dc3c0f4f1e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:17:03 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-11f0313a-1ad5-4979-9da1-311a09712c44 tempest-SnapshotMetadataTestJSON-1053855467 None] Flow 'volume_create_manager' (0f205fa7-8a04-48ae-b378-5c9e963a1f60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:17:03 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-11f0313a-1ad5-4979-9da1-311a09712c44 tempest-SnapshotMetadataTestJSON-1053855467 None] Created volume successfully. Sep 03 11:17:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5708950e-80ce-47dd-8b34-0e0d5759dcc3 tempest-SnapshotMetadataTestJSON-1053855467 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:17:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5708950e-80ce-47dd-8b34-0e0d5759dcc3 tempest-SnapshotMetadataTestJSON-1053855467 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:17:04 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-5708950e-80ce-47dd-8b34-0e0d5759dcc3 tempest-SnapshotMetadataTestJSON-1053855467 None] Creating offline snapshot 342dcd51-4b02-49e3-af98-33999e069798 of volume 5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887 {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:17:04 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[1baea3bf-328b-4252-8390-a5662b9b8e38]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:17:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5708950e-80ce-47dd-8b34-0e0d5759dcc3 tempest-SnapshotMetadataTestJSON-1053855467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:04 devstack sudo[93375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887 Sep 03 11:17:04 devstack sudo[93375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:05 devstack sudo[93375]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5708950e-80ce-47dd-8b34-0e0d5759dcc3 tempest-SnapshotMetadataTestJSON-1053855467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887" returned: 0 in 0.643s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5708950e-80ce-47dd-8b34-0e0d5759dcc3 tempest-SnapshotMetadataTestJSON-1053855467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887.342dcd51-4b02-49e3-af98-33999e069798 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:05 devstack sudo[93381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887.342dcd51-4b02-49e3-af98-33999e069798 1G Sep 03 11:17:05 devstack sudo[93381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:05 devstack sudo[93381]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5708950e-80ce-47dd-8b34-0e0d5759dcc3 tempest-SnapshotMetadataTestJSON-1053855467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887.342dcd51-4b02-49e3-af98-33999e069798 1G" returned: 0 in 0.507s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5708950e-80ce-47dd-8b34-0e0d5759dcc3 tempest-SnapshotMetadataTestJSON-1053855467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887.342dcd51-4b02-49e3-af98-33999e069798 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:06 devstack sudo[93388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887.342dcd51-4b02-49e3-af98-33999e069798 Sep 03 11:17:06 devstack sudo[93388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:06 devstack sudo[93388]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5708950e-80ce-47dd-8b34-0e0d5759dcc3 tempest-SnapshotMetadataTestJSON-1053855467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887.342dcd51-4b02-49e3-af98-33999e069798" returned: 0 in 0.402s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:06 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-5708950e-80ce-47dd-8b34-0e0d5759dcc3 tempest-SnapshotMetadataTestJSON-1053855467 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887.342dcd51-4b02-49e3-af98-33999e069798 is being set with open permissions: ugo+rw Sep 03 11:17:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5708950e-80ce-47dd-8b34-0e0d5759dcc3 tempest-SnapshotMetadataTestJSON-1053855467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887.342dcd51-4b02-49e3-af98-33999e069798 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:06 devstack sudo[93393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887.342dcd51-4b02-49e3-af98-33999e069798 Sep 03 11:17:06 devstack sudo[93393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:06 devstack sudo[93393]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5708950e-80ce-47dd-8b34-0e0d5759dcc3 tempest-SnapshotMetadataTestJSON-1053855467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887.342dcd51-4b02-49e3-af98-33999e069798" returned: 0 in 0.263s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5708950e-80ce-47dd-8b34-0e0d5759dcc3 tempest-SnapshotMetadataTestJSON-1053855467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:06 devstack sudo[93396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887.info Sep 03 11:17:06 devstack sudo[93396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:06 devstack sudo[93396]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5708950e-80ce-47dd-8b34-0e0d5759dcc3 tempest-SnapshotMetadataTestJSON-1053855467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887.info" returned: 0 in 0.281s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:06 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-5708950e-80ce-47dd-8b34-0e0d5759dcc3 tempest-SnapshotMetadataTestJSON-1053855467 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887.info is being set with open permissions: ugo+rw Sep 03 11:17:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5708950e-80ce-47dd-8b34-0e0d5759dcc3 tempest-SnapshotMetadataTestJSON-1053855467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:07 devstack sudo[93399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887.info Sep 03 11:17:07 devstack sudo[93399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:07 devstack sudo[93399]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5708950e-80ce-47dd-8b34-0e0d5759dcc3 tempest-SnapshotMetadataTestJSON-1053855467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887.info" returned: 0 in 0.267s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5708950e-80ce-47dd-8b34-0e0d5759dcc3 tempest-SnapshotMetadataTestJSON-1053855467 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.497s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:17:07 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-5708950e-80ce-47dd-8b34-0e0d5759dcc3 tempest-SnapshotMetadataTestJSON-1053855467 None] Create snapshot completed successfully Sep 03 11:17:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d0aee763-85cd-4573-b51f-4838ad74407e tempest-SnapshotMetadataTestJSON-1053855467 None] Acquiring lock "cinder-342dcd51-4b02-49e3-af98-33999e069798-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:17:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d0aee763-85cd-4573-b51f-4838ad74407e tempest-SnapshotMetadataTestJSON-1053855467 None] Lock "cinder-342dcd51-4b02-49e3-af98-33999e069798-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:17:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d0aee763-85cd-4573-b51f-4838ad74407e tempest-SnapshotMetadataTestJSON-1053855467 None] Acquiring lock "cinder-quobyte-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:17:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d0aee763-85cd-4573-b51f-4838ad74407e tempest-SnapshotMetadataTestJSON-1053855467 None] Lock "cinder-quobyte-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:17:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d0aee763-85cd-4573-b51f-4838ad74407e tempest-SnapshotMetadataTestJSON-1053855467 None] Acquiring lock "cinder-quobyte-342dcd51-4b02-49e3-af98-33999e069798" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:17:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d0aee763-85cd-4573-b51f-4838ad74407e tempest-SnapshotMetadataTestJSON-1053855467 None] Lock "cinder-quobyte-342dcd51-4b02-49e3-af98-33999e069798" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:17:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-d0aee763-85cd-4573-b51f-4838ad74407e tempest-SnapshotMetadataTestJSON-1053855467 None] Deleting offline snapshot 342dcd51-4b02-49e3-af98-33999e069798 of volume 5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:17:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-d0aee763-85cd-4573-b51f-4838ad74407e tempest-SnapshotMetadataTestJSON-1053855467 None] snapshot_file for this snap is: volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887.342dcd51-4b02-49e3-af98-33999e069798 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:17:08 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c43eb5-6033-4baa-ada8-1c0421700a54]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:17:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d0aee763-85cd-4573-b51f-4838ad74407e tempest-SnapshotMetadataTestJSON-1053855467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887.342dcd51-4b02-49e3-af98-33999e069798 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:08 devstack sudo[93420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887.342dcd51-4b02-49e3-af98-33999e069798 Sep 03 11:17:08 devstack sudo[93420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:09 devstack sudo[93420]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d0aee763-85cd-4573-b51f-4838ad74407e tempest-SnapshotMetadataTestJSON-1053855467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887.342dcd51-4b02-49e3-af98-33999e069798" returned: 0 in 0.409s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-d0aee763-85cd-4573-b51f-4838ad74407e tempest-SnapshotMetadataTestJSON-1053855467 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:17:09 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59b749e-2b1a-4993-81d4-fd8a3a7cdbef]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:17:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d0aee763-85cd-4573-b51f-4838ad74407e tempest-SnapshotMetadataTestJSON-1053855467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:09 devstack sudo[93425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887 Sep 03 11:17:09 devstack sudo[93425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:09 devstack sudo[93425]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d0aee763-85cd-4573-b51f-4838ad74407e tempest-SnapshotMetadataTestJSON-1053855467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887" returned: 0 in 0.355s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d0aee763-85cd-4573-b51f-4838ad74407e tempest-SnapshotMetadataTestJSON-1053855467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887.342dcd51-4b02-49e3-af98-33999e069798 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:09 devstack sudo[93455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887.342dcd51-4b02-49e3-af98-33999e069798 Sep 03 11:17:09 devstack sudo[93455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:09 devstack sudo[93455]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d0aee763-85cd-4573-b51f-4838ad74407e tempest-SnapshotMetadataTestJSON-1053855467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887.342dcd51-4b02-49e3-af98-33999e069798" returned: 0 in 0.338s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d0aee763-85cd-4573-b51f-4838ad74407e tempest-SnapshotMetadataTestJSON-1053855467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887.342dcd51-4b02-49e3-af98-33999e069798 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:09 devstack sudo[93460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887.342dcd51-4b02-49e3-af98-33999e069798 Sep 03 11:17:09 devstack sudo[93460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:10 devstack sudo[93460]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d0aee763-85cd-4573-b51f-4838ad74407e tempest-SnapshotMetadataTestJSON-1053855467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887.342dcd51-4b02-49e3-af98-33999e069798" returned: 0 in 0.246s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d0aee763-85cd-4573-b51f-4838ad74407e tempest-SnapshotMetadataTestJSON-1053855467 None] Lock "cinder-quobyte-342dcd51-4b02-49e3-af98-33999e069798" released by "_delete_snapshot" :: held 1.462s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:17:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d0aee763-85cd-4573-b51f-4838ad74407e tempest-SnapshotMetadataTestJSON-1053855467 None] Lock "cinder-quobyte-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887" released by "delete_snapshot" :: held 1.485s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:17:10 devstack cinder-volume[87038]: WARNING cinder.quota [None req-d0aee763-85cd-4573-b51f-4838ad74407e tempest-SnapshotMetadataTestJSON-1053855467 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:17:10 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-d0aee763-85cd-4573-b51f-4838ad74407e tempest-SnapshotMetadataTestJSON-1053855467 None] Created reservations ['148ec9b2-315a-4578-9069-c898ebeac82c', '5e90b4d6-ead9-479f-9fe3-9cfab5a68402', '9f63e293-1dcb-4164-8b27-492e33274257', '6249e3a1-cde5-4f8d-9681-bc0ef560b353'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:17:10 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-d0aee763-85cd-4573-b51f-4838ad74407e tempest-SnapshotMetadataTestJSON-1053855467 None] Delete snapshot completed successfully. Sep 03 11:17:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d0aee763-85cd-4573-b51f-4838ad74407e tempest-SnapshotMetadataTestJSON-1053855467 None] Lock "cinder-342dcd51-4b02-49e3-af98-33999e069798-delete_snapshot" released by "delete_snapshot" :: held 1.644s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:17:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fb084f39-4c99-4740-96ba-b4d93aec418a tempest-SnapshotMetadataTestJSON-1053855467 None] Acquiring lock "cinder-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:17:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fb084f39-4c99-4740-96ba-b4d93aec418a tempest-SnapshotMetadataTestJSON-1053855467 None] Lock "cinder-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:17:11 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fb084f39-4c99-4740-96ba-b4d93aec418a tempest-SnapshotMetadataTestJSON-1053855467 None] Acquiring lock "cinder-quobyte-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:17:11 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fb084f39-4c99-4740-96ba-b4d93aec418a tempest-SnapshotMetadataTestJSON-1053855467 None] Lock "cinder-quobyte-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887" acquired by "delete_volume" :: waited 0.034s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:17:11 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[7015e4c5-bbed-4bbd-adcd-10415d6128fc]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:17:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fb084f39-4c99-4740-96ba-b4d93aec418a tempest-SnapshotMetadataTestJSON-1053855467 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:11 devstack sudo[93497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887 Sep 03 11:17:11 devstack sudo[93497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:11 devstack sudo[93497]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fb084f39-4c99-4740-96ba-b4d93aec418a tempest-SnapshotMetadataTestJSON-1053855467 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887" returned: 0 in 0.385s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fb084f39-4c99-4740-96ba-b4d93aec418a tempest-SnapshotMetadataTestJSON-1053855467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:11 devstack sudo[93504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887 Sep 03 11:17:11 devstack sudo[93504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:11 devstack sudo[93504]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fb084f39-4c99-4740-96ba-b4d93aec418a tempest-SnapshotMetadataTestJSON-1053855467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887" returned: 0 in 0.253s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:11 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fb084f39-4c99-4740-96ba-b4d93aec418a tempest-SnapshotMetadataTestJSON-1053855467 None] Lock "cinder-quobyte-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887" released by "delete_volume" :: held 0.721s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:17:11 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-fb084f39-4c99-4740-96ba-b4d93aec418a tempest-SnapshotMetadataTestJSON-1053855467 None] Created reservations ['95f7e9a7-2b26-402e-9fee-53b6c75dd5de', '5da9ce6d-acd7-47b3-b055-31677555f51c', '2f70b337-576c-4211-8691-d91d5a9f34ef', 'cba6f62f-2d96-4549-a76e-3c99b84108b0'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:17:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-fb084f39-4c99-4740-96ba-b4d93aec418a tempest-SnapshotMetadataTestJSON-1053855467 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:17:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-fb084f39-4c99-4740-96ba-b4d93aec418a tempest-SnapshotMetadataTestJSON-1053855467 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:17:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-fb084f39-4c99-4740-96ba-b4d93aec418a tempest-SnapshotMetadataTestJSON-1053855467 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:17:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-fb084f39-4c99-4740-96ba-b4d93aec418a tempest-SnapshotMetadataTestJSON-1053855467 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:17:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-fb084f39-4c99-4740-96ba-b4d93aec418a tempest-SnapshotMetadataTestJSON-1053855467 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:17:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fb084f39-4c99-4740-96ba-b4d93aec418a tempest-SnapshotMetadataTestJSON-1053855467 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:11 devstack sudo[93507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:17:11 devstack sudo[93507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:12 devstack sudo[93507]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fb084f39-4c99-4740-96ba-b4d93aec418a tempest-SnapshotMetadataTestJSON-1053855467 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.282s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:12 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-fb084f39-4c99-4740-96ba-b4d93aec418a tempest-SnapshotMetadataTestJSON-1053855467 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:17:12 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-fb084f39-4c99-4740-96ba-b4d93aec418a tempest-SnapshotMetadataTestJSON-1053855467 None] Deleted volume successfully. Sep 03 11:17:12 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fb084f39-4c99-4740-96ba-b4d93aec418a tempest-SnapshotMetadataTestJSON-1053855467 None] Lock "cinder-5a1aaa54-4cfb-45e0-9c0f-eeec2cdc4887-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:17:15 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb5f74ed-4575-4e00-84d0-2176b732e89d tempest-VolumesMetadataTest-1781859355 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:17:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-fb5f74ed-4575-4e00-84d0-2176b732e89d tempest-VolumesMetadataTest-1781859355 None] Flow 'volume_create_manager' (1e53083b-e008-4666-b5fb-396636d4bfb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:17:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-fb5f74ed-4575-4e00-84d0-2176b732e89d tempest-VolumesMetadataTest-1781859355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (769d1ece-8d33-4979-a229-e30de6da27cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:17:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-fb5f74ed-4575-4e00-84d0-2176b732e89d tempest-VolumesMetadataTest-1781859355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (769d1ece-8d33-4979-a229-e30de6da27cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1212169968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ea611d-2934-4c40-918d-d134671f67bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c56faaf16ff2496098013b2f49d85c5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:17:16Z,use_quota=True,user_id='96b065b128214d648fe7789b02923133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:17:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-fb5f74ed-4575-4e00-84d0-2176b732e89d tempest-VolumesMetadataTest-1781859355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d7a91f-4eb5-43f8-adc9-521a33e9e093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:17:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-fb5f74ed-4575-4e00-84d0-2176b732e89d tempest-VolumesMetadataTest-1781859355 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6d7a91f-4eb5-43f8-adc9-521a33e9e093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:17:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-fb5f74ed-4575-4e00-84d0-2176b732e89d tempest-VolumesMetadataTest-1781859355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e19fb9f-6976-428e-9ae4-48aa0f005c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:17:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-fb5f74ed-4575-4e00-84d0-2176b732e89d tempest-VolumesMetadataTest-1781859355 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e19fb9f-6976-428e-9ae4-48aa0f005c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64ea611d-2934-4c40-918d-d134671f67bd', 'volume_name': 'volume-64ea611d-2934-4c40-918d-d134671f67bd', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:17:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-fb5f74ed-4575-4e00-84d0-2176b732e89d tempest-VolumesMetadataTest-1781859355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54f65b50-4125-4904-bfb5-a2bbc2813aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:17:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-fb5f74ed-4575-4e00-84d0-2176b732e89d tempest-VolumesMetadataTest-1781859355 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54f65b50-4125-4904-bfb5-a2bbc2813aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:17:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-fb5f74ed-4575-4e00-84d0-2176b732e89d tempest-VolumesMetadataTest-1781859355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (751428ca-44f3-4048-a203-127c99d87098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:17:15 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-fb5f74ed-4575-4e00-84d0-2176b732e89d tempest-VolumesMetadataTest-1781859355 None] Volume 64ea611d-2934-4c40-918d-d134671f67bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64ea611d-2934-4c40-918d-d134671f67bd', 'volume_size': 1} Sep 03 11:17:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-fb5f74ed-4575-4e00-84d0-2176b732e89d tempest-VolumesMetadataTest-1781859355 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:17:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-fb5f74ed-4575-4e00-84d0-2176b732e89d tempest-VolumesMetadataTest-1781859355 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:17:15 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-fb5f74ed-4575-4e00-84d0-2176b732e89d tempest-VolumesMetadataTest-1781859355 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:17:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1212169968',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64ea611d-2934-4c40-918d-d134671f67bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c56faaf16ff2496098013b2f49d85c5b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:17:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:17:16Z,use_quota=True,user_id='96b065b128214d648fe7789b02923133',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:17:15 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-fb5f74ed-4575-4e00-84d0-2176b732e89d tempest-VolumesMetadataTest-1781859355 None] Creating volume 64ea611d-2934-4c40-918d-d134671f67bd {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:17:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-fb5f74ed-4575-4e00-84d0-2176b732e89d tempest-VolumesMetadataTest-1781859355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:17:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-fb5f74ed-4575-4e00-84d0-2176b732e89d tempest-VolumesMetadataTest-1781859355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:17:15 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-fb5f74ed-4575-4e00-84d0-2176b732e89d tempest-VolumesMetadataTest-1781859355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:17:15 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-fb5f74ed-4575-4e00-84d0-2176b732e89d tempest-VolumesMetadataTest-1781859355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:17:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-fb5f74ed-4575-4e00-84d0-2176b732e89d tempest-VolumesMetadataTest-1781859355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:17:15 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-fb5f74ed-4575-4e00-84d0-2176b732e89d tempest-VolumesMetadataTest-1781859355 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:17:15 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-fb5f74ed-4575-4e00-84d0-2176b732e89d tempest-VolumesMetadataTest-1781859355 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:17:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fb5f74ed-4575-4e00-84d0-2176b732e89d tempest-VolumesMetadataTest-1781859355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-64ea611d-2934-4c40-918d-d134671f67bd 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:15 devstack sudo[93535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-64ea611d-2934-4c40-918d-d134671f67bd 1073741824 Sep 03 11:17:15 devstack sudo[93535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:16 devstack sudo[93535]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fb5f74ed-4575-4e00-84d0-2176b732e89d tempest-VolumesMetadataTest-1781859355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-64ea611d-2934-4c40-918d-d134671f67bd 1073741824" returned: 0 in 0.587s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fb5f74ed-4575-4e00-84d0-2176b732e89d tempest-VolumesMetadataTest-1781859355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-64ea611d-2934-4c40-918d-d134671f67bd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:16 devstack sudo[93544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-64ea611d-2934-4c40-918d-d134671f67bd Sep 03 11:17:16 devstack sudo[93544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:16 devstack sudo[93544]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fb5f74ed-4575-4e00-84d0-2176b732e89d tempest-VolumesMetadataTest-1781859355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-64ea611d-2934-4c40-918d-d134671f67bd" returned: 0 in 0.292s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:16 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-fb5f74ed-4575-4e00-84d0-2176b732e89d tempest-VolumesMetadataTest-1781859355 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:17:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-fb5f74ed-4575-4e00-84d0-2176b732e89d tempest-VolumesMetadataTest-1781859355 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:17:16 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-fb5f74ed-4575-4e00-84d0-2176b732e89d tempest-VolumesMetadataTest-1781859355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (751428ca-44f3-4048-a203-127c99d87098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64ea611d-2934-4c40-918d-d134671f67bd', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:17:16 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-fb5f74ed-4575-4e00-84d0-2176b732e89d tempest-VolumesMetadataTest-1781859355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cce63bd5-9cac-486e-b540-6c98183ae09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:17:16 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-fb5f74ed-4575-4e00-84d0-2176b732e89d tempest-VolumesMetadataTest-1781859355 None] Volume volume-64ea611d-2934-4c40-918d-d134671f67bd (64ea611d-2934-4c40-918d-d134671f67bd): created successfully Sep 03 11:17:16 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-fb5f74ed-4575-4e00-84d0-2176b732e89d tempest-VolumesMetadataTest-1781859355 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cce63bd5-9cac-486e-b540-6c98183ae09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:17:16 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-fb5f74ed-4575-4e00-84d0-2176b732e89d tempest-VolumesMetadataTest-1781859355 None] Flow 'volume_create_manager' (1e53083b-e008-4666-b5fb-396636d4bfb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:17:16 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-fb5f74ed-4575-4e00-84d0-2176b732e89d tempest-VolumesMetadataTest-1781859355 None] Created volume successfully. Sep 03 11:17:17 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:17:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:17:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:17:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:17:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:17:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:17:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:17 devstack sudo[93549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:17:17 devstack sudo[93549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:18 devstack sudo[93549]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.413s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:18 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:17:18 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:17:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread count: 28 {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:17:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread info: [<_MainThread(MainThread, started 139554943000704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:17:18 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b73c5617-1c3b-4a3e-a4a3-cbcc0d272025 tempest-VolumesMetadataTest-1781859355 None] Acquiring lock "cinder-64ea611d-2934-4c40-918d-d134671f67bd-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:17:18 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b73c5617-1c3b-4a3e-a4a3-cbcc0d272025 tempest-VolumesMetadataTest-1781859355 None] Lock "cinder-64ea611d-2934-4c40-918d-d134671f67bd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:17:18 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b73c5617-1c3b-4a3e-a4a3-cbcc0d272025 tempest-VolumesMetadataTest-1781859355 None] Acquiring lock "cinder-quobyte-64ea611d-2934-4c40-918d-d134671f67bd" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:17:18 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b73c5617-1c3b-4a3e-a4a3-cbcc0d272025 tempest-VolumesMetadataTest-1781859355 None] Lock "cinder-quobyte-64ea611d-2934-4c40-918d-d134671f67bd" acquired by "delete_volume" :: waited 0.016s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:17:18 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9530386-b0b0-4e70-8d53-6ca5ada6a8e6]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:17:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b73c5617-1c3b-4a3e-a4a3-cbcc0d272025 tempest-VolumesMetadataTest-1781859355 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-64ea611d-2934-4c40-918d-d134671f67bd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:18 devstack sudo[93552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-64ea611d-2934-4c40-918d-d134671f67bd Sep 03 11:17:18 devstack sudo[93552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:19 devstack sudo[93552]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b73c5617-1c3b-4a3e-a4a3-cbcc0d272025 tempest-VolumesMetadataTest-1781859355 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-64ea611d-2934-4c40-918d-d134671f67bd" returned: 0 in 0.381s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b73c5617-1c3b-4a3e-a4a3-cbcc0d272025 tempest-VolumesMetadataTest-1781859355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-64ea611d-2934-4c40-918d-d134671f67bd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:19 devstack sudo[93559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-64ea611d-2934-4c40-918d-d134671f67bd Sep 03 11:17:19 devstack sudo[93559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:19 devstack sudo[93559]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b73c5617-1c3b-4a3e-a4a3-cbcc0d272025 tempest-VolumesMetadataTest-1781859355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-64ea611d-2934-4c40-918d-d134671f67bd" returned: 0 in 0.287s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:19 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b73c5617-1c3b-4a3e-a4a3-cbcc0d272025 tempest-VolumesMetadataTest-1781859355 None] Lock "cinder-quobyte-64ea611d-2934-4c40-918d-d134671f67bd" released by "delete_volume" :: held 0.721s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:17:19 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-b73c5617-1c3b-4a3e-a4a3-cbcc0d272025 tempest-VolumesMetadataTest-1781859355 None] Created reservations ['eeb03ae6-1851-4e4c-a9be-1ac29b835fe8', 'c8352304-611d-45c2-9bf7-3d279d565355', '254e5f88-7ccc-4688-8d6b-05cdbb4f1af9', 'b6999501-190c-40f7-81f9-01c8d7f35bb6'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:17:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b73c5617-1c3b-4a3e-a4a3-cbcc0d272025 tempest-VolumesMetadataTest-1781859355 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:17:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b73c5617-1c3b-4a3e-a4a3-cbcc0d272025 tempest-VolumesMetadataTest-1781859355 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:17:19 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-b73c5617-1c3b-4a3e-a4a3-cbcc0d272025 tempest-VolumesMetadataTest-1781859355 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:17:19 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-b73c5617-1c3b-4a3e-a4a3-cbcc0d272025 tempest-VolumesMetadataTest-1781859355 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:17:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b73c5617-1c3b-4a3e-a4a3-cbcc0d272025 tempest-VolumesMetadataTest-1781859355 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:17:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b73c5617-1c3b-4a3e-a4a3-cbcc0d272025 tempest-VolumesMetadataTest-1781859355 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:19 devstack sudo[93562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:17:19 devstack sudo[93562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:19 devstack sudo[93562]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b73c5617-1c3b-4a3e-a4a3-cbcc0d272025 tempest-VolumesMetadataTest-1781859355 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.327s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:20 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-b73c5617-1c3b-4a3e-a4a3-cbcc0d272025 tempest-VolumesMetadataTest-1781859355 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:17:20 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-b73c5617-1c3b-4a3e-a4a3-cbcc0d272025 tempest-VolumesMetadataTest-1781859355 None] Deleted volume successfully. Sep 03 11:17:20 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b73c5617-1c3b-4a3e-a4a3-cbcc0d272025 tempest-VolumesMetadataTest-1781859355 None] Lock "cinder-64ea611d-2934-4c40-918d-d134671f67bd-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:17:20 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2fb003c2-2636-4604-a5c2-06ee4dca7955 tempest-AttachVolumeShelveTestJSON-1102155481 None] Acquiring lock "cinder-41764751-5ee1-4894-ab75-d3902623add7-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:17:20 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2fb003c2-2636-4604-a5c2-06ee4dca7955 tempest-AttachVolumeShelveTestJSON-1102155481 None] Lock "cinder-41764751-5ee1-4894-ab75-d3902623add7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:17:20 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2fb003c2-2636-4604-a5c2-06ee4dca7955 tempest-AttachVolumeShelveTestJSON-1102155481 None] Acquiring lock "cinder-quobyte-41764751-5ee1-4894-ab75-d3902623add7" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:17:20 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2fb003c2-2636-4604-a5c2-06ee4dca7955 tempest-AttachVolumeShelveTestJSON-1102155481 None] Lock "cinder-quobyte-41764751-5ee1-4894-ab75-d3902623add7" acquired by "delete_volume" :: waited 0.024s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:17:20 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[896b65c3-a544-4083-af18-70717b9ec5ef]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:17:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2fb003c2-2636-4604-a5c2-06ee4dca7955 tempest-AttachVolumeShelveTestJSON-1102155481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-41764751-5ee1-4894-ab75-d3902623add7 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:20 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-713a867d-7d46-4a94-a4aa-67b99c576321 req-eddce368-9b63-4689-b8f4-f7ce157de25b tempest-AttachVolumeTestJSON-470983266 None] Terminate volume connection completed successfully. Sep 03 11:17:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-713a867d-7d46-4a94-a4aa-67b99c576321 req-eddce368-9b63-4689-b8f4-f7ce157de25b tempest-AttachVolumeTestJSON-470983266 None] Deleting attachment 4e36ef8b-3075-4ffe-8c52-a4b7629fadff. {{(pid=87038) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:17:20 devstack sudo[93569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-41764751-5ee1-4894-ab75-d3902623add7 Sep 03 11:17:20 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:21 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2fb003c2-2636-4604-a5c2-06ee4dca7955 tempest-AttachVolumeShelveTestJSON-1102155481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-41764751-5ee1-4894-ab75-d3902623add7" returned: 0 in 0.578s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2fb003c2-2636-4604-a5c2-06ee4dca7955 tempest-AttachVolumeShelveTestJSON-1102155481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-41764751-5ee1-4894-ab75-d3902623add7 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:21 devstack sudo[93574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-41764751-5ee1-4894-ab75-d3902623add7 Sep 03 11:17:21 devstack sudo[93574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:21 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-87b01586-f6a0-4b62-8562-7e4c6d611851 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:17:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-87b01586-f6a0-4b62-8562-7e4c6d611851 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Flow 'volume_create_manager' (e76ab160-a35f-4b80-9151-87ac46e091ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:17:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-87b01586-f6a0-4b62-8562-7e4c6d611851 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c653808e-6c59-4ef0-8de6-e9f38ab9b911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:17:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-87b01586-f6a0-4b62-8562-7e4c6d611851 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c653808e-6c59-4ef0-8de6-e9f38ab9b911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1251308544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd2c119e-7002-4d1d-8394-6ef3448fcbb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57deb9b166874831ab814bcae944b865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:17:21Z,use_quota=True,user_id='90d1112deb3440d08c80892fd201bd07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:17:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-87b01586-f6a0-4b62-8562-7e4c6d611851 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79073eff-acaa-4847-ae46-4eb64beac089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:17:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-87b01586-f6a0-4b62-8562-7e4c6d611851 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79073eff-acaa-4847-ae46-4eb64beac089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:17:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-87b01586-f6a0-4b62-8562-7e4c6d611851 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5271bb92-a5f7-44b5-a4de-25553ce3f9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:17:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-87b01586-f6a0-4b62-8562-7e4c6d611851 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5271bb92-a5f7-44b5-a4de-25553ce3f9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd2c119e-7002-4d1d-8394-6ef3448fcbb9', 'volume_name': 'volume-fd2c119e-7002-4d1d-8394-6ef3448fcbb9', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:17:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-87b01586-f6a0-4b62-8562-7e4c6d611851 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc7e9c66-fc19-4f36-8d3b-d40d0775101e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:17:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-87b01586-f6a0-4b62-8562-7e4c6d611851 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc7e9c66-fc19-4f36-8d3b-d40d0775101e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:17:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-87b01586-f6a0-4b62-8562-7e4c6d611851 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a60460ac-187c-479e-aa06-45b9272ba9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:17:21 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-87b01586-f6a0-4b62-8562-7e4c6d611851 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Volume fd2c119e-7002-4d1d-8394-6ef3448fcbb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd2c119e-7002-4d1d-8394-6ef3448fcbb9', 'volume_size': 1} Sep 03 11:17:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-87b01586-f6a0-4b62-8562-7e4c6d611851 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:17:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-87b01586-f6a0-4b62-8562-7e4c6d611851 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:17:21 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-87b01586-f6a0-4b62-8562-7e4c6d611851 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:17:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1251308544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd2c119e-7002-4d1d-8394-6ef3448fcbb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57deb9b166874831ab814bcae944b865',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:17:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:17:21Z,use_quota=True,user_id='90d1112deb3440d08c80892fd201bd07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:17:21 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-87b01586-f6a0-4b62-8562-7e4c6d611851 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Creating volume fd2c119e-7002-4d1d-8394-6ef3448fcbb9 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:17:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-87b01586-f6a0-4b62-8562-7e4c6d611851 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:17:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-87b01586-f6a0-4b62-8562-7e4c6d611851 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:17:21 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-87b01586-f6a0-4b62-8562-7e4c6d611851 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:17:21 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-87b01586-f6a0-4b62-8562-7e4c6d611851 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:17:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-87b01586-f6a0-4b62-8562-7e4c6d611851 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:17:21 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-87b01586-f6a0-4b62-8562-7e4c6d611851 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:17:21 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-87b01586-f6a0-4b62-8562-7e4c6d611851 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:17:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-87b01586-f6a0-4b62-8562-7e4c6d611851 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fd2c119e-7002-4d1d-8394-6ef3448fcbb9 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:21 devstack sudo[93577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fd2c119e-7002-4d1d-8394-6ef3448fcbb9 1073741824 Sep 03 11:17:21 devstack sudo[93577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:21 devstack sudo[93574]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2fb003c2-2636-4604-a5c2-06ee4dca7955 tempest-AttachVolumeShelveTestJSON-1102155481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-41764751-5ee1-4894-ab75-d3902623add7" returned: 0 in 0.325s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:21 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2fb003c2-2636-4604-a5c2-06ee4dca7955 tempest-AttachVolumeShelveTestJSON-1102155481 None] Lock "cinder-quobyte-41764751-5ee1-4894-ab75-d3902623add7" released by "delete_volume" :: held 0.957s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:17:21 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-2fb003c2-2636-4604-a5c2-06ee4dca7955 tempest-AttachVolumeShelveTestJSON-1102155481 None] Created reservations ['8885f433-ddfa-43d0-ad36-9090bfa76a38', '0cb16138-5443-4f02-acc1-d2b81c80303d', 'f9347ace-c9ba-4e22-86f4-bab4e67d2bb6', '6b5aa257-28ac-415c-917b-febd52699f74'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:17:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2fb003c2-2636-4604-a5c2-06ee4dca7955 tempest-AttachVolumeShelveTestJSON-1102155481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:17:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2fb003c2-2636-4604-a5c2-06ee4dca7955 tempest-AttachVolumeShelveTestJSON-1102155481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:17:21 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2fb003c2-2636-4604-a5c2-06ee4dca7955 tempest-AttachVolumeShelveTestJSON-1102155481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:17:21 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2fb003c2-2636-4604-a5c2-06ee4dca7955 tempest-AttachVolumeShelveTestJSON-1102155481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:17:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2fb003c2-2636-4604-a5c2-06ee4dca7955 tempest-AttachVolumeShelveTestJSON-1102155481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:17:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2fb003c2-2636-4604-a5c2-06ee4dca7955 tempest-AttachVolumeShelveTestJSON-1102155481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:21 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:17:21 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:22 devstack sudo[93577]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:22 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2fb003c2-2636-4604-a5c2-06ee4dca7955 tempest-AttachVolumeShelveTestJSON-1102155481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.338s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:22 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-2fb003c2-2636-4604-a5c2-06ee4dca7955 tempest-AttachVolumeShelveTestJSON-1102155481 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:17:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-87b01586-f6a0-4b62-8562-7e4c6d611851 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fd2c119e-7002-4d1d-8394-6ef3448fcbb9 1073741824" returned: 0 in 0.656s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:22 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-2fb003c2-2636-4604-a5c2-06ee4dca7955 tempest-AttachVolumeShelveTestJSON-1102155481 None] Deleted volume successfully. Sep 03 11:17:22 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2fb003c2-2636-4604-a5c2-06ee4dca7955 tempest-AttachVolumeShelveTestJSON-1102155481 None] Lock "cinder-41764751-5ee1-4894-ab75-d3902623add7-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:17:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-87b01586-f6a0-4b62-8562-7e4c6d611851 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fd2c119e-7002-4d1d-8394-6ef3448fcbb9 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:22 devstack sudo[93591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fd2c119e-7002-4d1d-8394-6ef3448fcbb9 Sep 03 11:17:22 devstack sudo[93591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:22 devstack sudo[93591]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-87b01586-f6a0-4b62-8562-7e4c6d611851 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fd2c119e-7002-4d1d-8394-6ef3448fcbb9" returned: 0 in 0.289s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:22 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-87b01586-f6a0-4b62-8562-7e4c6d611851 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:17:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-87b01586-f6a0-4b62-8562-7e4c6d611851 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:17:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-87b01586-f6a0-4b62-8562-7e4c6d611851 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a60460ac-187c-479e-aa06-45b9272ba9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd2c119e-7002-4d1d-8394-6ef3448fcbb9', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:17:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-87b01586-f6a0-4b62-8562-7e4c6d611851 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53456d03-41de-4b27-aad0-25bdf3365f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:17:22 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-87b01586-f6a0-4b62-8562-7e4c6d611851 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Volume volume-fd2c119e-7002-4d1d-8394-6ef3448fcbb9 (fd2c119e-7002-4d1d-8394-6ef3448fcbb9): created successfully Sep 03 11:17:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-87b01586-f6a0-4b62-8562-7e4c6d611851 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53456d03-41de-4b27-aad0-25bdf3365f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:17:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-87b01586-f6a0-4b62-8562-7e4c6d611851 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Flow 'volume_create_manager' (e76ab160-a35f-4b80-9151-87ac46e091ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:17:22 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-87b01586-f6a0-4b62-8562-7e4c6d611851 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Created volume successfully. Sep 03 11:17:24 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:17:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Flow 'volume_create_manager' (343abd38-5600-41b0-8ee4-d4f09f480042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:17:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4053100-d408-4481-83c4-44210a77d773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:17:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4053100-d408-4481-83c4-44210a77d773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-266145128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c96f377-d906-4cc9-a15b-dcf2c7d01bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3337b2401abd4a25913fd0ca0f1e6202',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:17:24Z,use_quota=True,user_id='89284c4afa514af49b01431af33bc569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:17:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f466d5b-0fbc-4723-8e5e-ef391b9bf28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:17:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f466d5b-0fbc-4723-8e5e-ef391b9bf28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:17:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b519d827-ca00-4020-b512-e817b062c0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:17:24 devstack cinder-volume[87038]: DEBUG cinder.image.glance [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Creating Keystone auth plugin from conf {{(pid=87038) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 11:17:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b519d827-ca00-4020-b512-e817b062c0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9c96f377-d906-4cc9-a15b-dcf2c7d01bb9', 'volume_name': 'volume-9c96f377-d906-4cc9-a15b-dcf2c7d01bb9', 'volume_size': 1, 'image_id': 'e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72db6f41ce954ca898cc9f539a1cd3c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'created_at': datetime.datetime(2026, 9, 3, 9, 7, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 7, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:17:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a847e53-b7e4-4eb1-9bc4-2fa0316f17f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:17:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a847e53-b7e4-4eb1-9bc4-2fa0316f17f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:17:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a06928d-bed5-49b4-9d87-b23494e7402b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:17:24 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Volume 9c96f377-d906-4cc9-a15b-dcf2c7d01bb9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9c96f377-d906-4cc9-a15b-dcf2c7d01bb9', 'volume_size': 1, 'image_id': 'e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72db6f41ce954ca898cc9f539a1cd3c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'created_at': datetime.datetime(2026, 9, 3, 9, 7, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 7, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 03 11:17:24 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Trying to clone 9c96f377-d906-4cc9-a15b-dcf2c7d01bb9 from image e1b59027-cb2e-4dc7-b35a-2801c7a053de at location (None, [{'url': 'file:///opt/stack/data/glance/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'metadata': {}}]). {{(pid=87038) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 11:17:24 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2777d8a2-135a-41c5-8a29-310afe093296 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Acquiring lock "cinder-fd2c119e-7002-4d1d-8394-6ef3448fcbb9-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:17:25 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2777d8a2-135a-41c5-8a29-310afe093296 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Lock "cinder-fd2c119e-7002-4d1d-8394-6ef3448fcbb9-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:17:25 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2777d8a2-135a-41c5-8a29-310afe093296 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Acquiring lock "cinder-quobyte-fd2c119e-7002-4d1d-8394-6ef3448fcbb9" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:17:25 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2777d8a2-135a-41c5-8a29-310afe093296 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Lock "cinder-quobyte-fd2c119e-7002-4d1d-8394-6ef3448fcbb9" acquired by "delete_volume" :: waited 0.020s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:17:25 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_sp6lfxvndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87038) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 11:17:25 devstack cinder-volume[87038]: INFO cinder.image.image_utils [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Image download 20.69 MB at 20.69 MB/s Sep 03 11:17:25 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a6e181-8525-4bd1-a707-4c7231784a64]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:17:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2777d8a2-135a-41c5-8a29-310afe093296 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fd2c119e-7002-4d1d-8394-6ef3448fcbb9 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:25 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[e63919e4-a28f-4d20-a9ab-9fec182af7d9]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:17:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_sp6lfxvndevstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:25 devstack sudo[93625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fd2c119e-7002-4d1d-8394-6ef3448fcbb9 Sep 03 11:17:25 devstack sudo[93625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:25 devstack sudo[93631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_sp6lfxvndevstack@QuobyteHD Sep 03 11:17:25 devstack sudo[93631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:25 devstack sudo[93631]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_sp6lfxvndevstack@QuobyteHD" returned: 0 in 0.571s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:25 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Temporary image e1b59027-cb2e-4dc7-b35a-2801c7a053de is fetched for user 89284c4afa514af49b01431af33bc569. {{(pid=87038) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 11:17:25 devstack sudo[93625]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2777d8a2-135a-41c5-8a29-310afe093296 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fd2c119e-7002-4d1d-8394-6ef3448fcbb9" returned: 0 in 0.711s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2777d8a2-135a-41c5-8a29-310afe093296 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fd2c119e-7002-4d1d-8394-6ef3448fcbb9 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:26 devstack sudo[93695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fd2c119e-7002-4d1d-8394-6ef3448fcbb9 Sep 03 11:17:26 devstack sudo[93695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:26 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[6717584d-0b24-4b81-84e0-4ba87723b110]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:17:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_sp6lfxvndevstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:26 devstack sudo[93701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_sp6lfxvndevstack@QuobyteHD Sep 03 11:17:26 devstack sudo[93701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:26 devstack sudo[93695]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2777d8a2-135a-41c5-8a29-310afe093296 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fd2c119e-7002-4d1d-8394-6ef3448fcbb9" returned: 0 in 0.533s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:26 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2777d8a2-135a-41c5-8a29-310afe093296 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Lock "cinder-quobyte-fd2c119e-7002-4d1d-8394-6ef3448fcbb9" released by "delete_volume" :: held 1.315s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:17:26 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-2777d8a2-135a-41c5-8a29-310afe093296 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Created reservations ['77ea36be-59d4-4fdf-bd0a-d133e32b38bb', '5dec6ea4-5c2d-48ef-bfbf-49564bd8420f', 'cf6a9bb6-7cce-4829-a917-57b867933f51', 'fc210216-fe00-4793-af53-09c1009e9bbc'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:17:26 devstack sudo[93701]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_sp6lfxvndevstack@QuobyteHD" returned: 0 in 0.503s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:17:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:17:26 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:17:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-266145128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c96f377-d906-4cc9-a15b-dcf2c7d01bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3337b2401abd4a25913fd0ca0f1e6202',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:17:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:17:24Z,use_quota=True,user_id='89284c4afa514af49b01431af33bc569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:17:26 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Creating volume 9c96f377-d906-4cc9-a15b-dcf2c7d01bb9 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:17:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:17:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:17:26 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:17:26 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:17:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:17:26 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:17:26 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:17:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c96f377-d906-4cc9-a15b-dcf2c7d01bb9 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:26 devstack sudo[93714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c96f377-d906-4cc9-a15b-dcf2c7d01bb9 1073741824 Sep 03 11:17:26 devstack sudo[93714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2777d8a2-135a-41c5-8a29-310afe093296 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:17:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2777d8a2-135a-41c5-8a29-310afe093296 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:17:26 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2777d8a2-135a-41c5-8a29-310afe093296 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:17:26 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2777d8a2-135a-41c5-8a29-310afe093296 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:17:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2777d8a2-135a-41c5-8a29-310afe093296 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:17:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2777d8a2-135a-41c5-8a29-310afe093296 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:26 devstack sudo[93716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:17:26 devstack sudo[93716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:27 devstack sudo[93716]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2777d8a2-135a-41c5-8a29-310afe093296 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.330s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:27 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-2777d8a2-135a-41c5-8a29-310afe093296 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:17:27 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-2777d8a2-135a-41c5-8a29-310afe093296 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Deleted volume successfully. Sep 03 11:17:27 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2777d8a2-135a-41c5-8a29-310afe093296 tempest-VolumeQuotasNegativeTestJSON-1937358887 None] Lock "cinder-fd2c119e-7002-4d1d-8394-6ef3448fcbb9-delete_volume" released by "delete_volume" :: held 2.105s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:17:27 devstack sudo[93714]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c96f377-d906-4cc9-a15b-dcf2c7d01bb9 1073741824" returned: 0 in 0.740s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c96f377-d906-4cc9-a15b-dcf2c7d01bb9 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:27 devstack sudo[93725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c96f377-d906-4cc9-a15b-dcf2c7d01bb9 Sep 03 11:17:27 devstack sudo[93725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:27 devstack sudo[93725]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c96f377-d906-4cc9-a15b-dcf2c7d01bb9" returned: 0 in 0.466s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:17:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.284s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:17:28 devstack cinder-volume[87038]: DEBUG cinder.volume.volume_utils [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Attempting download of e1b59027-cb2e-4dc7-b35a-2801c7a053de ((None, [{'url': 'file:///opt/stack/data/glance/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'metadata': {}}])) to volume 9c96f377-d906-4cc9-a15b-dcf2c7d01bb9. {{(pid=87038) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 11:17:28 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89d0826-7d5e-4a0b-a1bd-512f051ca97a]: (4, 'raw') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:17:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1b59027-cb2e-4dc7-b35a-2801c7a053de_kkw5891o {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:28 devstack sudo[93729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1b59027-cb2e-4dc7-b35a-2801c7a053de_kkw5891o Sep 03 11:17:28 devstack sudo[93729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:28 devstack sudo[93729]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1b59027-cb2e-4dc7-b35a-2801c7a053de_kkw5891o" returned: 0 in 0.391s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1b59027-cb2e-4dc7-b35a-2801c7a053de_kkw5891o {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:28 devstack sudo[93733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1b59027-cb2e-4dc7-b35a-2801c7a053de_kkw5891o Sep 03 11:17:28 devstack sudo[93733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:29 devstack sudo[93733]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1b59027-cb2e-4dc7-b35a-2801c7a053de_kkw5891o" returned: 1 in 0.505s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1b59027-cb2e-4dc7-b35a-2801c7a053de_kkw5891o' failed. Not Retrying. {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:17:29 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d00f35e-c96f-414c-b501-e87597d97fdc]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:17:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_sp6lfxvndevstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:29 devstack sudo[93738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_sp6lfxvndevstack@QuobyteHD Sep 03 11:17:29 devstack sudo[93738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:29 devstack sudo[93738]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_sp6lfxvndevstack@QuobyteHD" returned: 0 in 0.499s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:29 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] e1b59027-cb2e-4dc7-b35a-2801c7a053de was qcow2, converting to qcow2 {{(pid=87038) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 11:17:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_sp6lfxvndevstack@QuobyteHD /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c96f377-d906-4cc9-a15b-dcf2c7d01bb9 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:29 devstack sudo[93743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_sp6lfxvndevstack@QuobyteHD /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c96f377-d906-4cc9-a15b-dcf2c7d01bb9 Sep 03 11:17:29 devstack sudo[93743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:31 devstack sudo[93743]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_sp6lfxvndevstack@QuobyteHD /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c96f377-d906-4cc9-a15b-dcf2c7d01bb9" returned: 0 in 2.245s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:31 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_sp6lfxvndevstack@QuobyteHD, size 112.00 MB, duration 2.25 sec, destination /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c96f377-d906-4cc9-a15b-dcf2c7d01bb9 {{(pid=87038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:17:31 devstack cinder-volume[87038]: INFO cinder.image.image_utils [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Converted 112.00 MB image at 49.87 MB/s Sep 03 11:17:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c96f377-d906-4cc9-a15b-dcf2c7d01bb9 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:31 devstack sudo[93757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c96f377-d906-4cc9-a15b-dcf2c7d01bb9 1G Sep 03 11:17:31 devstack sudo[93757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:32 devstack sudo[93757]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c96f377-d906-4cc9-a15b-dcf2c7d01bb9 1G" returned: 0 in 0.364s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:32 devstack cinder-volume[87038]: DEBUG cinder.volume.volume_utils [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Downloaded image e1b59027-cb2e-4dc7-b35a-2801c7a053de ((None, [{'url': 'file:///opt/stack/data/glance/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'metadata': {}}])) to volume 9c96f377-d906-4cc9-a15b-dcf2c7d01bb9 successfully. {{(pid=87038) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 11:17:32 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Temporary image e1b59027-cb2e-4dc7-b35a-2801c7a053de for user 89284c4afa514af49b01431af33bc569 is deleted. {{(pid=87038) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 11:17:32 devstack cinder-volume[87038]: DEBUG cinder.volume.volume_utils [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Marking volume 9c96f377-d906-4cc9-a15b-dcf2c7d01bb9 as bootable. {{(pid=87038) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 11:17:32 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Copying metadata from image e1b59027-cb2e-4dc7-b35a-2801c7a053de to 9c96f377-d906-4cc9-a15b-dcf2c7d01bb9. {{(pid=87038) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 11:17:32 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Creating volume glance metadata for volume 9c96f377-d906-4cc9-a15b-dcf2c7d01bb9 backed by image e1b59027-cb2e-4dc7-b35a-2801c7a053de with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87038) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 11:17:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a06928d-bed5-49b4-9d87-b23494e7402b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c96f377-d906-4cc9-a15b-dcf2c7d01bb9', 'volume_size': 1, 'image_id': 'e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72db6f41ce954ca898cc9f539a1cd3c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'created_at': datetime.datetime(2026, 9, 3, 9, 7, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 7, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:17:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0159edd-707a-4418-9b03-a6550bccd0c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:17:32 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Volume volume-9c96f377-d906-4cc9-a15b-dcf2c7d01bb9 (9c96f377-d906-4cc9-a15b-dcf2c7d01bb9): created successfully Sep 03 11:17:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0159edd-707a-4418-9b03-a6550bccd0c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:17:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Flow 'volume_create_manager' (343abd38-5600-41b0-8ee4-d4f09f480042) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:17:32 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-5135fc12-d972-450c-bc08-274afb837892 tempest-VolumesExtendTest-319710058 None] Created volume successfully. Sep 03 11:17:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b6f9f305-ab7a-444d-b840-caaf12ce9e95 tempest-VolumesExtendTest-319710058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:17:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b6f9f305-ab7a-444d-b840-caaf12ce9e95 tempest-VolumesExtendTest-319710058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:17:33 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[17816cfa-4b15-4bac-b688-ce8f8b04316a]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:17:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b6f9f305-ab7a-444d-b840-caaf12ce9e95 tempest-VolumesExtendTest-319710058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c96f377-d906-4cc9-a15b-dcf2c7d01bb9 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:33 devstack sudo[93762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c96f377-d906-4cc9-a15b-dcf2c7d01bb9 Sep 03 11:17:33 devstack sudo[93762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:33 devstack sudo[93762]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b6f9f305-ab7a-444d-b840-caaf12ce9e95 tempest-VolumesExtendTest-319710058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c96f377-d906-4cc9-a15b-dcf2c7d01bb9" returned: 0 in 0.544s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b6f9f305-ab7a-444d-b840-caaf12ce9e95 tempest-VolumesExtendTest-319710058 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c96f377-d906-4cc9-a15b-dcf2c7d01bb9 2G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b6f9f305-ab7a-444d-b840-caaf12ce9e95 tempest-VolumesExtendTest-319710058 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c96f377-d906-4cc9-a15b-dcf2c7d01bb9 2G" returned: 0 in 0.160s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b6f9f305-ab7a-444d-b840-caaf12ce9e95 tempest-VolumesExtendTest-319710058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.748s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:17:33 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-b6f9f305-ab7a-444d-b840-caaf12ce9e95 tempest-VolumesExtendTest-319710058 None] Extend volume completed successfully. Sep 03 11:17:34 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a53db794-554a-452f-adc2-05c38240613f tempest-VolumesExtendTest-319710058 None] Acquiring lock "cinder-9c96f377-d906-4cc9-a15b-dcf2c7d01bb9-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:17:34 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a53db794-554a-452f-adc2-05c38240613f tempest-VolumesExtendTest-319710058 None] Lock "cinder-9c96f377-d906-4cc9-a15b-dcf2c7d01bb9-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:17:34 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a53db794-554a-452f-adc2-05c38240613f tempest-VolumesExtendTest-319710058 None] Acquiring lock "cinder-quobyte-9c96f377-d906-4cc9-a15b-dcf2c7d01bb9" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:17:34 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a53db794-554a-452f-adc2-05c38240613f tempest-VolumesExtendTest-319710058 None] Lock "cinder-quobyte-9c96f377-d906-4cc9-a15b-dcf2c7d01bb9" acquired by "delete_volume" :: waited 0.022s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:17:34 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c8d050-e915-4cb8-a39a-2e29b1cd5a82]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:17:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a53db794-554a-452f-adc2-05c38240613f tempest-VolumesExtendTest-319710058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c96f377-d906-4cc9-a15b-dcf2c7d01bb9 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:34 devstack sudo[93778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c96f377-d906-4cc9-a15b-dcf2c7d01bb9 Sep 03 11:17:34 devstack sudo[93778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:35 devstack sudo[93778]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a53db794-554a-452f-adc2-05c38240613f tempest-VolumesExtendTest-319710058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c96f377-d906-4cc9-a15b-dcf2c7d01bb9" returned: 0 in 0.547s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a53db794-554a-452f-adc2-05c38240613f tempest-VolumesExtendTest-319710058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c96f377-d906-4cc9-a15b-dcf2c7d01bb9 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:35 devstack sudo[93783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c96f377-d906-4cc9-a15b-dcf2c7d01bb9 Sep 03 11:17:35 devstack sudo[93783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:35 devstack sudo[93783]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a53db794-554a-452f-adc2-05c38240613f tempest-VolumesExtendTest-319710058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c96f377-d906-4cc9-a15b-dcf2c7d01bb9" returned: 0 in 0.352s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a53db794-554a-452f-adc2-05c38240613f tempest-VolumesExtendTest-319710058 None] Lock "cinder-quobyte-9c96f377-d906-4cc9-a15b-dcf2c7d01bb9" released by "delete_volume" :: held 0.953s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:17:35 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-a53db794-554a-452f-adc2-05c38240613f tempest-VolumesExtendTest-319710058 None] Created reservations ['9aac01c6-332e-43ba-807d-3e7c4a06c396', '4dc69e68-acde-4578-9f9e-dfc09508a060', '719faa60-cb2c-40e7-a7c3-17db2f2887af', '69512b60-e1a4-45c7-a50f-feeda8a76aa8'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:17:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a53db794-554a-452f-adc2-05c38240613f tempest-VolumesExtendTest-319710058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:17:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a53db794-554a-452f-adc2-05c38240613f tempest-VolumesExtendTest-319710058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:17:35 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a53db794-554a-452f-adc2-05c38240613f tempest-VolumesExtendTest-319710058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:17:35 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a53db794-554a-452f-adc2-05c38240613f tempest-VolumesExtendTest-319710058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:17:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a53db794-554a-452f-adc2-05c38240613f tempest-VolumesExtendTest-319710058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:17:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a53db794-554a-452f-adc2-05c38240613f tempest-VolumesExtendTest-319710058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:35 devstack sudo[93786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:17:35 devstack sudo[93786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:36 devstack sudo[93786]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a53db794-554a-452f-adc2-05c38240613f tempest-VolumesExtendTest-319710058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.360s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:36 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-a53db794-554a-452f-adc2-05c38240613f tempest-VolumesExtendTest-319710058 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:17:36 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-a53db794-554a-452f-adc2-05c38240613f tempest-VolumesExtendTest-319710058 None] Deleted volume successfully. Sep 03 11:17:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a53db794-554a-452f-adc2-05c38240613f tempest-VolumesExtendTest-319710058 None] Lock "cinder-9c96f377-d906-4cc9-a15b-dcf2c7d01bb9-delete_volume" released by "delete_volume" :: held 1.629s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:17:37 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac6e750e-d8b6-4156-bb3e-d6a7c11134ef tempest-VolumesExtendTest-319710058 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:17:37 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ac6e750e-d8b6-4156-bb3e-d6a7c11134ef tempest-VolumesExtendTest-319710058 None] Flow 'volume_create_manager' (f27ddd28-a4f3-463a-8315-2e2336bbb8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:17:37 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ac6e750e-d8b6-4156-bb3e-d6a7c11134ef tempest-VolumesExtendTest-319710058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dac9ff6a-2193-4bf2-b377-7592568b3cea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:17:37 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ac6e750e-d8b6-4156-bb3e-d6a7c11134ef tempest-VolumesExtendTest-319710058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dac9ff6a-2193-4bf2-b377-7592568b3cea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1772616834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a4fc43c-894c-4acc-ad37-4e649ab05eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3337b2401abd4a25913fd0ca0f1e6202',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:17:38Z,use_quota=True,user_id='89284c4afa514af49b01431af33bc569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:17:37 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ac6e750e-d8b6-4156-bb3e-d6a7c11134ef tempest-VolumesExtendTest-319710058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7457ac3c-84a3-4d5b-85f1-21816f5b07cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:17:37 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ac6e750e-d8b6-4156-bb3e-d6a7c11134ef tempest-VolumesExtendTest-319710058 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7457ac3c-84a3-4d5b-85f1-21816f5b07cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:17:37 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ac6e750e-d8b6-4156-bb3e-d6a7c11134ef tempest-VolumesExtendTest-319710058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19a8fa72-1f36-4820-bc77-51baf6523dc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:17:37 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ac6e750e-d8b6-4156-bb3e-d6a7c11134ef tempest-VolumesExtendTest-319710058 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19a8fa72-1f36-4820-bc77-51baf6523dc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a4fc43c-894c-4acc-ad37-4e649ab05eb1', 'volume_name': 'volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:17:37 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ac6e750e-d8b6-4156-bb3e-d6a7c11134ef tempest-VolumesExtendTest-319710058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffd8df23-accb-4071-b2d7-6d5d6c2cd048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:17:37 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ac6e750e-d8b6-4156-bb3e-d6a7c11134ef tempest-VolumesExtendTest-319710058 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffd8df23-accb-4071-b2d7-6d5d6c2cd048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:17:37 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ac6e750e-d8b6-4156-bb3e-d6a7c11134ef tempest-VolumesExtendTest-319710058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9db1c5e5-bef3-4a88-8546-612535301694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:17:37 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-ac6e750e-d8b6-4156-bb3e-d6a7c11134ef tempest-VolumesExtendTest-319710058 None] Volume 1a4fc43c-894c-4acc-ad37-4e649ab05eb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1', 'volume_size': 1} Sep 03 11:17:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ac6e750e-d8b6-4156-bb3e-d6a7c11134ef tempest-VolumesExtendTest-319710058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:17:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ac6e750e-d8b6-4156-bb3e-d6a7c11134ef tempest-VolumesExtendTest-319710058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:17:37 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ac6e750e-d8b6-4156-bb3e-d6a7c11134ef tempest-VolumesExtendTest-319710058 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:17:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1772616834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a4fc43c-894c-4acc-ad37-4e649ab05eb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3337b2401abd4a25913fd0ca0f1e6202',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:17:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:17:38Z,use_quota=True,user_id='89284c4afa514af49b01431af33bc569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:17:37 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-ac6e750e-d8b6-4156-bb3e-d6a7c11134ef tempest-VolumesExtendTest-319710058 None] Creating volume 1a4fc43c-894c-4acc-ad37-4e649ab05eb1 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:17:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ac6e750e-d8b6-4156-bb3e-d6a7c11134ef tempest-VolumesExtendTest-319710058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:17:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ac6e750e-d8b6-4156-bb3e-d6a7c11134ef tempest-VolumesExtendTest-319710058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:17:37 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ac6e750e-d8b6-4156-bb3e-d6a7c11134ef tempest-VolumesExtendTest-319710058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:17:37 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ac6e750e-d8b6-4156-bb3e-d6a7c11134ef tempest-VolumesExtendTest-319710058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:17:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ac6e750e-d8b6-4156-bb3e-d6a7c11134ef tempest-VolumesExtendTest-319710058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:17:37 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ac6e750e-d8b6-4156-bb3e-d6a7c11134ef tempest-VolumesExtendTest-319710058 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:17:37 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-ac6e750e-d8b6-4156-bb3e-d6a7c11134ef tempest-VolumesExtendTest-319710058 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:17:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ac6e750e-d8b6-4156-bb3e-d6a7c11134ef tempest-VolumesExtendTest-319710058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:37 devstack sudo[93790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1 1073741824 Sep 03 11:17:37 devstack sudo[93790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:38 devstack sudo[93790]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ac6e750e-d8b6-4156-bb3e-d6a7c11134ef tempest-VolumesExtendTest-319710058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1 1073741824" returned: 0 in 0.520s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ac6e750e-d8b6-4156-bb3e-d6a7c11134ef tempest-VolumesExtendTest-319710058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:38 devstack sudo[93796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1 Sep 03 11:17:38 devstack sudo[93796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:38 devstack sudo[93796]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ac6e750e-d8b6-4156-bb3e-d6a7c11134ef tempest-VolumesExtendTest-319710058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1" returned: 0 in 0.446s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:38 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ac6e750e-d8b6-4156-bb3e-d6a7c11134ef tempest-VolumesExtendTest-319710058 None] <== create_volume: return (1013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:17:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ac6e750e-d8b6-4156-bb3e-d6a7c11134ef tempest-VolumesExtendTest-319710058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:17:38 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ac6e750e-d8b6-4156-bb3e-d6a7c11134ef tempest-VolumesExtendTest-319710058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9db1c5e5-bef3-4a88-8546-612535301694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:17:38 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ac6e750e-d8b6-4156-bb3e-d6a7c11134ef tempest-VolumesExtendTest-319710058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73709514-ca02-45d9-9371-a6f83fb1002b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:17:38 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-ac6e750e-d8b6-4156-bb3e-d6a7c11134ef tempest-VolumesExtendTest-319710058 None] Volume volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1 (1a4fc43c-894c-4acc-ad37-4e649ab05eb1): created successfully Sep 03 11:17:38 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ac6e750e-d8b6-4156-bb3e-d6a7c11134ef tempest-VolumesExtendTest-319710058 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73709514-ca02-45d9-9371-a6f83fb1002b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:17:38 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ac6e750e-d8b6-4156-bb3e-d6a7c11134ef tempest-VolumesExtendTest-319710058 None] Flow 'volume_create_manager' (f27ddd28-a4f3-463a-8315-2e2336bbb8c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:17:38 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-ac6e750e-d8b6-4156-bb3e-d6a7c11134ef tempest-VolumesExtendTest-319710058 None] Created volume successfully. Sep 03 11:17:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9c1eea27-93ad-4741-8772-dcc34acc1b0c tempest-VolumesExtendTest-319710058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:17:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9c1eea27-93ad-4741-8772-dcc34acc1b0c tempest-VolumesExtendTest-319710058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:17:40 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-9c1eea27-93ad-4741-8772-dcc34acc1b0c tempest-VolumesExtendTest-319710058 None] Creating offline snapshot c1adf2af-a1ce-44b3-8a70-565a0815f19d of volume 1a4fc43c-894c-4acc-ad37-4e649ab05eb1 {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:17:40 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f00e435-425d-418b-971c-857cee9d0f90]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:17:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9c1eea27-93ad-4741-8772-dcc34acc1b0c tempest-VolumesExtendTest-319710058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:40 devstack sudo[93800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1 Sep 03 11:17:40 devstack sudo[93800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:40 devstack sudo[93800]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9c1eea27-93ad-4741-8772-dcc34acc1b0c tempest-VolumesExtendTest-319710058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1" returned: 0 in 0.508s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9c1eea27-93ad-4741-8772-dcc34acc1b0c tempest-VolumesExtendTest-319710058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1.c1adf2af-a1ce-44b3-8a70-565a0815f19d 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:40 devstack sudo[93806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1.c1adf2af-a1ce-44b3-8a70-565a0815f19d 1G Sep 03 11:17:40 devstack sudo[93806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:41 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-4672a984-0d39-40c2-87f3-c0d92cfdf432 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:17:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4672a984-0d39-40c2-87f3-c0d92cfdf432 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Flow 'volume_create_manager' (b2ad5859-667b-4382-831d-398c506f4177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:17:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4672a984-0d39-40c2-87f3-c0d92cfdf432 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e61613-4831-4d7e-b9ed-84a4cafaa1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:17:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4672a984-0d39-40c2-87f3-c0d92cfdf432 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e61613-4831-4d7e-b9ed-84a4cafaa1f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2096828748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0fa75ab-beeb-4364-9f74-c8284fbb25ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db8c7834e8f04b8ba7f1926c5eee5b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:17:41Z,use_quota=True,user_id='99556a8b4334493b9632cc2e4fb2dbdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:17:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4672a984-0d39-40c2-87f3-c0d92cfdf432 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dac526e-ffe4-4aad-a453-74ffb880271d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:17:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4672a984-0d39-40c2-87f3-c0d92cfdf432 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4dac526e-ffe4-4aad-a453-74ffb880271d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:17:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4672a984-0d39-40c2-87f3-c0d92cfdf432 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca657425-d1d7-4339-9743-09668c9ce1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:17:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4672a984-0d39-40c2-87f3-c0d92cfdf432 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca657425-d1d7-4339-9743-09668c9ce1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0fa75ab-beeb-4364-9f74-c8284fbb25ec', 'volume_name': 'volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:17:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4672a984-0d39-40c2-87f3-c0d92cfdf432 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a9ae5d3-caf2-4e59-ae51-d93a8cbc9406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:17:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4672a984-0d39-40c2-87f3-c0d92cfdf432 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a9ae5d3-caf2-4e59-ae51-d93a8cbc9406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:17:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4672a984-0d39-40c2-87f3-c0d92cfdf432 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce14dac0-a6c8-493b-84f2-76b7942cfa43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:17:41 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-4672a984-0d39-40c2-87f3-c0d92cfdf432 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Volume b0fa75ab-beeb-4364-9f74-c8284fbb25ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec', 'volume_size': 1} Sep 03 11:17:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4672a984-0d39-40c2-87f3-c0d92cfdf432 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:17:41 devstack sudo[93806]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9c1eea27-93ad-4741-8772-dcc34acc1b0c tempest-VolumesExtendTest-319710058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1.c1adf2af-a1ce-44b3-8a70-565a0815f19d 1G" returned: 0 in 0.621s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9c1eea27-93ad-4741-8772-dcc34acc1b0c tempest-VolumesExtendTest-319710058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1.c1adf2af-a1ce-44b3-8a70-565a0815f19d {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:41 devstack sudo[93814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1.c1adf2af-a1ce-44b3-8a70-565a0815f19d Sep 03 11:17:41 devstack sudo[93814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:41 devstack sudo[93814]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9c1eea27-93ad-4741-8772-dcc34acc1b0c tempest-VolumesExtendTest-319710058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1.c1adf2af-a1ce-44b3-8a70-565a0815f19d" returned: 0 in 0.308s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:41 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-9c1eea27-93ad-4741-8772-dcc34acc1b0c tempest-VolumesExtendTest-319710058 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1.c1adf2af-a1ce-44b3-8a70-565a0815f19d is being set with open permissions: ugo+rw Sep 03 11:17:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9c1eea27-93ad-4741-8772-dcc34acc1b0c tempest-VolumesExtendTest-319710058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1.c1adf2af-a1ce-44b3-8a70-565a0815f19d {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:41 devstack sudo[93823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1.c1adf2af-a1ce-44b3-8a70-565a0815f19d Sep 03 11:17:41 devstack sudo[93823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:42 devstack sudo[93823]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9c1eea27-93ad-4741-8772-dcc34acc1b0c tempest-VolumesExtendTest-319710058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1.c1adf2af-a1ce-44b3-8a70-565a0815f19d" returned: 0 in 0.319s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9c1eea27-93ad-4741-8772-dcc34acc1b0c tempest-VolumesExtendTest-319710058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:42 devstack sudo[93830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1.info Sep 03 11:17:42 devstack sudo[93830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:42 devstack sudo[93830]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9c1eea27-93ad-4741-8772-dcc34acc1b0c tempest-VolumesExtendTest-319710058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1.info" returned: 0 in 0.298s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:42 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-9c1eea27-93ad-4741-8772-dcc34acc1b0c tempest-VolumesExtendTest-319710058 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1.info is being set with open permissions: ugo+rw Sep 03 11:17:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9c1eea27-93ad-4741-8772-dcc34acc1b0c tempest-VolumesExtendTest-319710058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:42 devstack sudo[93833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1.info Sep 03 11:17:42 devstack sudo[93833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:42 devstack sudo[93833]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9c1eea27-93ad-4741-8772-dcc34acc1b0c tempest-VolumesExtendTest-319710058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1.info" returned: 0 in 0.256s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9c1eea27-93ad-4741-8772-dcc34acc1b0c tempest-VolumesExtendTest-319710058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.430s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:17:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4672a984-0d39-40c2-87f3-c0d92cfdf432 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.371s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:17:42 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4672a984-0d39-40c2-87f3-c0d92cfdf432 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:17:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2096828748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0fa75ab-beeb-4364-9f74-c8284fbb25ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db8c7834e8f04b8ba7f1926c5eee5b0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:17:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:17:41Z,use_quota=True,user_id='99556a8b4334493b9632cc2e4fb2dbdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:17:42 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-4672a984-0d39-40c2-87f3-c0d92cfdf432 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Creating volume b0fa75ab-beeb-4364-9f74-c8284fbb25ec {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:17:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4672a984-0d39-40c2-87f3-c0d92cfdf432 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:17:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4672a984-0d39-40c2-87f3-c0d92cfdf432 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:17:42 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4672a984-0d39-40c2-87f3-c0d92cfdf432 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:17:42 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4672a984-0d39-40c2-87f3-c0d92cfdf432 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:17:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4672a984-0d39-40c2-87f3-c0d92cfdf432 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:17:42 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4672a984-0d39-40c2-87f3-c0d92cfdf432 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:17:42 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-4672a984-0d39-40c2-87f3-c0d92cfdf432 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:17:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4672a984-0d39-40c2-87f3-c0d92cfdf432 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:42 devstack sudo[93836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec 1073741824 Sep 03 11:17:42 devstack sudo[93836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:42 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-9c1eea27-93ad-4741-8772-dcc34acc1b0c tempest-VolumesExtendTest-319710058 None] Create snapshot completed successfully Sep 03 11:17:43 devstack sudo[93836]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4672a984-0d39-40c2-87f3-c0d92cfdf432 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec 1073741824" returned: 0 in 0.416s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4672a984-0d39-40c2-87f3-c0d92cfdf432 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:43 devstack sudo[93842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec Sep 03 11:17:43 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:43 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4672a984-0d39-40c2-87f3-c0d92cfdf432 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec" returned: 0 in 0.293s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4672a984-0d39-40c2-87f3-c0d92cfdf432 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:17:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4672a984-0d39-40c2-87f3-c0d92cfdf432 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:17:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4672a984-0d39-40c2-87f3-c0d92cfdf432 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce14dac0-a6c8-493b-84f2-76b7942cfa43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:17:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4672a984-0d39-40c2-87f3-c0d92cfdf432 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ef955f-b4ff-4e11-85dc-e9b37c850b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:17:43 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-4672a984-0d39-40c2-87f3-c0d92cfdf432 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Volume volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec (b0fa75ab-beeb-4364-9f74-c8284fbb25ec): created successfully Sep 03 11:17:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4672a984-0d39-40c2-87f3-c0d92cfdf432 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82ef955f-b4ff-4e11-85dc-e9b37c850b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:17:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4672a984-0d39-40c2-87f3-c0d92cfdf432 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Flow 'volume_create_manager' (b2ad5859-667b-4382-831d-398c506f4177) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:17:43 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-4672a984-0d39-40c2-87f3-c0d92cfdf432 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Created volume successfully. Sep 03 11:17:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1932fb69-41eb-49a6-a828-01fc86595045 tempest-VolumesExtendTest-319710058 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:17:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1932fb69-41eb-49a6-a828-01fc86595045 tempest-VolumesExtendTest-319710058 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:17:43 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d35b778-8f22-4342-81b2-fc336c3acf6d]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:17:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1932fb69-41eb-49a6-a828-01fc86595045 tempest-VolumesExtendTest-319710058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:43 devstack sudo[93845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1 Sep 03 11:17:43 devstack sudo[93845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:44 devstack sudo[93845]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1932fb69-41eb-49a6-a828-01fc86595045 tempest-VolumesExtendTest-319710058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1" returned: 0 in 0.387s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1932fb69-41eb-49a6-a828-01fc86595045 tempest-VolumesExtendTest-319710058 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1.c1adf2af-a1ce-44b3-8a70-565a0815f19d 2G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1932fb69-41eb-49a6-a828-01fc86595045 tempest-VolumesExtendTest-319710058 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1.c1adf2af-a1ce-44b3-8a70-565a0815f19d 2G" returned: 0 in 0.163s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1932fb69-41eb-49a6-a828-01fc86595045 tempest-VolumesExtendTest-319710058 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.583s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:17:44 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-1932fb69-41eb-49a6-a828-01fc86595045 tempest-VolumesExtendTest-319710058 None] Extend volume completed successfully. Sep 03 11:17:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7a70f9d8-af4d-4174-9381-83915c0ab7b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:17:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7a70f9d8-af4d-4174-9381-83915c0ab7b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:17:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-7a70f9d8-af4d-4174-9381-83915c0ab7b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Creating offline snapshot bb205949-dfcc-4653-858d-100a41922660 of volume b0fa75ab-beeb-4364-9f74-c8284fbb25ec {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:17:44 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[952d848f-107a-4170-a4c9-d185aef5cb41]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:17:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7a70f9d8-af4d-4174-9381-83915c0ab7b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:44 devstack sudo[93854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec Sep 03 11:17:44 devstack sudo[93854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:44 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-367d7be9-4014-454a-bc95-10358cdb2285 tempest-VolumesExtendTest-319710058 None] Acquiring lock "cinder-c1adf2af-a1ce-44b3-8a70-565a0815f19d-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:17:44 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-367d7be9-4014-454a-bc95-10358cdb2285 tempest-VolumesExtendTest-319710058 None] Lock "cinder-c1adf2af-a1ce-44b3-8a70-565a0815f19d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.068s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:17:44 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-367d7be9-4014-454a-bc95-10358cdb2285 tempest-VolumesExtendTest-319710058 None] Acquiring lock "cinder-quobyte-1a4fc43c-894c-4acc-ad37-4e649ab05eb1" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:17:45 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-367d7be9-4014-454a-bc95-10358cdb2285 tempest-VolumesExtendTest-319710058 None] Lock "cinder-quobyte-1a4fc43c-894c-4acc-ad37-4e649ab05eb1" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:17:45 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-367d7be9-4014-454a-bc95-10358cdb2285 tempest-VolumesExtendTest-319710058 None] Acquiring lock "cinder-quobyte-c1adf2af-a1ce-44b3-8a70-565a0815f19d" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:17:45 devstack sudo[93854]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7a70f9d8-af4d-4174-9381-83915c0ab7b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec" returned: 0 in 0.393s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7a70f9d8-af4d-4174-9381-83915c0ab7b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec.bb205949-dfcc-4653-858d-100a41922660 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:45 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-367d7be9-4014-454a-bc95-10358cdb2285 tempest-VolumesExtendTest-319710058 None] Lock "cinder-quobyte-c1adf2af-a1ce-44b3-8a70-565a0815f19d" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:17:45 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-367d7be9-4014-454a-bc95-10358cdb2285 tempest-VolumesExtendTest-319710058 None] Deleting offline snapshot c1adf2af-a1ce-44b3-8a70-565a0815f19d of volume 1a4fc43c-894c-4acc-ad37-4e649ab05eb1 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:17:45 devstack sudo[93859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec.bb205949-dfcc-4653-858d-100a41922660 1G Sep 03 11:17:45 devstack sudo[93859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:45 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-367d7be9-4014-454a-bc95-10358cdb2285 tempest-VolumesExtendTest-319710058 None] snapshot_file for this snap is: volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1.c1adf2af-a1ce-44b3-8a70-565a0815f19d {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:17:45 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c89df8a-772c-4ecc-80cb-c45801d5a60a]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:17:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-367d7be9-4014-454a-bc95-10358cdb2285 tempest-VolumesExtendTest-319710058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1.c1adf2af-a1ce-44b3-8a70-565a0815f19d {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:45 devstack sudo[93861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1.c1adf2af-a1ce-44b3-8a70-565a0815f19d Sep 03 11:17:45 devstack sudo[93861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:45 devstack sudo[93859]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7a70f9d8-af4d-4174-9381-83915c0ab7b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec.bb205949-dfcc-4653-858d-100a41922660 1G" returned: 0 in 0.459s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7a70f9d8-af4d-4174-9381-83915c0ab7b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec.bb205949-dfcc-4653-858d-100a41922660 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:45 devstack sudo[93870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec.bb205949-dfcc-4653-858d-100a41922660 Sep 03 11:17:45 devstack sudo[93870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:45 devstack sudo[93861]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-367d7be9-4014-454a-bc95-10358cdb2285 tempest-VolumesExtendTest-319710058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1.c1adf2af-a1ce-44b3-8a70-565a0815f19d" returned: 0 in 0.411s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:45 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-367d7be9-4014-454a-bc95-10358cdb2285 tempest-VolumesExtendTest-319710058 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:17:45 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[befd5c74-5d3e-43b7-9677-a92bf2daadba]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:17:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-367d7be9-4014-454a-bc95-10358cdb2285 tempest-VolumesExtendTest-319710058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:45 devstack sudo[93872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1 Sep 03 11:17:45 devstack sudo[93872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:45 devstack sudo[93870]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7a70f9d8-af4d-4174-9381-83915c0ab7b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec.bb205949-dfcc-4653-858d-100a41922660" returned: 0 in 0.324s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:45 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-7a70f9d8-af4d-4174-9381-83915c0ab7b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec.bb205949-dfcc-4653-858d-100a41922660 is being set with open permissions: ugo+rw Sep 03 11:17:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7a70f9d8-af4d-4174-9381-83915c0ab7b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec.bb205949-dfcc-4653-858d-100a41922660 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:45 devstack sudo[93879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec.bb205949-dfcc-4653-858d-100a41922660 Sep 03 11:17:45 devstack sudo[93879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:45 devstack sudo[93872]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-367d7be9-4014-454a-bc95-10358cdb2285 tempest-VolumesExtendTest-319710058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1" returned: 0 in 0.389s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-367d7be9-4014-454a-bc95-10358cdb2285 tempest-VolumesExtendTest-319710058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1.c1adf2af-a1ce-44b3-8a70-565a0815f19d {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:45 devstack sudo[93884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1.c1adf2af-a1ce-44b3-8a70-565a0815f19d Sep 03 11:17:45 devstack sudo[93884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:46 devstack sudo[93879]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7a70f9d8-af4d-4174-9381-83915c0ab7b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec.bb205949-dfcc-4653-858d-100a41922660" returned: 0 in 0.270s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7a70f9d8-af4d-4174-9381-83915c0ab7b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:46 devstack sudo[93887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec.info Sep 03 11:17:46 devstack sudo[93887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:46 devstack sudo[93884]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-367d7be9-4014-454a-bc95-10358cdb2285 tempest-VolumesExtendTest-319710058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1.c1adf2af-a1ce-44b3-8a70-565a0815f19d" returned: 0 in 0.376s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-367d7be9-4014-454a-bc95-10358cdb2285 tempest-VolumesExtendTest-319710058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1.c1adf2af-a1ce-44b3-8a70-565a0815f19d {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:46 devstack sudo[93893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1.c1adf2af-a1ce-44b3-8a70-565a0815f19d Sep 03 11:17:46 devstack sudo[93893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:46 devstack sudo[93887]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7a70f9d8-af4d-4174-9381-83915c0ab7b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec.info" returned: 0 in 0.265s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:46 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-7a70f9d8-af4d-4174-9381-83915c0ab7b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec.info is being set with open permissions: ugo+rw Sep 03 11:17:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7a70f9d8-af4d-4174-9381-83915c0ab7b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:46 devstack sudo[93896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec.info Sep 03 11:17:46 devstack sudo[93896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:46 devstack sudo[93893]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-367d7be9-4014-454a-bc95-10358cdb2285 tempest-VolumesExtendTest-319710058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1.c1adf2af-a1ce-44b3-8a70-565a0815f19d" returned: 0 in 0.269s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:46 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-367d7be9-4014-454a-bc95-10358cdb2285 tempest-VolumesExtendTest-319710058 None] Lock "cinder-quobyte-c1adf2af-a1ce-44b3-8a70-565a0815f19d" released by "_delete_snapshot" :: held 1.588s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:17:46 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-367d7be9-4014-454a-bc95-10358cdb2285 tempest-VolumesExtendTest-319710058 None] Lock "cinder-quobyte-1a4fc43c-894c-4acc-ad37-4e649ab05eb1" released by "delete_snapshot" :: held 1.626s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:17:46 devstack sudo[93896]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7a70f9d8-af4d-4174-9381-83915c0ab7b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec.info" returned: 0 in 0.264s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7a70f9d8-af4d-4174-9381-83915c0ab7b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.065s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:17:46 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-7a70f9d8-af4d-4174-9381-83915c0ab7b6 tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Create snapshot completed successfully Sep 03 11:17:46 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-367d7be9-4014-454a-bc95-10358cdb2285 tempest-VolumesExtendTest-319710058 None] Created reservations ['0ca7a087-7e01-4646-84b8-9f5d2529076e', '06106515-2e78-4a92-a603-f37928b0317f', '28b3cb94-a393-4e61-ae40-ddc1afe52dec', '0b088f16-bfbb-437d-ab17-4e28e780672d'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:17:46 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-367d7be9-4014-454a-bc95-10358cdb2285 tempest-VolumesExtendTest-319710058 None] Delete snapshot completed successfully. Sep 03 11:17:46 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-367d7be9-4014-454a-bc95-10358cdb2285 tempest-VolumesExtendTest-319710058 None] Lock "cinder-c1adf2af-a1ce-44b3-8a70-565a0815f19d-delete_snapshot" released by "delete_snapshot" :: held 1.795s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:17:47 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-87130ea8-35ee-43a6-8a9b-2cc3f11c4345 tempest-VolumesExtendTest-319710058 None] Acquiring lock "cinder-1a4fc43c-894c-4acc-ad37-4e649ab05eb1-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:17:47 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-87130ea8-35ee-43a6-8a9b-2cc3f11c4345 tempest-VolumesExtendTest-319710058 None] Lock "cinder-1a4fc43c-894c-4acc-ad37-4e649ab05eb1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:17:47 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-87130ea8-35ee-43a6-8a9b-2cc3f11c4345 tempest-VolumesExtendTest-319710058 None] Acquiring lock "cinder-quobyte-1a4fc43c-894c-4acc-ad37-4e649ab05eb1" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:17:47 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-87130ea8-35ee-43a6-8a9b-2cc3f11c4345 tempest-VolumesExtendTest-319710058 None] Lock "cinder-quobyte-1a4fc43c-894c-4acc-ad37-4e649ab05eb1" acquired by "delete_volume" :: waited 0.017s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:17:47 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dabe9b8-ce58-405a-af86-4f6b077c6157]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:17:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-87130ea8-35ee-43a6-8a9b-2cc3f11c4345 tempest-VolumesExtendTest-319710058 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:47 devstack sudo[93900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1 Sep 03 11:17:47 devstack sudo[93900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:47 devstack sudo[93900]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-87130ea8-35ee-43a6-8a9b-2cc3f11c4345 tempest-VolumesExtendTest-319710058 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1" returned: 0 in 0.464s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-87130ea8-35ee-43a6-8a9b-2cc3f11c4345 tempest-VolumesExtendTest-319710058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:47 devstack sudo[93909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1 Sep 03 11:17:47 devstack sudo[93909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:48 devstack sudo[93909]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-87130ea8-35ee-43a6-8a9b-2cc3f11c4345 tempest-VolumesExtendTest-319710058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1a4fc43c-894c-4acc-ad37-4e649ab05eb1" returned: 0 in 0.446s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:48 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-87130ea8-35ee-43a6-8a9b-2cc3f11c4345 tempest-VolumesExtendTest-319710058 None] Lock "cinder-quobyte-1a4fc43c-894c-4acc-ad37-4e649ab05eb1" released by "delete_volume" :: held 1.026s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:17:48 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-87130ea8-35ee-43a6-8a9b-2cc3f11c4345 tempest-VolumesExtendTest-319710058 None] Created reservations ['46683755-ab48-47c9-a620-fa0a677d96dc', '5b227574-c2b3-4de8-90bd-4aed9db3838a', '42e760d4-b31c-443c-bc5f-040d6363bed5', 'ad3475ca-a011-4e07-801c-2dc0815dac43'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:17:48 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8f15f5e6-432a-4552-8a2f-1f2c08beb1ae tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Acquiring lock "cinder-bb205949-dfcc-4653-858d-100a41922660-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:17:48 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8f15f5e6-432a-4552-8a2f-1f2c08beb1ae tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Lock "cinder-bb205949-dfcc-4653-858d-100a41922660-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:17:48 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8f15f5e6-432a-4552-8a2f-1f2c08beb1ae tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Acquiring lock "cinder-quobyte-b0fa75ab-beeb-4364-9f74-c8284fbb25ec" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:17:48 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8f15f5e6-432a-4552-8a2f-1f2c08beb1ae tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Lock "cinder-quobyte-b0fa75ab-beeb-4364-9f74-c8284fbb25ec" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:17:48 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8f15f5e6-432a-4552-8a2f-1f2c08beb1ae tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Acquiring lock "cinder-quobyte-bb205949-dfcc-4653-858d-100a41922660" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:17:48 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8f15f5e6-432a-4552-8a2f-1f2c08beb1ae tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Lock "cinder-quobyte-bb205949-dfcc-4653-858d-100a41922660" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:17:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-8f15f5e6-432a-4552-8a2f-1f2c08beb1ae tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Deleting offline snapshot bb205949-dfcc-4653-858d-100a41922660 of volume b0fa75ab-beeb-4364-9f74-c8284fbb25ec {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:17:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-8f15f5e6-432a-4552-8a2f-1f2c08beb1ae tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] snapshot_file for this snap is: volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec.bb205949-dfcc-4653-858d-100a41922660 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:17:48 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2cd2e12-86e8-455d-80a1-a4e968f9da44]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:17:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8f15f5e6-432a-4552-8a2f-1f2c08beb1ae tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec.bb205949-dfcc-4653-858d-100a41922660 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-87130ea8-35ee-43a6-8a9b-2cc3f11c4345 tempest-VolumesExtendTest-319710058 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:17:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-87130ea8-35ee-43a6-8a9b-2cc3f11c4345 tempest-VolumesExtendTest-319710058 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:17:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-87130ea8-35ee-43a6-8a9b-2cc3f11c4345 tempest-VolumesExtendTest-319710058 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:17:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-87130ea8-35ee-43a6-8a9b-2cc3f11c4345 tempest-VolumesExtendTest-319710058 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:17:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-87130ea8-35ee-43a6-8a9b-2cc3f11c4345 tempest-VolumesExtendTest-319710058 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:17:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-87130ea8-35ee-43a6-8a9b-2cc3f11c4345 tempest-VolumesExtendTest-319710058 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:48 devstack sudo[93917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:17:48 devstack sudo[93917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:48 devstack sudo[93916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec.bb205949-dfcc-4653-858d-100a41922660 Sep 03 11:17:48 devstack sudo[93916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:49 devstack sudo[93916]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:49 devstack sudo[93917]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8f15f5e6-432a-4552-8a2f-1f2c08beb1ae tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec.bb205949-dfcc-4653-858d-100a41922660" returned: 0 in 0.529s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:49 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-8f15f5e6-432a-4552-8a2f-1f2c08beb1ae tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:17:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-87130ea8-35ee-43a6-8a9b-2cc3f11c4345 tempest-VolumesExtendTest-319710058 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.535s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:49 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-87130ea8-35ee-43a6-8a9b-2cc3f11c4345 tempest-VolumesExtendTest-319710058 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:17:49 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-87130ea8-35ee-43a6-8a9b-2cc3f11c4345 tempest-VolumesExtendTest-319710058 None] Deleted volume successfully. Sep 03 11:17:49 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbbdd6b-ca6d-4b30-aeb9-24ea6ceffbcf]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:17:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8f15f5e6-432a-4552-8a2f-1f2c08beb1ae tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:49 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-87130ea8-35ee-43a6-8a9b-2cc3f11c4345 tempest-VolumesExtendTest-319710058 None] Lock "cinder-1a4fc43c-894c-4acc-ad37-4e649ab05eb1-delete_volume" released by "delete_volume" :: held 2.023s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:17:49 devstack sudo[93940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec Sep 03 11:17:49 devstack sudo[93940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:49 devstack sudo[93940]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8f15f5e6-432a-4552-8a2f-1f2c08beb1ae tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec" returned: 0 in 0.537s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8f15f5e6-432a-4552-8a2f-1f2c08beb1ae tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec.bb205949-dfcc-4653-858d-100a41922660 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:49 devstack sudo[93951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec.bb205949-dfcc-4653-858d-100a41922660 Sep 03 11:17:49 devstack sudo[93951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:50 devstack sudo[93951]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8f15f5e6-432a-4552-8a2f-1f2c08beb1ae tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec.bb205949-dfcc-4653-858d-100a41922660" returned: 0 in 0.444s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8f15f5e6-432a-4552-8a2f-1f2c08beb1ae tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec.bb205949-dfcc-4653-858d-100a41922660 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:50 devstack sudo[93957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec.bb205949-dfcc-4653-858d-100a41922660 Sep 03 11:17:50 devstack sudo[93957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:50 devstack sudo[93957]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8f15f5e6-432a-4552-8a2f-1f2c08beb1ae tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec.bb205949-dfcc-4653-858d-100a41922660" returned: 0 in 0.355s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:50 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8f15f5e6-432a-4552-8a2f-1f2c08beb1ae tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Lock "cinder-quobyte-bb205949-dfcc-4653-858d-100a41922660" released by "_delete_snapshot" :: held 2.067s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:17:50 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8f15f5e6-432a-4552-8a2f-1f2c08beb1ae tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Lock "cinder-quobyte-b0fa75ab-beeb-4364-9f74-c8284fbb25ec" released by "delete_snapshot" :: held 2.108s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:17:50 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-8f15f5e6-432a-4552-8a2f-1f2c08beb1ae tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Created reservations ['aade260f-bc34-44a8-b6a6-2afd52973909', 'a7f2baaa-0195-4589-b1fb-187f449e0dcb', 'ab0ab1d6-1ea4-4712-a81d-bfe8c2c08deb', '50510b4f-09d4-4905-b088-a196f349896f'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:17:50 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-8f15f5e6-432a-4552-8a2f-1f2c08beb1ae tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Delete snapshot completed successfully. Sep 03 11:17:50 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8f15f5e6-432a-4552-8a2f-1f2c08beb1ae tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Lock "cinder-bb205949-dfcc-4653-858d-100a41922660-delete_snapshot" released by "delete_snapshot" :: held 2.313s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:17:51 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a7c28c42-f3e8-4c84-8bae-fd86a389a50a tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Acquiring lock "cinder-b0fa75ab-beeb-4364-9f74-c8284fbb25ec-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:17:51 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a7c28c42-f3e8-4c84-8bae-fd86a389a50a tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Lock "cinder-b0fa75ab-beeb-4364-9f74-c8284fbb25ec-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:17:51 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a7c28c42-f3e8-4c84-8bae-fd86a389a50a tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Acquiring lock "cinder-quobyte-b0fa75ab-beeb-4364-9f74-c8284fbb25ec" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:17:51 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a7c28c42-f3e8-4c84-8bae-fd86a389a50a tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Lock "cinder-quobyte-b0fa75ab-beeb-4364-9f74-c8284fbb25ec" acquired by "delete_volume" :: waited 0.026s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:17:51 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[af10906d-243a-4806-bafe-c1bcb0b43eee]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:17:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a7c28c42-f3e8-4c84-8bae-fd86a389a50a tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:52 devstack sudo[93979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec Sep 03 11:17:52 devstack sudo[93979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:52 devstack sudo[93979]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a7c28c42-f3e8-4c84-8bae-fd86a389a50a tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec" returned: 0 in 0.576s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a7c28c42-f3e8-4c84-8bae-fd86a389a50a tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:52 devstack sudo[93984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec Sep 03 11:17:52 devstack sudo[93984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:52 devstack sudo[93984]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a7c28c42-f3e8-4c84-8bae-fd86a389a50a tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b0fa75ab-beeb-4364-9f74-c8284fbb25ec" returned: 0 in 0.275s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:52 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a7c28c42-f3e8-4c84-8bae-fd86a389a50a tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Lock "cinder-quobyte-b0fa75ab-beeb-4364-9f74-c8284fbb25ec" released by "delete_volume" :: held 0.944s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:17:52 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-a7c28c42-f3e8-4c84-8bae-fd86a389a50a tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Created reservations ['ef96f523-9e52-4f58-8aac-95b967730bc0', 'e67284fe-98ff-40ac-9648-e0aa65a1a0c8', '9b8da19e-d22d-4828-99df-ce8fe681253d', 'def5d245-9ab8-41e5-80ae-2dddee7f08c8'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:17:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a7c28c42-f3e8-4c84-8bae-fd86a389a50a tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:17:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a7c28c42-f3e8-4c84-8bae-fd86a389a50a tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:17:52 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a7c28c42-f3e8-4c84-8bae-fd86a389a50a tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:17:52 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a7c28c42-f3e8-4c84-8bae-fd86a389a50a tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:17:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a7c28c42-f3e8-4c84-8bae-fd86a389a50a tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:17:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a7c28c42-f3e8-4c84-8bae-fd86a389a50a tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:17:52 devstack sudo[93987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:17:52 devstack sudo[93987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:17:53 devstack sudo[93987]: pam_unix(sudo:session): session closed for user root Sep 03 11:17:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a7c28c42-f3e8-4c84-8bae-fd86a389a50a tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.336s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:17:53 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-a7c28c42-f3e8-4c84-8bae-fd86a389a50a tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:17:53 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-a7c28c42-f3e8-4c84-8bae-fd86a389a50a tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Deleted volume successfully. Sep 03 11:17:53 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a7c28c42-f3e8-4c84-8bae-fd86a389a50a tempest-VolumeSnapshotQuotasNegativeTestJSON-102220271 None] Lock "cinder-b0fa75ab-beeb-4364-9f74-c8284fbb25ec-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:18:02 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:UPDATE=105,cinder:SELECT=82,cinder:DELETE=10,cinder:INSERT=25 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:18:03 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=89,cinder:INSERT=37,cinder:UPDATE=98,cinder:DELETE=6 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:18:15 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfeca8da-6da7-4c96-8fb1-9009d725bd37 tempest-VolumesSnapshotTestJSON-646131283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:18:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bfeca8da-6da7-4c96-8fb1-9009d725bd37 tempest-VolumesSnapshotTestJSON-646131283 None] Flow 'volume_create_manager' (cc688b67-5441-4b5d-aeb1-ff0a3aedd3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:18:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bfeca8da-6da7-4c96-8fb1-9009d725bd37 tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17fe1c69-6cf2-4704-bfe0-e098314ab5a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bfeca8da-6da7-4c96-8fb1-9009d725bd37 tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17fe1c69-6cf2-4704-bfe0-e098314ab5a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-874206505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9815f917-95d5-428c-ba9a-88553f8fe4a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f6c59ae1cf246f1887744ceb45bf69b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:18:16Z,use_quota=True,user_id='d5030fa0be77435bbc51b81f5ffd8a2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bfeca8da-6da7-4c96-8fb1-9009d725bd37 tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78b2151d-6a7b-4da3-80de-9a8cea0de669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bfeca8da-6da7-4c96-8fb1-9009d725bd37 tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78b2151d-6a7b-4da3-80de-9a8cea0de669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bfeca8da-6da7-4c96-8fb1-9009d725bd37 tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47f0b611-33ca-488f-b7ba-e5dcf78b2851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bfeca8da-6da7-4c96-8fb1-9009d725bd37 tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (47f0b611-33ca-488f-b7ba-e5dcf78b2851) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9815f917-95d5-428c-ba9a-88553f8fe4a5', 'volume_name': 'volume-9815f917-95d5-428c-ba9a-88553f8fe4a5', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bfeca8da-6da7-4c96-8fb1-9009d725bd37 tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc70a603-1b19-4576-af12-839203fea2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bfeca8da-6da7-4c96-8fb1-9009d725bd37 tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc70a603-1b19-4576-af12-839203fea2e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bfeca8da-6da7-4c96-8fb1-9009d725bd37 tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a5c75b1-b5c3-48d4-a088-5f5a594c0aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:15 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-bfeca8da-6da7-4c96-8fb1-9009d725bd37 tempest-VolumesSnapshotTestJSON-646131283 None] Volume 9815f917-95d5-428c-ba9a-88553f8fe4a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9815f917-95d5-428c-ba9a-88553f8fe4a5', 'volume_size': 1} Sep 03 11:18:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bfeca8da-6da7-4c96-8fb1-9009d725bd37 tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:18:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bfeca8da-6da7-4c96-8fb1-9009d725bd37 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:18:15 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-bfeca8da-6da7-4c96-8fb1-9009d725bd37 tempest-VolumesSnapshotTestJSON-646131283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-874206505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9815f917-95d5-428c-ba9a-88553f8fe4a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f6c59ae1cf246f1887744ceb45bf69b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:18:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:18:16Z,use_quota=True,user_id='d5030fa0be77435bbc51b81f5ffd8a2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:18:15 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-bfeca8da-6da7-4c96-8fb1-9009d725bd37 tempest-VolumesSnapshotTestJSON-646131283 None] Creating volume 9815f917-95d5-428c-ba9a-88553f8fe4a5 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:18:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bfeca8da-6da7-4c96-8fb1-9009d725bd37 tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:18:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bfeca8da-6da7-4c96-8fb1-9009d725bd37 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:18:15 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-bfeca8da-6da7-4c96-8fb1-9009d725bd37 tempest-VolumesSnapshotTestJSON-646131283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:18:15 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-bfeca8da-6da7-4c96-8fb1-9009d725bd37 tempest-VolumesSnapshotTestJSON-646131283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:18:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bfeca8da-6da7-4c96-8fb1-9009d725bd37 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:18:15 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-bfeca8da-6da7-4c96-8fb1-9009d725bd37 tempest-VolumesSnapshotTestJSON-646131283 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:18:15 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-bfeca8da-6da7-4c96-8fb1-9009d725bd37 tempest-VolumesSnapshotTestJSON-646131283 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:18:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bfeca8da-6da7-4c96-8fb1-9009d725bd37 tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:15 devstack sudo[94217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5 1073741824 Sep 03 11:18:15 devstack sudo[94217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:16 devstack sudo[94217]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bfeca8da-6da7-4c96-8fb1-9009d725bd37 tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5 1073741824" returned: 0 in 0.600s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bfeca8da-6da7-4c96-8fb1-9009d725bd37 tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:16 devstack sudo[94224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5 Sep 03 11:18:16 devstack sudo[94224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:16 devstack sudo[94224]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bfeca8da-6da7-4c96-8fb1-9009d725bd37 tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5" returned: 0 in 0.338s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:16 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-bfeca8da-6da7-4c96-8fb1-9009d725bd37 tempest-VolumesSnapshotTestJSON-646131283 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:18:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bfeca8da-6da7-4c96-8fb1-9009d725bd37 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:18:16 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bfeca8da-6da7-4c96-8fb1-9009d725bd37 tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a5c75b1-b5c3-48d4-a088-5f5a594c0aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9815f917-95d5-428c-ba9a-88553f8fe4a5', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:16 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bfeca8da-6da7-4c96-8fb1-9009d725bd37 tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4f2f04f-3ad4-40a8-8b9c-d482669d6606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:16 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-bfeca8da-6da7-4c96-8fb1-9009d725bd37 tempest-VolumesSnapshotTestJSON-646131283 None] Volume volume-9815f917-95d5-428c-ba9a-88553f8fe4a5 (9815f917-95d5-428c-ba9a-88553f8fe4a5): created successfully Sep 03 11:18:16 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bfeca8da-6da7-4c96-8fb1-9009d725bd37 tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4f2f04f-3ad4-40a8-8b9c-d482669d6606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:16 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bfeca8da-6da7-4c96-8fb1-9009d725bd37 tempest-VolumesSnapshotTestJSON-646131283 None] Flow 'volume_create_manager' (cc688b67-5441-4b5d-aeb1-ff0a3aedd3bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:18:16 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-bfeca8da-6da7-4c96-8fb1-9009d725bd37 tempest-VolumesSnapshotTestJSON-646131283 None] Created volume successfully. Sep 03 11:18:17 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:18:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:18:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:18:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:18:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:18:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:18:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:17 devstack sudo[94228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:18:17 devstack sudo[94228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:18 devstack sudo[94228]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.400s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:18 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:18:18 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:18:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread count: 28 {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:18:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread info: [<_MainThread(MainThread, started 139554943000704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:18:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3b7a2be0-ae66-4901-a911-b1fbc288f32f tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:18:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3b7a2be0-ae66-4901-a911-b1fbc288f32f tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:18:18 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-3b7a2be0-ae66-4901-a911-b1fbc288f32f tempest-VolumesSnapshotTestJSON-646131283 None] Creating offline snapshot b6584060-bda7-44c1-9a82-32da52e4e725 of volume 9815f917-95d5-428c-ba9a-88553f8fe4a5 {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:18:18 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b987886-6e79-44ac-8d03-2e558627fd7c]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:18:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3b7a2be0-ae66-4901-a911-b1fbc288f32f tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:18 devstack sudo[94231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5 Sep 03 11:18:18 devstack sudo[94231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:18 devstack sudo[94231]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3b7a2be0-ae66-4901-a911-b1fbc288f32f tempest-VolumesSnapshotTestJSON-646131283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5" returned: 0 in 0.425s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3b7a2be0-ae66-4901-a911-b1fbc288f32f tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5.b6584060-bda7-44c1-9a82-32da52e4e725 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:18 devstack sudo[94237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5.b6584060-bda7-44c1-9a82-32da52e4e725 1G Sep 03 11:18:18 devstack sudo[94237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:19 devstack sudo[94237]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3b7a2be0-ae66-4901-a911-b1fbc288f32f tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5.b6584060-bda7-44c1-9a82-32da52e4e725 1G" returned: 0 in 0.591s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3b7a2be0-ae66-4901-a911-b1fbc288f32f tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9815f917-95d5-428c-ba9a-88553f8fe4a5 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5.b6584060-bda7-44c1-9a82-32da52e4e725 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:19 devstack sudo[94242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9815f917-95d5-428c-ba9a-88553f8fe4a5 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5.b6584060-bda7-44c1-9a82-32da52e4e725 Sep 03 11:18:19 devstack sudo[94242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:19 devstack sudo[94242]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3b7a2be0-ae66-4901-a911-b1fbc288f32f tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9815f917-95d5-428c-ba9a-88553f8fe4a5 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5.b6584060-bda7-44c1-9a82-32da52e4e725" returned: 0 in 0.313s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:19 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-3b7a2be0-ae66-4901-a911-b1fbc288f32f tempest-VolumesSnapshotTestJSON-646131283 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5.b6584060-bda7-44c1-9a82-32da52e4e725 is being set with open permissions: ugo+rw Sep 03 11:18:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3b7a2be0-ae66-4901-a911-b1fbc288f32f tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5.b6584060-bda7-44c1-9a82-32da52e4e725 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:19 devstack sudo[94252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5.b6584060-bda7-44c1-9a82-32da52e4e725 Sep 03 11:18:19 devstack sudo[94252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:20 devstack sudo[94252]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3b7a2be0-ae66-4901-a911-b1fbc288f32f tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5.b6584060-bda7-44c1-9a82-32da52e4e725" returned: 0 in 0.282s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3b7a2be0-ae66-4901-a911-b1fbc288f32f tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:20 devstack sudo[94255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5.info Sep 03 11:18:20 devstack sudo[94255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:20 devstack sudo[94255]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3b7a2be0-ae66-4901-a911-b1fbc288f32f tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5.info" returned: 0 in 0.278s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:20 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-3b7a2be0-ae66-4901-a911-b1fbc288f32f tempest-VolumesSnapshotTestJSON-646131283 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5.info is being set with open permissions: ugo+rw Sep 03 11:18:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3b7a2be0-ae66-4901-a911-b1fbc288f32f tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:20 devstack sudo[94258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5.info Sep 03 11:18:20 devstack sudo[94258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:20 devstack sudo[94258]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3b7a2be0-ae66-4901-a911-b1fbc288f32f tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5.info" returned: 0 in 0.274s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3b7a2be0-ae66-4901-a911-b1fbc288f32f tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.290s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:18:20 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-3b7a2be0-ae66-4901-a911-b1fbc288f32f tempest-VolumesSnapshotTestJSON-646131283 None] Create snapshot completed successfully Sep 03 11:18:21 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-6b7421a6-2cd6-48a4-b5be-d109ef077ec5 tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "cinder-b6584060-bda7-44c1-9a82-32da52e4e725-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:18:21 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-6b7421a6-2cd6-48a4-b5be-d109ef077ec5 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-b6584060-bda7-44c1-9a82-32da52e4e725-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:18:21 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-6b7421a6-2cd6-48a4-b5be-d109ef077ec5 tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "cinder-quobyte-9815f917-95d5-428c-ba9a-88553f8fe4a5" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:18:21 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-6b7421a6-2cd6-48a4-b5be-d109ef077ec5 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-quobyte-9815f917-95d5-428c-ba9a-88553f8fe4a5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:18:21 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-6b7421a6-2cd6-48a4-b5be-d109ef077ec5 tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "cinder-quobyte-b6584060-bda7-44c1-9a82-32da52e4e725" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:18:21 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-6b7421a6-2cd6-48a4-b5be-d109ef077ec5 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-quobyte-b6584060-bda7-44c1-9a82-32da52e4e725" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:18:21 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-6b7421a6-2cd6-48a4-b5be-d109ef077ec5 tempest-VolumesSnapshotTestJSON-646131283 None] Deleting offline snapshot b6584060-bda7-44c1-9a82-32da52e4e725 of volume 9815f917-95d5-428c-ba9a-88553f8fe4a5 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:18:21 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-6b7421a6-2cd6-48a4-b5be-d109ef077ec5 tempest-VolumesSnapshotTestJSON-646131283 None] snapshot_file for this snap is: volume-9815f917-95d5-428c-ba9a-88553f8fe4a5.b6584060-bda7-44c1-9a82-32da52e4e725 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:18:21 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06deaa3-5241-4ed3-8be3-decf00878af3]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:18:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6b7421a6-2cd6-48a4-b5be-d109ef077ec5 tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5.b6584060-bda7-44c1-9a82-32da52e4e725 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:22 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-754dfa0a-3ec4-455e-b79c-ecd3595f1e33 tempest-AttachVolumeNegativeTest-1135519864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:18:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-754dfa0a-3ec4-455e-b79c-ecd3595f1e33 tempest-AttachVolumeNegativeTest-1135519864 None] Flow 'volume_create_manager' (960710be-0add-443a-bd88-0645039cee80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:18:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-754dfa0a-3ec4-455e-b79c-ecd3595f1e33 tempest-AttachVolumeNegativeTest-1135519864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63aeb40e-1d0f-45d1-8f3f-963d992f788c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:22 devstack sudo[94263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5.b6584060-bda7-44c1-9a82-32da52e4e725 Sep 03 11:18:22 devstack sudo[94263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-754dfa0a-3ec4-455e-b79c-ecd3595f1e33 tempest-AttachVolumeNegativeTest-1135519864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63aeb40e-1d0f-45d1-8f3f-963d992f788c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:18:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1804830517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c80e6766-3893-4574-80e9-3c693c910c52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d61409d09184c5993bb335ccbb39155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:18:22Z,use_quota=True,user_id='b17a20289dae429a8682705ff233e9b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-754dfa0a-3ec4-455e-b79c-ecd3595f1e33 tempest-AttachVolumeNegativeTest-1135519864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00ed26bc-0b57-4619-867c-9b936bae98c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-754dfa0a-3ec4-455e-b79c-ecd3595f1e33 tempest-AttachVolumeNegativeTest-1135519864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00ed26bc-0b57-4619-867c-9b936bae98c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-754dfa0a-3ec4-455e-b79c-ecd3595f1e33 tempest-AttachVolumeNegativeTest-1135519864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc8733c4-3c3c-4d45-b6d2-2ac6a99cef9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-754dfa0a-3ec4-455e-b79c-ecd3595f1e33 tempest-AttachVolumeNegativeTest-1135519864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cc8733c4-3c3c-4d45-b6d2-2ac6a99cef9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c80e6766-3893-4574-80e9-3c693c910c52', 'volume_name': 'volume-c80e6766-3893-4574-80e9-3c693c910c52', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-754dfa0a-3ec4-455e-b79c-ecd3595f1e33 tempest-AttachVolumeNegativeTest-1135519864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38e59a59-0265-4bac-86f9-d11078cf94a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-754dfa0a-3ec4-455e-b79c-ecd3595f1e33 tempest-AttachVolumeNegativeTest-1135519864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (38e59a59-0265-4bac-86f9-d11078cf94a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-754dfa0a-3ec4-455e-b79c-ecd3595f1e33 tempest-AttachVolumeNegativeTest-1135519864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfdcfd63-a0b9-41e1-8d68-b04028a95aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:22 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-754dfa0a-3ec4-455e-b79c-ecd3595f1e33 tempest-AttachVolumeNegativeTest-1135519864 None] Volume c80e6766-3893-4574-80e9-3c693c910c52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c80e6766-3893-4574-80e9-3c693c910c52', 'volume_size': 1} Sep 03 11:18:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-754dfa0a-3ec4-455e-b79c-ecd3595f1e33 tempest-AttachVolumeNegativeTest-1135519864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:18:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-754dfa0a-3ec4-455e-b79c-ecd3595f1e33 tempest-AttachVolumeNegativeTest-1135519864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:18:22 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-754dfa0a-3ec4-455e-b79c-ecd3595f1e33 tempest-AttachVolumeNegativeTest-1135519864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:18:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1804830517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c80e6766-3893-4574-80e9-3c693c910c52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d61409d09184c5993bb335ccbb39155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:18:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:18:22Z,use_quota=True,user_id='b17a20289dae429a8682705ff233e9b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:18:22 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-754dfa0a-3ec4-455e-b79c-ecd3595f1e33 tempest-AttachVolumeNegativeTest-1135519864 None] Creating volume c80e6766-3893-4574-80e9-3c693c910c52 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:18:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-754dfa0a-3ec4-455e-b79c-ecd3595f1e33 tempest-AttachVolumeNegativeTest-1135519864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:18:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-754dfa0a-3ec4-455e-b79c-ecd3595f1e33 tempest-AttachVolumeNegativeTest-1135519864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:18:22 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-754dfa0a-3ec4-455e-b79c-ecd3595f1e33 tempest-AttachVolumeNegativeTest-1135519864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:18:22 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-754dfa0a-3ec4-455e-b79c-ecd3595f1e33 tempest-AttachVolumeNegativeTest-1135519864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:18:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-754dfa0a-3ec4-455e-b79c-ecd3595f1e33 tempest-AttachVolumeNegativeTest-1135519864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:18:22 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-754dfa0a-3ec4-455e-b79c-ecd3595f1e33 tempest-AttachVolumeNegativeTest-1135519864 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:18:22 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-754dfa0a-3ec4-455e-b79c-ecd3595f1e33 tempest-AttachVolumeNegativeTest-1135519864 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:18:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-754dfa0a-3ec4-455e-b79c-ecd3595f1e33 tempest-AttachVolumeNegativeTest-1135519864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c80e6766-3893-4574-80e9-3c693c910c52 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:22 devstack sudo[94265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c80e6766-3893-4574-80e9-3c693c910c52 1073741824 Sep 03 11:18:22 devstack sudo[94265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:22 devstack sudo[94263]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6b7421a6-2cd6-48a4-b5be-d109ef077ec5 tempest-VolumesSnapshotTestJSON-646131283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5.b6584060-bda7-44c1-9a82-32da52e4e725" returned: 0 in 0.513s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:22 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-6b7421a6-2cd6-48a4-b5be-d109ef077ec5 tempest-VolumesSnapshotTestJSON-646131283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9815f917-95d5-428c-ba9a-88553f8fe4a5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:18:22 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ae4360-4045-42ed-9381-175dc3285402]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:18:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6b7421a6-2cd6-48a4-b5be-d109ef077ec5 tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:22 devstack sudo[94274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5 Sep 03 11:18:22 devstack sudo[94274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:22 devstack sudo[94265]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-754dfa0a-3ec4-455e-b79c-ecd3595f1e33 tempest-AttachVolumeNegativeTest-1135519864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c80e6766-3893-4574-80e9-3c693c910c52 1073741824" returned: 0 in 0.502s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-754dfa0a-3ec4-455e-b79c-ecd3595f1e33 tempest-AttachVolumeNegativeTest-1135519864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c80e6766-3893-4574-80e9-3c693c910c52 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:22 devstack sudo[94278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c80e6766-3893-4574-80e9-3c693c910c52 Sep 03 11:18:22 devstack sudo[94278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:23 devstack sudo[94274]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6b7421a6-2cd6-48a4-b5be-d109ef077ec5 tempest-VolumesSnapshotTestJSON-646131283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5" returned: 0 in 0.606s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6b7421a6-2cd6-48a4-b5be-d109ef077ec5 tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5.b6584060-bda7-44c1-9a82-32da52e4e725 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:23 devstack sudo[94315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5.b6584060-bda7-44c1-9a82-32da52e4e725 Sep 03 11:18:23 devstack sudo[94315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:23 devstack sudo[94278]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-754dfa0a-3ec4-455e-b79c-ecd3595f1e33 tempest-AttachVolumeNegativeTest-1135519864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c80e6766-3893-4574-80e9-3c693c910c52" returned: 0 in 0.432s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:23 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-754dfa0a-3ec4-455e-b79c-ecd3595f1e33 tempest-AttachVolumeNegativeTest-1135519864 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:18:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-754dfa0a-3ec4-455e-b79c-ecd3595f1e33 tempest-AttachVolumeNegativeTest-1135519864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:18:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-754dfa0a-3ec4-455e-b79c-ecd3595f1e33 tempest-AttachVolumeNegativeTest-1135519864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfdcfd63-a0b9-41e1-8d68-b04028a95aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c80e6766-3893-4574-80e9-3c693c910c52', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-754dfa0a-3ec4-455e-b79c-ecd3595f1e33 tempest-AttachVolumeNegativeTest-1135519864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a191145c-0eb9-4359-83ac-b5c7d822e4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:23 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-754dfa0a-3ec4-455e-b79c-ecd3595f1e33 tempest-AttachVolumeNegativeTest-1135519864 None] Volume volume-c80e6766-3893-4574-80e9-3c693c910c52 (c80e6766-3893-4574-80e9-3c693c910c52): created successfully Sep 03 11:18:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-754dfa0a-3ec4-455e-b79c-ecd3595f1e33 tempest-AttachVolumeNegativeTest-1135519864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a191145c-0eb9-4359-83ac-b5c7d822e4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-754dfa0a-3ec4-455e-b79c-ecd3595f1e33 tempest-AttachVolumeNegativeTest-1135519864 None] Flow 'volume_create_manager' (960710be-0add-443a-bd88-0645039cee80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:18:23 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-754dfa0a-3ec4-455e-b79c-ecd3595f1e33 tempest-AttachVolumeNegativeTest-1135519864 None] Created volume successfully. Sep 03 11:18:23 devstack sudo[94315]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6b7421a6-2cd6-48a4-b5be-d109ef077ec5 tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5.b6584060-bda7-44c1-9a82-32da52e4e725" returned: 0 in 0.402s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6b7421a6-2cd6-48a4-b5be-d109ef077ec5 tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5.b6584060-bda7-44c1-9a82-32da52e4e725 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:23 devstack sudo[94322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5.b6584060-bda7-44c1-9a82-32da52e4e725 Sep 03 11:18:23 devstack sudo[94322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:23 devstack sudo[94322]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6b7421a6-2cd6-48a4-b5be-d109ef077ec5 tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5.b6584060-bda7-44c1-9a82-32da52e4e725" returned: 0 in 0.247s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:23 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-6b7421a6-2cd6-48a4-b5be-d109ef077ec5 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-quobyte-b6584060-bda7-44c1-9a82-32da52e4e725" released by "_delete_snapshot" :: held 1.914s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:18:23 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-6b7421a6-2cd6-48a4-b5be-d109ef077ec5 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-quobyte-9815f917-95d5-428c-ba9a-88553f8fe4a5" released by "delete_snapshot" :: held 1.940s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:18:23 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-6b7421a6-2cd6-48a4-b5be-d109ef077ec5 tempest-VolumesSnapshotTestJSON-646131283 None] Created reservations ['f5dc8b1c-0eb3-40dc-ba52-da4baccb6969', '4ee01af0-b87a-4dcb-88f2-720e090ef8f4', '09e70fb6-8b37-4aff-a35d-cbdf9032d29b', 'd3e20dd1-fb08-47e4-8f99-b929d349204f'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:18:23 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-6b7421a6-2cd6-48a4-b5be-d109ef077ec5 tempest-VolumesSnapshotTestJSON-646131283 None] Delete snapshot completed successfully. Sep 03 11:18:23 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-6b7421a6-2cd6-48a4-b5be-d109ef077ec5 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-b6584060-bda7-44c1-9a82-32da52e4e725-delete_snapshot" released by "delete_snapshot" :: held 2.147s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:18:24 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-109dc2bb-4100-4ffc-bcf1-b87774bf58eb tempest-VolumesSnapshotTestJSON-646131283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:18:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-109dc2bb-4100-4ffc-bcf1-b87774bf58eb tempest-VolumesSnapshotTestJSON-646131283 None] Flow 'volume_create_manager' (db5d7c41-e0cb-422d-ad1b-27a22552ba68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:18:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-109dc2bb-4100-4ffc-bcf1-b87774bf58eb tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87494f2e-2fa3-40f7-9f85-d36fb7e31ca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-109dc2bb-4100-4ffc-bcf1-b87774bf58eb tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87494f2e-2fa3-40f7-9f85-d36fb7e31ca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-202509718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=365ff714-494e-4e41-939a-e3240a40454e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f6c59ae1cf246f1887744ceb45bf69b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:18:25Z,use_quota=True,user_id='d5030fa0be77435bbc51b81f5ffd8a2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-109dc2bb-4100-4ffc-bcf1-b87774bf58eb tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b697f1-1703-4142-bfba-73fc2267b5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-109dc2bb-4100-4ffc-bcf1-b87774bf58eb tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b697f1-1703-4142-bfba-73fc2267b5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-109dc2bb-4100-4ffc-bcf1-b87774bf58eb tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0f8c699-58c1-4231-b46b-a0f693018ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-109dc2bb-4100-4ffc-bcf1-b87774bf58eb tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0f8c699-58c1-4231-b46b-a0f693018ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '365ff714-494e-4e41-939a-e3240a40454e', 'volume_name': 'volume-365ff714-494e-4e41-939a-e3240a40454e', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-109dc2bb-4100-4ffc-bcf1-b87774bf58eb tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29f02291-ca18-4b4e-b313-da0b315031af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-109dc2bb-4100-4ffc-bcf1-b87774bf58eb tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29f02291-ca18-4b4e-b313-da0b315031af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-109dc2bb-4100-4ffc-bcf1-b87774bf58eb tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44cc2491-6949-4aea-9f4b-02a286558cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:25 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-109dc2bb-4100-4ffc-bcf1-b87774bf58eb tempest-VolumesSnapshotTestJSON-646131283 None] Volume 365ff714-494e-4e41-939a-e3240a40454e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-365ff714-494e-4e41-939a-e3240a40454e', 'volume_size': 1} Sep 03 11:18:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-109dc2bb-4100-4ffc-bcf1-b87774bf58eb tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:18:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-109dc2bb-4100-4ffc-bcf1-b87774bf58eb tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:18:25 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-109dc2bb-4100-4ffc-bcf1-b87774bf58eb tempest-VolumesSnapshotTestJSON-646131283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:18:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-202509718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=365ff714-494e-4e41-939a-e3240a40454e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f6c59ae1cf246f1887744ceb45bf69b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:18:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:18:25Z,use_quota=True,user_id='d5030fa0be77435bbc51b81f5ffd8a2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:18:25 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-109dc2bb-4100-4ffc-bcf1-b87774bf58eb tempest-VolumesSnapshotTestJSON-646131283 None] Creating volume 365ff714-494e-4e41-939a-e3240a40454e {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:18:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-109dc2bb-4100-4ffc-bcf1-b87774bf58eb tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:18:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-109dc2bb-4100-4ffc-bcf1-b87774bf58eb tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:18:25 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-109dc2bb-4100-4ffc-bcf1-b87774bf58eb tempest-VolumesSnapshotTestJSON-646131283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:18:25 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-109dc2bb-4100-4ffc-bcf1-b87774bf58eb tempest-VolumesSnapshotTestJSON-646131283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:18:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-109dc2bb-4100-4ffc-bcf1-b87774bf58eb tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:18:25 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-109dc2bb-4100-4ffc-bcf1-b87774bf58eb tempest-VolumesSnapshotTestJSON-646131283 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:18:25 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-109dc2bb-4100-4ffc-bcf1-b87774bf58eb tempest-VolumesSnapshotTestJSON-646131283 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:18:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-109dc2bb-4100-4ffc-bcf1-b87774bf58eb tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:25 devstack sudo[94329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e 1073741824 Sep 03 11:18:25 devstack sudo[94329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:25 devstack sudo[94329]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-109dc2bb-4100-4ffc-bcf1-b87774bf58eb tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e 1073741824" returned: 0 in 0.553s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-109dc2bb-4100-4ffc-bcf1-b87774bf58eb tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:25 devstack sudo[94344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e Sep 03 11:18:25 devstack sudo[94344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-934412cc-3667-470a-94dd-802bbf0a49e0 req-85decfcf-8a1a-4f8a-8224-ba984f43e402 tempest-AttachVolumeNegativeTest-1135519864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:18:25 devstack sudo[94344]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-109dc2bb-4100-4ffc-bcf1-b87774bf58eb tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e" returned: 0 in 0.332s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:25 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-109dc2bb-4100-4ffc-bcf1-b87774bf58eb tempest-VolumesSnapshotTestJSON-646131283 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:18:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-109dc2bb-4100-4ffc-bcf1-b87774bf58eb tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:18:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-934412cc-3667-470a-94dd-802bbf0a49e0 req-85decfcf-8a1a-4f8a-8224-ba984f43e402 tempest-AttachVolumeNegativeTest-1135519864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.193s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:18:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-109dc2bb-4100-4ffc-bcf1-b87774bf58eb tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44cc2491-6949-4aea-9f4b-02a286558cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-365ff714-494e-4e41-939a-e3240a40454e', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-109dc2bb-4100-4ffc-bcf1-b87774bf58eb tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (892f9d66-abe8-40f9-8b86-cdfb17d161f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-934412cc-3667-470a-94dd-802bbf0a49e0 req-85decfcf-8a1a-4f8a-8224-ba984f43e402 tempest-AttachVolumeNegativeTest-1135519864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:18:26 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-109dc2bb-4100-4ffc-bcf1-b87774bf58eb tempest-VolumesSnapshotTestJSON-646131283 None] Volume volume-365ff714-494e-4e41-939a-e3240a40454e (365ff714-494e-4e41-939a-e3240a40454e): created successfully Sep 03 11:18:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-109dc2bb-4100-4ffc-bcf1-b87774bf58eb tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (892f9d66-abe8-40f9-8b86-cdfb17d161f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-109dc2bb-4100-4ffc-bcf1-b87774bf58eb tempest-VolumesSnapshotTestJSON-646131283 None] Flow 'volume_create_manager' (db5d7c41-e0cb-422d-ad1b-27a22552ba68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:18:26 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-109dc2bb-4100-4ffc-bcf1-b87774bf58eb tempest-VolumesSnapshotTestJSON-646131283 None] Created volume successfully. Sep 03 11:18:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-934412cc-3667-470a-94dd-802bbf0a49e0 req-85decfcf-8a1a-4f8a-8224-ba984f43e402 tempest-AttachVolumeNegativeTest-1135519864 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912', 'name': 'volume-c80e6766-3893-4574-80e9-3c693c910c52', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '74a0b20f-84c2-4156-a2bd-d0756890d5cb', 'enforce_multipath': True} {{(pid=87038) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:18:26 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-934412cc-3667-470a-94dd-802bbf0a49e0 req-85decfcf-8a1a-4f8a-8224-ba984f43e402 tempest-AttachVolumeNegativeTest-1135519864 None] attachment_update completed successfully. Sep 03 11:18:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-02109c44-1453-4258-b6d5-208bba9c2006 tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:18:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-02109c44-1453-4258-b6d5-208bba9c2006 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:18:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-02109c44-1453-4258-b6d5-208bba9c2006 tempest-VolumesSnapshotTestJSON-646131283 None] Creating offline snapshot 029c2337-994b-4cc1-9ce5-d13e0896b3f2 of volume 365ff714-494e-4e41-939a-e3240a40454e {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:18:27 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e8afbc-377b-45bb-a783-c054cb320c74]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:18:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-02109c44-1453-4258-b6d5-208bba9c2006 tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:27 devstack sudo[94729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e Sep 03 11:18:27 devstack sudo[94729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:27 devstack sudo[94729]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-02109c44-1453-4258-b6d5-208bba9c2006 tempest-VolumesSnapshotTestJSON-646131283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e" returned: 0 in 0.443s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-02109c44-1453-4258-b6d5-208bba9c2006 tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e.029c2337-994b-4cc1-9ce5-d13e0896b3f2 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:27 devstack sudo[94735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e.029c2337-994b-4cc1-9ce5-d13e0896b3f2 1G Sep 03 11:18:27 devstack sudo[94735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:28 devstack sudo[94735]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-02109c44-1453-4258-b6d5-208bba9c2006 tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e.029c2337-994b-4cc1-9ce5-d13e0896b3f2 1G" returned: 0 in 0.465s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-02109c44-1453-4258-b6d5-208bba9c2006 tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-365ff714-494e-4e41-939a-e3240a40454e -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e.029c2337-994b-4cc1-9ce5-d13e0896b3f2 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:28 devstack sudo[94741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-365ff714-494e-4e41-939a-e3240a40454e -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e.029c2337-994b-4cc1-9ce5-d13e0896b3f2 Sep 03 11:18:28 devstack sudo[94741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:28 devstack sudo[94741]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-02109c44-1453-4258-b6d5-208bba9c2006 tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-365ff714-494e-4e41-939a-e3240a40454e -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e.029c2337-994b-4cc1-9ce5-d13e0896b3f2" returned: 0 in 0.356s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:28 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-02109c44-1453-4258-b6d5-208bba9c2006 tempest-VolumesSnapshotTestJSON-646131283 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e.029c2337-994b-4cc1-9ce5-d13e0896b3f2 is being set with open permissions: ugo+rw Sep 03 11:18:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-02109c44-1453-4258-b6d5-208bba9c2006 tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e.029c2337-994b-4cc1-9ce5-d13e0896b3f2 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:28 devstack sudo[94747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e.029c2337-994b-4cc1-9ce5-d13e0896b3f2 Sep 03 11:18:28 devstack sudo[94747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:28 devstack sudo[94747]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-02109c44-1453-4258-b6d5-208bba9c2006 tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e.029c2337-994b-4cc1-9ce5-d13e0896b3f2" returned: 0 in 0.335s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-02109c44-1453-4258-b6d5-208bba9c2006 tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:28 devstack sudo[94750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e.info Sep 03 11:18:28 devstack sudo[94750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:29 devstack sudo[94750]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-02109c44-1453-4258-b6d5-208bba9c2006 tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e.info" returned: 0 in 0.331s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:29 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-02109c44-1453-4258-b6d5-208bba9c2006 tempest-VolumesSnapshotTestJSON-646131283 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e.info is being set with open permissions: ugo+rw Sep 03 11:18:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-02109c44-1453-4258-b6d5-208bba9c2006 tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:29 devstack sudo[94753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e.info Sep 03 11:18:29 devstack sudo[94753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:29 devstack sudo[94753]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-02109c44-1453-4258-b6d5-208bba9c2006 tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e.info" returned: 0 in 0.285s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-02109c44-1453-4258-b6d5-208bba9c2006 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.315s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:18:29 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-02109c44-1453-4258-b6d5-208bba9c2006 tempest-VolumesSnapshotTestJSON-646131283 None] Create snapshot completed successfully Sep 03 11:18:31 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:18:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Flow 'volume_create_manager' (fe6a927a-5785-4dda-b2e0-d33d1db863ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:18:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d9dffd3-d09d-48d4-878e-9b71bf6696ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d9dffd3-d09d-48d4-878e-9b71bf6696ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:18:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-97182331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=389a56bc-33c2-4a6b-8e3a-97f027922c6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f6c59ae1cf246f1887744ceb45bf69b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:18:31Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=029c2337-994b-4cc1-9ce5-d13e0896b3f2,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:18:31Z,use_quota=True,user_id='d5030fa0be77435bbc51b81f5ffd8a2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bca0d2ac-161f-49fa-8f10-47d8436e1db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bca0d2ac-161f-49fa-8f10-47d8436e1db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3a70706-59ed-4eaf-8161-b8d3268f69e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3a70706-59ed-4eaf-8161-b8d3268f69e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '389a56bc-33c2-4a6b-8e3a-97f027922c6c', 'volume_name': 'volume-389a56bc-33c2-4a6b-8e3a-97f027922c6c', 'volume_size': 2, 'snapshot_id': '029c2337-994b-4cc1-9ce5-d13e0896b3f2'}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc7ee47-3ced-4ac4-b8f6-903c7cf49425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edc7ee47-3ced-4ac4-b8f6-903c7cf49425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06204fed-8efc-41b1-bce0-e0c2b8bc6d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:31 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Volume 389a56bc-33c2-4a6b-8e3a-97f027922c6c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-389a56bc-33c2-4a6b-8e3a-97f027922c6c', 'volume_size': 2, 'snapshot_id': '029c2337-994b-4cc1-9ce5-d13e0896b3f2'} Sep 03 11:18:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:18:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:18:31 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "cinder-quobyte-029c2337-994b-4cc1-9ce5-d13e0896b3f2-389a56bc-33c2-4a6b-8e3a-97f027922c6c" by "_create_volume_from_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:18:31 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-quobyte-029c2337-994b-4cc1-9ce5-d13e0896b3f2-389a56bc-33c2-4a6b-8e3a-97f027922c6c" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:18:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Creating volume 389a56bc-33c2-4a6b-8e3a-97f027922c6c from snapshot 029c2337-994b-4cc1-9ce5-d13e0896b3f2 {{(pid=87038) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 11:18:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:18:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:18:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:18:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:18:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:18:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:18:31 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "cinder-quobyte-389a56bc-33c2-4a6b-8e3a-97f027922c6c" by "_copy_volume_from_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:18:31 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-quobyte-389a56bc-33c2-4a6b-8e3a-97f027922c6c" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:18:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] snapshot: 029c2337-994b-4cc1-9ce5-d13e0896b3f2, volume: 389a56bc-33c2-4a6b-8e3a-97f027922c6c, {{(pid=87038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 11:18:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:18:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:18:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:18:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:18:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:18:31 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[e140b7aa-5ee4-4029-a1b8-a35805bc336d]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:18:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e.029c2337-994b-4cc1-9ce5-d13e0896b3f2 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:31 devstack sudo[94757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e.029c2337-994b-4cc1-9ce5-d13e0896b3f2 Sep 03 11:18:31 devstack sudo[94757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:31 devstack sudo[94757]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e.029c2337-994b-4cc1-9ce5-d13e0896b3f2" returned: 0 in 0.505s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-365ff714-494e-4e41-939a-e3240a40454e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:18:31 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf5e9a61-4946-4d65-922d-d847bf43b0bf]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:18:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:32 devstack sudo[94763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e Sep 03 11:18:32 devstack sudo[94763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:32 devstack sudo[94763]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e" returned: 0 in 0.538s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e {{(pid=87038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 11:18:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Creating direct copy from snapshot {{(pid=87038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 11:18:32 devstack cinder-volume[87038]: DEBUG cinder.utils [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Path /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-389a56bc-33c2-4a6b-8e3a-97f027922c6c not found in is_blk_device check {{(pid=87038) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 11:18:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-389a56bc-33c2-4a6b-8e3a-97f027922c6c {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:32 devstack sudo[94772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-389a56bc-33c2-4a6b-8e3a-97f027922c6c Sep 03 11:18:32 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:36 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c98aa88-0783-4313-ac62-e0daae05cec9 tempest-AttachVolumeTestJSON-470983266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:18:36 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1c98aa88-0783-4313-ac62-e0daae05cec9 tempest-AttachVolumeTestJSON-470983266 None] Flow 'volume_create_manager' (c8f79b5b-422a-4aaa-afab-06a720d0d2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:18:36 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1c98aa88-0783-4313-ac62-e0daae05cec9 tempest-AttachVolumeTestJSON-470983266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72f012ff-239a-4346-9cd4-b6778163cc84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:36 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1c98aa88-0783-4313-ac62-e0daae05cec9 tempest-AttachVolumeTestJSON-470983266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72f012ff-239a-4346-9cd4-b6778163cc84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-80791925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78fabb40-ed3c-4228-b3c0-6076e53a07ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='640bae814fcc4d0093f0b97d498922d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:18:36Z,use_quota=True,user_id='904f07e50f244f6aa0e0658a81e4d444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:36 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1c98aa88-0783-4313-ac62-e0daae05cec9 tempest-AttachVolumeTestJSON-470983266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0628f053-d0c4-45b9-b78a-da912df2ea75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:36 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1c98aa88-0783-4313-ac62-e0daae05cec9 tempest-AttachVolumeTestJSON-470983266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0628f053-d0c4-45b9-b78a-da912df2ea75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:36 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1c98aa88-0783-4313-ac62-e0daae05cec9 tempest-AttachVolumeTestJSON-470983266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289c90bf-d89d-4cfe-a996-7cba07d98109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:36 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1c98aa88-0783-4313-ac62-e0daae05cec9 tempest-AttachVolumeTestJSON-470983266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (289c90bf-d89d-4cfe-a996-7cba07d98109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78fabb40-ed3c-4228-b3c0-6076e53a07ca', 'volume_name': 'volume-78fabb40-ed3c-4228-b3c0-6076e53a07ca', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:36 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1c98aa88-0783-4313-ac62-e0daae05cec9 tempest-AttachVolumeTestJSON-470983266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55b0cd8a-053f-426f-8834-69ae74bb4fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:36 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1c98aa88-0783-4313-ac62-e0daae05cec9 tempest-AttachVolumeTestJSON-470983266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55b0cd8a-053f-426f-8834-69ae74bb4fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:36 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1c98aa88-0783-4313-ac62-e0daae05cec9 tempest-AttachVolumeTestJSON-470983266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0d5f8a8-ab10-4569-a1cd-0a664a3a38b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:36 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-1c98aa88-0783-4313-ac62-e0daae05cec9 tempest-AttachVolumeTestJSON-470983266 None] Volume 78fabb40-ed3c-4228-b3c0-6076e53a07ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78fabb40-ed3c-4228-b3c0-6076e53a07ca', 'volume_size': 1} Sep 03 11:18:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1c98aa88-0783-4313-ac62-e0daae05cec9 tempest-AttachVolumeTestJSON-470983266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:18:39 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-389a56bc-33c2-4a6b-8e3a-97f027922c6c" returned: 0 in 6.565s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:39 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Image conversion details: src /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e, size 1024.00 MB, duration 6.57 sec, destination /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-389a56bc-33c2-4a6b-8e3a-97f027922c6c {{(pid=87038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:18:39 devstack cinder-volume[87038]: INFO cinder.image.image_utils [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Converted 1024.00 MB image at 155.96 MB/s Sep 03 11:18:39 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-389a56bc-33c2-4a6b-8e3a-97f027922c6c is being set with open permissions: ugo+rw Sep 03 11:18:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-389a56bc-33c2-4a6b-8e3a-97f027922c6c {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:39 devstack sudo[94826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-389a56bc-33c2-4a6b-8e3a-97f027922c6c Sep 03 11:18:39 devstack sudo[94826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:39 devstack sudo[94826]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-389a56bc-33c2-4a6b-8e3a-97f027922c6c" returned: 0 in 0.274s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:39 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-quobyte-389a56bc-33c2-4a6b-8e3a-97f027922c6c" released by "_copy_volume_from_snapshot" :: held 7.983s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:18:39 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-quobyte-029c2337-994b-4cc1-9ce5-d13e0896b3f2-389a56bc-33c2-4a6b-8e3a-97f027922c6c" released by "_create_volume_from_snapshot" :: held 8.083s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:18:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.107s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:18:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1c98aa88-0783-4313-ac62-e0daae05cec9 tempest-AttachVolumeTestJSON-470983266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.072s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:18:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1c98aa88-0783-4313-ac62-e0daae05cec9 tempest-AttachVolumeTestJSON-470983266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:18:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-80791925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78fabb40-ed3c-4228-b3c0-6076e53a07ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='640bae814fcc4d0093f0b97d498922d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:18:36Z,use_quota=True,user_id='904f07e50f244f6aa0e0658a81e4d444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:18:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-1c98aa88-0783-4313-ac62-e0daae05cec9 tempest-AttachVolumeTestJSON-470983266 None] Creating volume 78fabb40-ed3c-4228-b3c0-6076e53a07ca {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:18:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1c98aa88-0783-4313-ac62-e0daae05cec9 tempest-AttachVolumeTestJSON-470983266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:18:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1c98aa88-0783-4313-ac62-e0daae05cec9 tempest-AttachVolumeTestJSON-470983266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:18:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1c98aa88-0783-4313-ac62-e0daae05cec9 tempest-AttachVolumeTestJSON-470983266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:18:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1c98aa88-0783-4313-ac62-e0daae05cec9 tempest-AttachVolumeTestJSON-470983266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:18:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1c98aa88-0783-4313-ac62-e0daae05cec9 tempest-AttachVolumeTestJSON-470983266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:18:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1c98aa88-0783-4313-ac62-e0daae05cec9 tempest-AttachVolumeTestJSON-470983266 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:18:39 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-1c98aa88-0783-4313-ac62-e0daae05cec9 tempest-AttachVolumeTestJSON-470983266 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:18:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1c98aa88-0783-4313-ac62-e0daae05cec9 tempest-AttachVolumeTestJSON-470983266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-78fabb40-ed3c-4228-b3c0-6076e53a07ca 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:39 devstack sudo[94829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-78fabb40-ed3c-4228-b3c0-6076e53a07ca 1073741824 Sep 03 11:18:39 devstack sudo[94829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06204fed-8efc-41b1-bce0-e0c2b8bc6d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-389a56bc-33c2-4a6b-8e3a-97f027922c6c', 'volume_size': 2, 'snapshot_id': '029c2337-994b-4cc1-9ce5-d13e0896b3f2'}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a2d69c3-000e-48e5-812d-5958aaf5dfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:39 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Volume volume-389a56bc-33c2-4a6b-8e3a-97f027922c6c (389a56bc-33c2-4a6b-8e3a-97f027922c6c): created successfully Sep 03 11:18:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a2d69c3-000e-48e5-812d-5958aaf5dfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Flow 'volume_create_manager' (fe6a927a-5785-4dda-b2e0-d33d1db863ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:18:39 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-2f1e3f3f-caef-4ee7-b002-6e55fe9854dd tempest-VolumesSnapshotTestJSON-646131283 None] Created volume successfully. Sep 03 11:18:39 devstack sudo[94829]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1c98aa88-0783-4313-ac62-e0daae05cec9 tempest-AttachVolumeTestJSON-470983266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-78fabb40-ed3c-4228-b3c0-6076e53a07ca 1073741824" returned: 0 in 0.575s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1c98aa88-0783-4313-ac62-e0daae05cec9 tempest-AttachVolumeTestJSON-470983266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-78fabb40-ed3c-4228-b3c0-6076e53a07ca {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:40 devstack sudo[94835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-78fabb40-ed3c-4228-b3c0-6076e53a07ca Sep 03 11:18:40 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:40 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ea54e664-419e-430d-9cda-53ccc9fae395 tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "cinder-389a56bc-33c2-4a6b-8e3a-97f027922c6c-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:18:40 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ea54e664-419e-430d-9cda-53ccc9fae395 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-389a56bc-33c2-4a6b-8e3a-97f027922c6c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:18:40 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1c98aa88-0783-4313-ac62-e0daae05cec9 tempest-AttachVolumeTestJSON-470983266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-78fabb40-ed3c-4228-b3c0-6076e53a07ca" returned: 0 in 0.411s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:40 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1c98aa88-0783-4313-ac62-e0daae05cec9 tempest-AttachVolumeTestJSON-470983266 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:18:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1c98aa88-0783-4313-ac62-e0daae05cec9 tempest-AttachVolumeTestJSON-470983266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:18:40 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ea54e664-419e-430d-9cda-53ccc9fae395 tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "cinder-quobyte-389a56bc-33c2-4a6b-8e3a-97f027922c6c" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:18:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1c98aa88-0783-4313-ac62-e0daae05cec9 tempest-AttachVolumeTestJSON-470983266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0d5f8a8-ab10-4569-a1cd-0a664a3a38b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78fabb40-ed3c-4228-b3c0-6076e53a07ca', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1c98aa88-0783-4313-ac62-e0daae05cec9 tempest-AttachVolumeTestJSON-470983266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a9f565-7591-4610-a021-12914642ab10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:40 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ea54e664-419e-430d-9cda-53ccc9fae395 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-quobyte-389a56bc-33c2-4a6b-8e3a-97f027922c6c" acquired by "delete_volume" :: waited 0.039s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:18:40 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-1c98aa88-0783-4313-ac62-e0daae05cec9 tempest-AttachVolumeTestJSON-470983266 None] Volume volume-78fabb40-ed3c-4228-b3c0-6076e53a07ca (78fabb40-ed3c-4228-b3c0-6076e53a07ca): created successfully Sep 03 11:18:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1c98aa88-0783-4313-ac62-e0daae05cec9 tempest-AttachVolumeTestJSON-470983266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07a9f565-7591-4610-a021-12914642ab10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1c98aa88-0783-4313-ac62-e0daae05cec9 tempest-AttachVolumeTestJSON-470983266 None] Flow 'volume_create_manager' (c8f79b5b-422a-4aaa-afab-06a720d0d2ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:18:40 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57f5055-9996-4feb-96f8-b632a1c75ef6]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:18:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ea54e664-419e-430d-9cda-53ccc9fae395 tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-389a56bc-33c2-4a6b-8e3a-97f027922c6c {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:40 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-1c98aa88-0783-4313-ac62-e0daae05cec9 tempest-AttachVolumeTestJSON-470983266 None] Created volume successfully. Sep 03 11:18:40 devstack sudo[94839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-389a56bc-33c2-4a6b-8e3a-97f027922c6c Sep 03 11:18:40 devstack sudo[94839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:40 devstack sudo[94839]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ea54e664-419e-430d-9cda-53ccc9fae395 tempest-VolumesSnapshotTestJSON-646131283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-389a56bc-33c2-4a6b-8e3a-97f027922c6c" returned: 0 in 0.400s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ea54e664-419e-430d-9cda-53ccc9fae395 tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-389a56bc-33c2-4a6b-8e3a-97f027922c6c {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:40 devstack sudo[94846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-389a56bc-33c2-4a6b-8e3a-97f027922c6c Sep 03 11:18:40 devstack sudo[94846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:41 devstack sudo[94846]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ea54e664-419e-430d-9cda-53ccc9fae395 tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-389a56bc-33c2-4a6b-8e3a-97f027922c6c" returned: 0 in 0.346s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ea54e664-419e-430d-9cda-53ccc9fae395 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-quobyte-389a56bc-33c2-4a6b-8e3a-97f027922c6c" released by "delete_volume" :: held 0.822s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:18:41 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-ea54e664-419e-430d-9cda-53ccc9fae395 tempest-VolumesSnapshotTestJSON-646131283 None] Created reservations ['66115164-39bf-4080-863d-4911c763e902', '97a9a46c-18b9-4ac6-8354-149cdaf7d396', '55139ee9-2460-40ad-a6b7-252229a58d3d', 'd08526c2-fc80-459e-bd52-e0790d25fa67'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:18:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ea54e664-419e-430d-9cda-53ccc9fae395 tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:18:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ea54e664-419e-430d-9cda-53ccc9fae395 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:18:41 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ea54e664-419e-430d-9cda-53ccc9fae395 tempest-VolumesSnapshotTestJSON-646131283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:18:41 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ea54e664-419e-430d-9cda-53ccc9fae395 tempest-VolumesSnapshotTestJSON-646131283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:18:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ea54e664-419e-430d-9cda-53ccc9fae395 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:18:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ea54e664-419e-430d-9cda-53ccc9fae395 tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:41 devstack sudo[94854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:18:41 devstack sudo[94854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-09c6462b-fb94-4702-845a-0a74fff33acb tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "cinder-029c2337-994b-4cc1-9ce5-d13e0896b3f2-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:18:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-09c6462b-fb94-4702-845a-0a74fff33acb tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-029c2337-994b-4cc1-9ce5-d13e0896b3f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:18:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-09c6462b-fb94-4702-845a-0a74fff33acb tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "cinder-quobyte-365ff714-494e-4e41-939a-e3240a40454e" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:18:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-09c6462b-fb94-4702-845a-0a74fff33acb tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-quobyte-365ff714-494e-4e41-939a-e3240a40454e" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:18:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-09c6462b-fb94-4702-845a-0a74fff33acb tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "cinder-quobyte-029c2337-994b-4cc1-9ce5-d13e0896b3f2" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:18:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-09c6462b-fb94-4702-845a-0a74fff33acb tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-quobyte-029c2337-994b-4cc1-9ce5-d13e0896b3f2" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:18:41 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-09c6462b-fb94-4702-845a-0a74fff33acb tempest-VolumesSnapshotTestJSON-646131283 None] Deleting offline snapshot 029c2337-994b-4cc1-9ce5-d13e0896b3f2 of volume 365ff714-494e-4e41-939a-e3240a40454e {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:18:41 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-09c6462b-fb94-4702-845a-0a74fff33acb tempest-VolumesSnapshotTestJSON-646131283 None] snapshot_file for this snap is: volume-365ff714-494e-4e41-939a-e3240a40454e.029c2337-994b-4cc1-9ce5-d13e0896b3f2 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:18:41 devstack sudo[94854]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ea54e664-419e-430d-9cda-53ccc9fae395 tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.462s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:41 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-ea54e664-419e-430d-9cda-53ccc9fae395 tempest-VolumesSnapshotTestJSON-646131283 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:18:41 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a92a10f-19e7-47a9-aa33-fecc119295b0]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:18:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-09c6462b-fb94-4702-845a-0a74fff33acb tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e.029c2337-994b-4cc1-9ce5-d13e0896b3f2 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:41 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-ea54e664-419e-430d-9cda-53ccc9fae395 tempest-VolumesSnapshotTestJSON-646131283 None] Deleted volume successfully. Sep 03 11:18:42 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ea54e664-419e-430d-9cda-53ccc9fae395 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-389a56bc-33c2-4a6b-8e3a-97f027922c6c-delete_volume" released by "delete_volume" :: held 1.637s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:18:42 devstack sudo[94857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e.029c2337-994b-4cc1-9ce5-d13e0896b3f2 Sep 03 11:18:42 devstack sudo[94857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:42 devstack sudo[94857]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-09c6462b-fb94-4702-845a-0a74fff33acb tempest-VolumesSnapshotTestJSON-646131283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e.029c2337-994b-4cc1-9ce5-d13e0896b3f2" returned: 0 in 0.533s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:42 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-09c6462b-fb94-4702-845a-0a74fff33acb tempest-VolumesSnapshotTestJSON-646131283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-365ff714-494e-4e41-939a-e3240a40454e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:18:42 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dc6295a-072a-45b3-8f27-96c387c9b098]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:18:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-09c6462b-fb94-4702-845a-0a74fff33acb tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-fb25f6e9-f1c2-4841-a44f-c2ca2cfaa30b req-56f32b98-8e0a-4f58-93d9-9bbd834ebc87 tempest-AttachVolumeTestJSON-470983266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:18:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-fb25f6e9-f1c2-4841-a44f-c2ca2cfaa30b req-56f32b98-8e0a-4f58-93d9-9bbd834ebc87 tempest-AttachVolumeTestJSON-470983266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:18:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-fb25f6e9-f1c2-4841-a44f-c2ca2cfaa30b req-56f32b98-8e0a-4f58-93d9-9bbd834ebc87 tempest-AttachVolumeTestJSON-470983266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:18:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-fb25f6e9-f1c2-4841-a44f-c2ca2cfaa30b req-56f32b98-8e0a-4f58-93d9-9bbd834ebc87 tempest-AttachVolumeTestJSON-470983266 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912', 'name': 'volume-78fabb40-ed3c-4228-b3c0-6076e53a07ca', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1a14d62a-ccb0-4c4c-8e7a-cdb6c12a8cd3', 'enforce_multipath': True} {{(pid=87038) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:18:42 devstack sudo[94871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e Sep 03 11:18:42 devstack sudo[94871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:42 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-fb25f6e9-f1c2-4841-a44f-c2ca2cfaa30b req-56f32b98-8e0a-4f58-93d9-9bbd834ebc87 tempest-AttachVolumeTestJSON-470983266 None] attachment_update completed successfully. Sep 03 11:18:43 devstack sudo[94871]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-09c6462b-fb94-4702-845a-0a74fff33acb tempest-VolumesSnapshotTestJSON-646131283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e" returned: 0 in 1.058s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-09c6462b-fb94-4702-845a-0a74fff33acb tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e.029c2337-994b-4cc1-9ce5-d13e0896b3f2 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:43 devstack sudo[94879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e.029c2337-994b-4cc1-9ce5-d13e0896b3f2 Sep 03 11:18:43 devstack sudo[94879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:44 devstack sudo[94879]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-09c6462b-fb94-4702-845a-0a74fff33acb tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e.029c2337-994b-4cc1-9ce5-d13e0896b3f2" returned: 0 in 0.771s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-09c6462b-fb94-4702-845a-0a74fff33acb tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e.029c2337-994b-4cc1-9ce5-d13e0896b3f2 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:44 devstack sudo[94930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e.029c2337-994b-4cc1-9ce5-d13e0896b3f2 Sep 03 11:18:44 devstack sudo[94930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:44 devstack sudo[94930]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-09c6462b-fb94-4702-845a-0a74fff33acb tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e.029c2337-994b-4cc1-9ce5-d13e0896b3f2" returned: 0 in 0.485s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:44 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-09c6462b-fb94-4702-845a-0a74fff33acb tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-quobyte-029c2337-994b-4cc1-9ce5-d13e0896b3f2" released by "_delete_snapshot" :: held 3.059s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:18:44 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-09c6462b-fb94-4702-845a-0a74fff33acb tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-quobyte-365ff714-494e-4e41-939a-e3240a40454e" released by "delete_snapshot" :: held 3.093s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:18:45 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-09c6462b-fb94-4702-845a-0a74fff33acb tempest-VolumesSnapshotTestJSON-646131283 None] Created reservations ['8ae10859-ed71-4910-8d10-041c582a9a23', '6f239538-8037-4032-88e8-fc30f12c725d', '504b5f9c-5e6d-4e83-9e4a-7010d96f712f', '8c05e17b-bbb6-4e74-bdf4-7ff7dc51ef2f'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:18:45 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-09c6462b-fb94-4702-845a-0a74fff33acb tempest-VolumesSnapshotTestJSON-646131283 None] Delete snapshot completed successfully. Sep 03 11:18:45 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-09c6462b-fb94-4702-845a-0a74fff33acb tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-029c2337-994b-4cc1-9ce5-d13e0896b3f2-delete_snapshot" released by "delete_snapshot" :: held 3.412s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:18:46 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a66d08d-4570-4790-8d36-1176d521cf9c tempest-AttachVolumeTestJSON-470983266 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:18:46 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7a66d08d-4570-4790-8d36-1176d521cf9c tempest-AttachVolumeTestJSON-470983266 None] Flow 'volume_create_manager' (eeaade4a-1fa8-4ffa-b36f-81e38d8ba4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:18:46 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7a66d08d-4570-4790-8d36-1176d521cf9c tempest-AttachVolumeTestJSON-470983266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (200a5c83-a15b-42b4-a945-6c19b171733b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:46 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7a66d08d-4570-4790-8d36-1176d521cf9c tempest-AttachVolumeTestJSON-470983266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (200a5c83-a15b-42b4-a945-6c19b171733b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-801574778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e61d8bb3-a4ed-4f9b-bcb0-2b566a576fee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='640bae814fcc4d0093f0b97d498922d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:18:46Z,use_quota=True,user_id='904f07e50f244f6aa0e0658a81e4d444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:46 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7a66d08d-4570-4790-8d36-1176d521cf9c tempest-AttachVolumeTestJSON-470983266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1206d28-83ca-4d28-8384-2b88a6754a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:46 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7a66d08d-4570-4790-8d36-1176d521cf9c tempest-AttachVolumeTestJSON-470983266 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1206d28-83ca-4d28-8384-2b88a6754a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:46 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7a66d08d-4570-4790-8d36-1176d521cf9c tempest-AttachVolumeTestJSON-470983266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba54c7f3-7394-4304-a435-f9909ff80658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:46 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7a66d08d-4570-4790-8d36-1176d521cf9c tempest-AttachVolumeTestJSON-470983266 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba54c7f3-7394-4304-a435-f9909ff80658) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e61d8bb3-a4ed-4f9b-bcb0-2b566a576fee', 'volume_name': 'volume-e61d8bb3-a4ed-4f9b-bcb0-2b566a576fee', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:46 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7a66d08d-4570-4790-8d36-1176d521cf9c tempest-AttachVolumeTestJSON-470983266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (790fccab-acea-4e50-83d7-b54e7ee48d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:46 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7a66d08d-4570-4790-8d36-1176d521cf9c tempest-AttachVolumeTestJSON-470983266 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (790fccab-acea-4e50-83d7-b54e7ee48d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:46 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7a66d08d-4570-4790-8d36-1176d521cf9c tempest-AttachVolumeTestJSON-470983266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a19b0a85-9f88-4eda-aa1e-c128476cad58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:46 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-7a66d08d-4570-4790-8d36-1176d521cf9c tempest-AttachVolumeTestJSON-470983266 None] Volume e61d8bb3-a4ed-4f9b-bcb0-2b566a576fee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e61d8bb3-a4ed-4f9b-bcb0-2b566a576fee', 'volume_size': 1} Sep 03 11:18:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7a66d08d-4570-4790-8d36-1176d521cf9c tempest-AttachVolumeTestJSON-470983266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:18:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7a66d08d-4570-4790-8d36-1176d521cf9c tempest-AttachVolumeTestJSON-470983266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:18:46 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7a66d08d-4570-4790-8d36-1176d521cf9c tempest-AttachVolumeTestJSON-470983266 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-801574778',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e61d8bb3-a4ed-4f9b-bcb0-2b566a576fee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='640bae814fcc4d0093f0b97d498922d0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:18:46Z,use_quota=True,user_id='904f07e50f244f6aa0e0658a81e4d444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:18:46 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-7a66d08d-4570-4790-8d36-1176d521cf9c tempest-AttachVolumeTestJSON-470983266 None] Creating volume e61d8bb3-a4ed-4f9b-bcb0-2b566a576fee {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:18:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7a66d08d-4570-4790-8d36-1176d521cf9c tempest-AttachVolumeTestJSON-470983266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:18:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7a66d08d-4570-4790-8d36-1176d521cf9c tempest-AttachVolumeTestJSON-470983266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:18:46 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7a66d08d-4570-4790-8d36-1176d521cf9c tempest-AttachVolumeTestJSON-470983266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:18:46 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7a66d08d-4570-4790-8d36-1176d521cf9c tempest-AttachVolumeTestJSON-470983266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:18:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7a66d08d-4570-4790-8d36-1176d521cf9c tempest-AttachVolumeTestJSON-470983266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:18:46 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7a66d08d-4570-4790-8d36-1176d521cf9c tempest-AttachVolumeTestJSON-470983266 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:18:46 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-7a66d08d-4570-4790-8d36-1176d521cf9c tempest-AttachVolumeTestJSON-470983266 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:18:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7a66d08d-4570-4790-8d36-1176d521cf9c tempest-AttachVolumeTestJSON-470983266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e61d8bb3-a4ed-4f9b-bcb0-2b566a576fee 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:46 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f1ba6e57-aa58-4bed-95ed-e6fd2f5cb782 tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "cinder-365ff714-494e-4e41-939a-e3240a40454e-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:18:46 devstack sudo[94974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e61d8bb3-a4ed-4f9b-bcb0-2b566a576fee 1073741824 Sep 03 11:18:46 devstack sudo[94974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:46 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f1ba6e57-aa58-4bed-95ed-e6fd2f5cb782 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-365ff714-494e-4e41-939a-e3240a40454e-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:18:46 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f1ba6e57-aa58-4bed-95ed-e6fd2f5cb782 tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "cinder-quobyte-365ff714-494e-4e41-939a-e3240a40454e" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:18:46 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f1ba6e57-aa58-4bed-95ed-e6fd2f5cb782 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-quobyte-365ff714-494e-4e41-939a-e3240a40454e" acquired by "delete_volume" :: waited 0.020s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:18:46 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61fea46-c678-440e-b3b5-4a3a66229c5b]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:18:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f1ba6e57-aa58-4bed-95ed-e6fd2f5cb782 tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:46 devstack sudo[94976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e Sep 03 11:18:46 devstack sudo[94976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:47 devstack sudo[94974]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7a66d08d-4570-4790-8d36-1176d521cf9c tempest-AttachVolumeTestJSON-470983266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e61d8bb3-a4ed-4f9b-bcb0-2b566a576fee 1073741824" returned: 0 in 0.739s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7a66d08d-4570-4790-8d36-1176d521cf9c tempest-AttachVolumeTestJSON-470983266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e61d8bb3-a4ed-4f9b-bcb0-2b566a576fee {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:47 devstack sudo[94976]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f1ba6e57-aa58-4bed-95ed-e6fd2f5cb782 tempest-VolumesSnapshotTestJSON-646131283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e" returned: 0 in 0.708s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f1ba6e57-aa58-4bed-95ed-e6fd2f5cb782 tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:47 devstack sudo[94986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e61d8bb3-a4ed-4f9b-bcb0-2b566a576fee Sep 03 11:18:47 devstack sudo[94986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:47 devstack sudo[94987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e Sep 03 11:18:47 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:47 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f1ba6e57-aa58-4bed-95ed-e6fd2f5cb782 tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-365ff714-494e-4e41-939a-e3240a40454e" returned: 0 in 0.395s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:47 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f1ba6e57-aa58-4bed-95ed-e6fd2f5cb782 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-quobyte-365ff714-494e-4e41-939a-e3240a40454e" released by "delete_volume" :: held 1.203s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:18:47 devstack sudo[94986]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7a66d08d-4570-4790-8d36-1176d521cf9c tempest-AttachVolumeTestJSON-470983266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e61d8bb3-a4ed-4f9b-bcb0-2b566a576fee" returned: 0 in 0.500s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:47 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7a66d08d-4570-4790-8d36-1176d521cf9c tempest-AttachVolumeTestJSON-470983266 None] <== create_volume: return (1364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:18:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7a66d08d-4570-4790-8d36-1176d521cf9c tempest-AttachVolumeTestJSON-470983266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:18:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7a66d08d-4570-4790-8d36-1176d521cf9c tempest-AttachVolumeTestJSON-470983266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a19b0a85-9f88-4eda-aa1e-c128476cad58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e61d8bb3-a4ed-4f9b-bcb0-2b566a576fee', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7a66d08d-4570-4790-8d36-1176d521cf9c tempest-AttachVolumeTestJSON-470983266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40388014-e7b7-4daf-bcae-57653c868198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:47 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-7a66d08d-4570-4790-8d36-1176d521cf9c tempest-AttachVolumeTestJSON-470983266 None] Volume volume-e61d8bb3-a4ed-4f9b-bcb0-2b566a576fee (e61d8bb3-a4ed-4f9b-bcb0-2b566a576fee): created successfully Sep 03 11:18:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7a66d08d-4570-4790-8d36-1176d521cf9c tempest-AttachVolumeTestJSON-470983266 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40388014-e7b7-4daf-bcae-57653c868198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7a66d08d-4570-4790-8d36-1176d521cf9c tempest-AttachVolumeTestJSON-470983266 None] Flow 'volume_create_manager' (eeaade4a-1fa8-4ffa-b36f-81e38d8ba4d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:18:47 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-f1ba6e57-aa58-4bed-95ed-e6fd2f5cb782 tempest-VolumesSnapshotTestJSON-646131283 None] Created reservations ['859854ed-e04d-41b4-b33a-9358434923cf', '19eec1d9-05a4-4064-ae09-84390449edc1', '2c784d56-8a92-4cbc-bb87-89f42840f6e4', '31d3737e-7c0d-4533-b23c-c11fe3591167'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:18:47 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-7a66d08d-4570-4790-8d36-1176d521cf9c tempest-AttachVolumeTestJSON-470983266 None] Created volume successfully. Sep 03 11:18:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f1ba6e57-aa58-4bed-95ed-e6fd2f5cb782 tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:18:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f1ba6e57-aa58-4bed-95ed-e6fd2f5cb782 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:18:47 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f1ba6e57-aa58-4bed-95ed-e6fd2f5cb782 tempest-VolumesSnapshotTestJSON-646131283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:18:47 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f1ba6e57-aa58-4bed-95ed-e6fd2f5cb782 tempest-VolumesSnapshotTestJSON-646131283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:18:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f1ba6e57-aa58-4bed-95ed-e6fd2f5cb782 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:18:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f1ba6e57-aa58-4bed-95ed-e6fd2f5cb782 tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:47 devstack sudo[94993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:18:47 devstack sudo[94993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:48 devstack sudo[94993]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f1ba6e57-aa58-4bed-95ed-e6fd2f5cb782 tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.502s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:48 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-f1ba6e57-aa58-4bed-95ed-e6fd2f5cb782 tempest-VolumesSnapshotTestJSON-646131283 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:18:48 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-f1ba6e57-aa58-4bed-95ed-e6fd2f5cb782 tempest-VolumesSnapshotTestJSON-646131283 None] Deleted volume successfully. Sep 03 11:18:48 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f1ba6e57-aa58-4bed-95ed-e6fd2f5cb782 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-365ff714-494e-4e41-939a-e3240a40454e-delete_volume" released by "delete_volume" :: held 2.039s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:18:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-a634048b-9dc8-4a9f-bddd-ef1657cd5866 req-cf857ed4-cd81-42b1-b7ba-506bf59dd6b1 tempest-AttachVolumeTestJSON-470983266 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:18:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-a634048b-9dc8-4a9f-bddd-ef1657cd5866 req-cf857ed4-cd81-42b1-b7ba-506bf59dd6b1 tempest-AttachVolumeTestJSON-470983266 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:18:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-a634048b-9dc8-4a9f-bddd-ef1657cd5866 req-cf857ed4-cd81-42b1-b7ba-506bf59dd6b1 tempest-AttachVolumeTestJSON-470983266 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:18:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-a634048b-9dc8-4a9f-bddd-ef1657cd5866 req-cf857ed4-cd81-42b1-b7ba-506bf59dd6b1 tempest-AttachVolumeTestJSON-470983266 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912', 'name': 'volume-e61d8bb3-a4ed-4f9b-bcb0-2b566a576fee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2fb9f9e5-a905-4e6b-9a57-9b2d01472bc4', 'enforce_multipath': True} {{(pid=87038) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:18:50 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-a634048b-9dc8-4a9f-bddd-ef1657cd5866 req-cf857ed4-cd81-42b1-b7ba-506bf59dd6b1 tempest-AttachVolumeTestJSON-470983266 None] attachment_update completed successfully. Sep 03 11:18:50 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-11745aa4-86ee-46c4-9921-31c358d2a283 tempest-VolumesSnapshotTestJSON-646131283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:18:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-11745aa4-86ee-46c4-9921-31c358d2a283 tempest-VolumesSnapshotTestJSON-646131283 None] Flow 'volume_create_manager' (7befea5e-b889-4b6a-9406-f83add047817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:18:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-11745aa4-86ee-46c4-9921-31c358d2a283 tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55f5c290-4dc2-4d7b-b3ea-f6a0400da742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-11745aa4-86ee-46c4-9921-31c358d2a283 tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55f5c290-4dc2-4d7b-b3ea-f6a0400da742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-555109513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed3a7ccc-f43e-441a-924e-b3db614caae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f6c59ae1cf246f1887744ceb45bf69b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:18:50Z,use_quota=True,user_id='d5030fa0be77435bbc51b81f5ffd8a2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-11745aa4-86ee-46c4-9921-31c358d2a283 tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89c11a5b-96fa-4ff8-827b-2303cc1e077f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-11745aa4-86ee-46c4-9921-31c358d2a283 tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89c11a5b-96fa-4ff8-827b-2303cc1e077f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-11745aa4-86ee-46c4-9921-31c358d2a283 tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (171fa325-1599-43a6-9fed-84e9d16eaa9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-11745aa4-86ee-46c4-9921-31c358d2a283 tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (171fa325-1599-43a6-9fed-84e9d16eaa9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed3a7ccc-f43e-441a-924e-b3db614caae4', 'volume_name': 'volume-ed3a7ccc-f43e-441a-924e-b3db614caae4', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-11745aa4-86ee-46c4-9921-31c358d2a283 tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1daef1f-722a-4225-b546-c1d85589b95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-11745aa4-86ee-46c4-9921-31c358d2a283 tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1daef1f-722a-4225-b546-c1d85589b95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-11745aa4-86ee-46c4-9921-31c358d2a283 tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea429c5d-20b7-4f4b-b169-851b99d9343e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:50 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-11745aa4-86ee-46c4-9921-31c358d2a283 tempest-VolumesSnapshotTestJSON-646131283 None] Volume ed3a7ccc-f43e-441a-924e-b3db614caae4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed3a7ccc-f43e-441a-924e-b3db614caae4', 'volume_size': 1} Sep 03 11:18:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-11745aa4-86ee-46c4-9921-31c358d2a283 tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:18:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-11745aa4-86ee-46c4-9921-31c358d2a283 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:18:50 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-11745aa4-86ee-46c4-9921-31c358d2a283 tempest-VolumesSnapshotTestJSON-646131283 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:18:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-555109513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed3a7ccc-f43e-441a-924e-b3db614caae4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f6c59ae1cf246f1887744ceb45bf69b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:18:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:18:50Z,use_quota=True,user_id='d5030fa0be77435bbc51b81f5ffd8a2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:18:50 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-11745aa4-86ee-46c4-9921-31c358d2a283 tempest-VolumesSnapshotTestJSON-646131283 None] Creating volume ed3a7ccc-f43e-441a-924e-b3db614caae4 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:18:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-11745aa4-86ee-46c4-9921-31c358d2a283 tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:18:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-11745aa4-86ee-46c4-9921-31c358d2a283 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:18:50 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-11745aa4-86ee-46c4-9921-31c358d2a283 tempest-VolumesSnapshotTestJSON-646131283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:18:50 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-11745aa4-86ee-46c4-9921-31c358d2a283 tempest-VolumesSnapshotTestJSON-646131283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:18:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-11745aa4-86ee-46c4-9921-31c358d2a283 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:18:50 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-11745aa4-86ee-46c4-9921-31c358d2a283 tempest-VolumesSnapshotTestJSON-646131283 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:18:50 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-11745aa4-86ee-46c4-9921-31c358d2a283 tempest-VolumesSnapshotTestJSON-646131283 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:18:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-11745aa4-86ee-46c4-9921-31c358d2a283 tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:50 devstack sudo[95029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4 1073741824 Sep 03 11:18:50 devstack sudo[95029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:51 devstack sudo[95029]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-11745aa4-86ee-46c4-9921-31c358d2a283 tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4 1073741824" returned: 0 in 0.804s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-11745aa4-86ee-46c4-9921-31c358d2a283 tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:51 devstack sudo[95036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4 Sep 03 11:18:51 devstack sudo[95036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:51 devstack sudo[95036]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-11745aa4-86ee-46c4-9921-31c358d2a283 tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4" returned: 0 in 0.371s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:51 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-11745aa4-86ee-46c4-9921-31c358d2a283 tempest-VolumesSnapshotTestJSON-646131283 None] <== create_volume: return (1253ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:18:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-11745aa4-86ee-46c4-9921-31c358d2a283 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:18:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-11745aa4-86ee-46c4-9921-31c358d2a283 tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea429c5d-20b7-4f4b-b169-851b99d9343e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed3a7ccc-f43e-441a-924e-b3db614caae4', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-11745aa4-86ee-46c4-9921-31c358d2a283 tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66f09879-2c3f-4ff4-86ea-e99e1d9f0644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:51 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-11745aa4-86ee-46c4-9921-31c358d2a283 tempest-VolumesSnapshotTestJSON-646131283 None] Volume volume-ed3a7ccc-f43e-441a-924e-b3db614caae4 (ed3a7ccc-f43e-441a-924e-b3db614caae4): created successfully Sep 03 11:18:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-11745aa4-86ee-46c4-9921-31c358d2a283 tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66f09879-2c3f-4ff4-86ea-e99e1d9f0644) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-11745aa4-86ee-46c4-9921-31c358d2a283 tempest-VolumesSnapshotTestJSON-646131283 None] Flow 'volume_create_manager' (7befea5e-b889-4b6a-9406-f83add047817) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:18:51 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-11745aa4-86ee-46c4-9921-31c358d2a283 tempest-VolumesSnapshotTestJSON-646131283 None] Created volume successfully. Sep 03 11:18:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f4635acf-40a9-413f-91a9-33202cb00272 tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:18:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f4635acf-40a9-413f-91a9-33202cb00272 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:18:52 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-f4635acf-40a9-413f-91a9-33202cb00272 tempest-VolumesSnapshotTestJSON-646131283 None] Creating offline snapshot b1d6d328-8959-42e1-b70a-30315b9ec2aa of volume ed3a7ccc-f43e-441a-924e-b3db614caae4 {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:18:52 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d4fd01f-01d9-4ab2-b8a9-549666a0dd61]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:18:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f4635acf-40a9-413f-91a9-33202cb00272 tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:53 devstack sudo[95059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4 Sep 03 11:18:53 devstack sudo[95059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:53 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-c340a353-3264-48c4-b2d0-ecdd18d46eb0 req-8d306d87-97f7-4354-91b0-e227253b9f5b tempest-AttachVolumeTestJSON-470983266 None] Terminate volume connection completed successfully. Sep 03 11:18:53 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-c340a353-3264-48c4-b2d0-ecdd18d46eb0 req-8d306d87-97f7-4354-91b0-e227253b9f5b tempest-AttachVolumeTestJSON-470983266 None] Deleting attachment 1a14d62a-ccb0-4c4c-8e7a-cdb6c12a8cd3. {{(pid=87038) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:18:53 devstack sudo[95059]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f4635acf-40a9-413f-91a9-33202cb00272 tempest-VolumesSnapshotTestJSON-646131283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4" returned: 0 in 0.810s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f4635acf-40a9-413f-91a9-33202cb00272 tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4.b1d6d328-8959-42e1-b70a-30315b9ec2aa 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:53 devstack sudo[95105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4.b1d6d328-8959-42e1-b70a-30315b9ec2aa 1G Sep 03 11:18:53 devstack sudo[95105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:54 devstack sudo[95105]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f4635acf-40a9-413f-91a9-33202cb00272 tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4.b1d6d328-8959-42e1-b70a-30315b9ec2aa 1G" returned: 0 in 0.851s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f4635acf-40a9-413f-91a9-33202cb00272 tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed3a7ccc-f43e-441a-924e-b3db614caae4 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4.b1d6d328-8959-42e1-b70a-30315b9ec2aa {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:54 devstack sudo[95126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed3a7ccc-f43e-441a-924e-b3db614caae4 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4.b1d6d328-8959-42e1-b70a-30315b9ec2aa Sep 03 11:18:54 devstack sudo[95126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:55 devstack sudo[95126]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f4635acf-40a9-413f-91a9-33202cb00272 tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed3a7ccc-f43e-441a-924e-b3db614caae4 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4.b1d6d328-8959-42e1-b70a-30315b9ec2aa" returned: 0 in 0.530s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:55 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-f4635acf-40a9-413f-91a9-33202cb00272 tempest-VolumesSnapshotTestJSON-646131283 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4.b1d6d328-8959-42e1-b70a-30315b9ec2aa is being set with open permissions: ugo+rw Sep 03 11:18:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f4635acf-40a9-413f-91a9-33202cb00272 tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4.b1d6d328-8959-42e1-b70a-30315b9ec2aa {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:55 devstack sudo[95134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4.b1d6d328-8959-42e1-b70a-30315b9ec2aa Sep 03 11:18:55 devstack sudo[95134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:55 devstack sudo[95134]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f4635acf-40a9-413f-91a9-33202cb00272 tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4.b1d6d328-8959-42e1-b70a-30315b9ec2aa" returned: 0 in 0.387s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f4635acf-40a9-413f-91a9-33202cb00272 tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:55 devstack sudo[95138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4.info Sep 03 11:18:55 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:55 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f4635acf-40a9-413f-91a9-33202cb00272 tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4.info" returned: 0 in 0.418s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:55 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-f4635acf-40a9-413f-91a9-33202cb00272 tempest-VolumesSnapshotTestJSON-646131283 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4.info is being set with open permissions: ugo+rw Sep 03 11:18:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f4635acf-40a9-413f-91a9-33202cb00272 tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:55 devstack sudo[95143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4.info Sep 03 11:18:55 devstack sudo[95143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:55 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-caf12ebf-5466-41cf-9673-5b64c74cf218 req-726e8c66-3c48-4d5a-bdae-0d2e8afce5de tempest-AttachVolumeTestJSON-470983266 None] Terminate volume connection completed successfully. Sep 03 11:18:55 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-caf12ebf-5466-41cf-9673-5b64c74cf218 req-726e8c66-3c48-4d5a-bdae-0d2e8afce5de tempest-AttachVolumeTestJSON-470983266 None] Deleting attachment 2fb9f9e5-a905-4e6b-9a57-9b2d01472bc4. {{(pid=87038) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:18:56 devstack sudo[95143]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f4635acf-40a9-413f-91a9-33202cb00272 tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4.info" returned: 0 in 0.355s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f4635acf-40a9-413f-91a9-33202cb00272 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.545s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:18:56 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-f4635acf-40a9-413f-91a9-33202cb00272 tempest-VolumesSnapshotTestJSON-646131283 None] Create snapshot completed successfully Sep 03 11:18:57 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6f73973-1979-413c-a7ac-3a3a5e41283b tempest-VolumesActionsTest-849658457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:18:57 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d6f73973-1979-413c-a7ac-3a3a5e41283b tempest-VolumesActionsTest-849658457 None] Flow 'volume_create_manager' (0f549a08-f8ea-47b5-9d14-2ec384400724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:18:57 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d6f73973-1979-413c-a7ac-3a3a5e41283b tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a705c2-fdd5-4fc8-9c8b-a5382e9e9d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:57 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d6f73973-1979-413c-a7ac-3a3a5e41283b tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a705c2-fdd5-4fc8-9c8b-a5382e9e9d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1381761852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=628a2fbf-5933-40a1-95dd-f1f79ff1b52b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68554cd8f42e427692f2042c9e6db115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:18:57Z,use_quota=True,user_id='9fdff0e3f9c54adb90c508fb6ea826d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:57 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d6f73973-1979-413c-a7ac-3a3a5e41283b tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59bdaac5-7b81-4482-adf7-f7d470e86afb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:57 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d6f73973-1979-413c-a7ac-3a3a5e41283b tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59bdaac5-7b81-4482-adf7-f7d470e86afb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:57 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d6f73973-1979-413c-a7ac-3a3a5e41283b tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8065f6d0-9898-42ac-bc1e-f1e5b6af401d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:57 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d6f73973-1979-413c-a7ac-3a3a5e41283b tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8065f6d0-9898-42ac-bc1e-f1e5b6af401d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '628a2fbf-5933-40a1-95dd-f1f79ff1b52b', 'volume_name': 'volume-628a2fbf-5933-40a1-95dd-f1f79ff1b52b', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:57 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d6f73973-1979-413c-a7ac-3a3a5e41283b tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d98af9d-15a3-4965-9913-2889695c6b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:57 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d6f73973-1979-413c-a7ac-3a3a5e41283b tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d98af9d-15a3-4965-9913-2889695c6b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:57 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d6f73973-1979-413c-a7ac-3a3a5e41283b tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b23dd0c1-de6f-4136-9158-015dd7362c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:57 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-d6f73973-1979-413c-a7ac-3a3a5e41283b tempest-VolumesActionsTest-849658457 None] Volume 628a2fbf-5933-40a1-95dd-f1f79ff1b52b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-628a2fbf-5933-40a1-95dd-f1f79ff1b52b', 'volume_size': 1} Sep 03 11:18:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d6f73973-1979-413c-a7ac-3a3a5e41283b tempest-VolumesActionsTest-849658457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:18:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d6f73973-1979-413c-a7ac-3a3a5e41283b tempest-VolumesActionsTest-849658457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:18:57 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d6f73973-1979-413c-a7ac-3a3a5e41283b tempest-VolumesActionsTest-849658457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1381761852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=628a2fbf-5933-40a1-95dd-f1f79ff1b52b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68554cd8f42e427692f2042c9e6db115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:18:57Z,use_quota=True,user_id='9fdff0e3f9c54adb90c508fb6ea826d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:18:57 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-d6f73973-1979-413c-a7ac-3a3a5e41283b tempest-VolumesActionsTest-849658457 None] Creating volume 628a2fbf-5933-40a1-95dd-f1f79ff1b52b {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:18:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d6f73973-1979-413c-a7ac-3a3a5e41283b tempest-VolumesActionsTest-849658457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:18:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d6f73973-1979-413c-a7ac-3a3a5e41283b tempest-VolumesActionsTest-849658457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:18:57 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d6f73973-1979-413c-a7ac-3a3a5e41283b tempest-VolumesActionsTest-849658457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:18:57 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d6f73973-1979-413c-a7ac-3a3a5e41283b tempest-VolumesActionsTest-849658457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:18:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d6f73973-1979-413c-a7ac-3a3a5e41283b tempest-VolumesActionsTest-849658457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:18:57 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d6f73973-1979-413c-a7ac-3a3a5e41283b tempest-VolumesActionsTest-849658457 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:18:57 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-d6f73973-1979-413c-a7ac-3a3a5e41283b tempest-VolumesActionsTest-849658457 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:18:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d6f73973-1979-413c-a7ac-3a3a5e41283b tempest-VolumesActionsTest-849658457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-628a2fbf-5933-40a1-95dd-f1f79ff1b52b 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:57 devstack sudo[95148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-628a2fbf-5933-40a1-95dd-f1f79ff1b52b 1073741824 Sep 03 11:18:57 devstack sudo[95148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:58 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:18:58 devstack sudo[95148]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d6f73973-1979-413c-a7ac-3a3a5e41283b tempest-VolumesActionsTest-849658457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-628a2fbf-5933-40a1-95dd-f1f79ff1b52b 1073741824" returned: 0 in 0.950s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:58 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Flow 'volume_create_manager' (2193d364-a989-431c-9322-18b00c2a57db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:18:58 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e12e2ab-cfae-4a16-98b2-e2b8af7927d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:58 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e12e2ab-cfae-4a16-98b2-e2b8af7927d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-47981940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa89f44d-2d66-4b30-8901-68b193d5a495,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1f6c59ae1cf246f1887744ceb45bf69b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b1d6d328-8959-42e1-b70a-30315b9ec2aa,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:18:58Z,use_quota=True,user_id='d5030fa0be77435bbc51b81f5ffd8a2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:58 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e646a9-ae8e-4850-b316-ba9ef9c37e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:58 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0e646a9-ae8e-4850-b316-ba9ef9c37e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:58 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (226e9952-0542-448d-9c34-0f7010fbf4c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:58 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (226e9952-0542-448d-9c34-0f7010fbf4c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'aa89f44d-2d66-4b30-8901-68b193d5a495', 'volume_name': 'volume-aa89f44d-2d66-4b30-8901-68b193d5a495', 'volume_size': 1, 'snapshot_id': 'b1d6d328-8959-42e1-b70a-30315b9ec2aa'}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:58 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9294b26-b686-4d7b-8e4a-d9dbcd162bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:58 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d9294b26-b686-4d7b-8e4a-d9dbcd162bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:58 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd19392f-e6c5-4654-8d18-2b6ab3df9ac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:58 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Volume aa89f44d-2d66-4b30-8901-68b193d5a495: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-aa89f44d-2d66-4b30-8901-68b193d5a495', 'volume_size': 1, 'snapshot_id': 'b1d6d328-8959-42e1-b70a-30315b9ec2aa'} Sep 03 11:18:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:18:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d6f73973-1979-413c-a7ac-3a3a5e41283b tempest-VolumesActionsTest-849658457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-628a2fbf-5933-40a1-95dd-f1f79ff1b52b {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:58 devstack sudo[95175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-628a2fbf-5933-40a1-95dd-f1f79ff1b52b Sep 03 11:18:58 devstack sudo[95175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:59 devstack sudo[95175]: pam_unix(sudo:session): session closed for user root Sep 03 11:18:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d6f73973-1979-413c-a7ac-3a3a5e41283b tempest-VolumesActionsTest-849658457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-628a2fbf-5933-40a1-95dd-f1f79ff1b52b" returned: 0 in 0.416s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:18:59 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d6f73973-1979-413c-a7ac-3a3a5e41283b tempest-VolumesActionsTest-849658457 None] <== create_volume: return (1627ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:18:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d6f73973-1979-413c-a7ac-3a3a5e41283b tempest-VolumesActionsTest-849658457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:18:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.467s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:18:59 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "cinder-quobyte-b1d6d328-8959-42e1-b70a-30315b9ec2aa-aa89f44d-2d66-4b30-8901-68b193d5a495" by "_create_volume_from_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:18:59 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d6f73973-1979-413c-a7ac-3a3a5e41283b tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b23dd0c1-de6f-4136-9158-015dd7362c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-628a2fbf-5933-40a1-95dd-f1f79ff1b52b', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:59 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d6f73973-1979-413c-a7ac-3a3a5e41283b tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66620ec2-0dbe-4110-b8c2-538224e0cc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:18:59 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-quobyte-b1d6d328-8959-42e1-b70a-30315b9ec2aa-aa89f44d-2d66-4b30-8901-68b193d5a495" acquired by "_create_volume_from_snapshot" :: waited 0.080s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:18:59 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Creating volume aa89f44d-2d66-4b30-8901-68b193d5a495 from snapshot b1d6d328-8959-42e1-b70a-30315b9ec2aa {{(pid=87038) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 11:18:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:18:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:18:59 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:18:59 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:18:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:18:59 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:18:59 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "cinder-quobyte-aa89f44d-2d66-4b30-8901-68b193d5a495" by "_copy_volume_from_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:18:59 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-d6f73973-1979-413c-a7ac-3a3a5e41283b tempest-VolumesActionsTest-849658457 None] Volume volume-628a2fbf-5933-40a1-95dd-f1f79ff1b52b (628a2fbf-5933-40a1-95dd-f1f79ff1b52b): created successfully Sep 03 11:18:59 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d6f73973-1979-413c-a7ac-3a3a5e41283b tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66620ec2-0dbe-4110-b8c2-538224e0cc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:18:59 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d6f73973-1979-413c-a7ac-3a3a5e41283b tempest-VolumesActionsTest-849658457 None] Flow 'volume_create_manager' (0f549a08-f8ea-47b5-9d14-2ec384400724) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:18:59 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-quobyte-aa89f44d-2d66-4b30-8901-68b193d5a495" acquired by "_copy_volume_from_snapshot" :: waited 0.056s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:18:59 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] snapshot: b1d6d328-8959-42e1-b70a-30315b9ec2aa, volume: aa89f44d-2d66-4b30-8901-68b193d5a495, {{(pid=87038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 11:18:59 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-d6f73973-1979-413c-a7ac-3a3a5e41283b tempest-VolumesActionsTest-849658457 None] Created volume successfully. Sep 03 11:18:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:18:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:18:59 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:18:59 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:18:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:18:59 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcb25d2-780a-4689-a4c3-2a24432d2d12]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:18:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4.b1d6d328-8959-42e1-b70a-30315b9ec2aa {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:18:59 devstack sudo[95184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4.b1d6d328-8959-42e1-b70a-30315b9ec2aa Sep 03 11:18:59 devstack sudo[95184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:18:59 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4b73fa9e-353b-4d9b-b1f1-2cfe21174b77 tempest-VolumesActionsTest-849658457 None] Acquiring lock "cinder-628a2fbf-5933-40a1-95dd-f1f79ff1b52b" by "attach_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:00 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4b73fa9e-353b-4d9b-b1f1-2cfe21174b77 tempest-VolumesActionsTest-849658457 None] Lock "cinder-628a2fbf-5933-40a1-95dd-f1f79ff1b52b" acquired by "attach_volume" :: waited 0.053s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:00 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-4b73fa9e-353b-4d9b-b1f1-2cfe21174b77 tempest-VolumesActionsTest-849658457 None] Attaching volume 628a2fbf-5933-40a1-95dd-f1f79ff1b52b to instance 891c4121-9f71-4bde-905f-4e4c505f6d94 at mountpoint /dev/vdb on host None. Sep 03 11:19:00 devstack sudo[95184]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:00 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-4b73fa9e-353b-4d9b-b1f1-2cfe21174b77 tempest-VolumesActionsTest-849658457 None] Attach volume completed successfully. Sep 03 11:19:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4.b1d6d328-8959-42e1-b70a-30315b9ec2aa" returned: 0 in 0.721s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:00 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed3a7ccc-f43e-441a-924e-b3db614caae4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:19:00 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4b73fa9e-353b-4d9b-b1f1-2cfe21174b77 tempest-VolumesActionsTest-849658457 None] Lock "cinder-628a2fbf-5933-40a1-95dd-f1f79ff1b52b" released by "attach_volume" :: held 0.245s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:00 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dda6130-ee7e-4dc1-8b37-76c2895169a1]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:19:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:00 devstack sudo[95207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4 Sep 03 11:19:00 devstack sudo[95207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:00 devstack sudo[95207]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4" returned: 0 in 0.467s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:00 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4 {{(pid=87038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 11:19:00 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Creating direct copy from snapshot {{(pid=87038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 11:19:00 devstack cinder-volume[87038]: DEBUG cinder.utils [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Path /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa89f44d-2d66-4b30-8901-68b193d5a495 not found in is_blk_device check {{(pid=87038) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 11:19:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa89f44d-2d66-4b30-8901-68b193d5a495 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:00 devstack sudo[95214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa89f44d-2d66-4b30-8901-68b193d5a495 Sep 03 11:19:00 devstack sudo[95214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:01 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-4347cc02-f673-47c0-b701-08e84148d5d5 tempest-VolumesActionsTest-1050327428 None] Terminate volume connection completed successfully. Sep 03 11:19:01 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4347cc02-f673-47c0-b701-08e84148d5d5 tempest-VolumesActionsTest-1050327428 None] Acquiring lock "cinder-628a2fbf-5933-40a1-95dd-f1f79ff1b52b-detach_volume" by "detach_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:01 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4347cc02-f673-47c0-b701-08e84148d5d5 tempest-VolumesActionsTest-1050327428 None] Lock "cinder-628a2fbf-5933-40a1-95dd-f1f79ff1b52b-detach_volume" acquired by "detach_volume" :: waited 0.024s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:01 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-4347cc02-f673-47c0-b701-08e84148d5d5 tempest-VolumesActionsTest-1050327428 None] Detaching volume 628a2fbf-5933-40a1-95dd-f1f79ff1b52b from instance 891c4121-9f71-4bde-905f-4e4c505f6d94. Sep 03 11:19:01 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-4347cc02-f673-47c0-b701-08e84148d5d5 tempest-VolumesActionsTest-1050327428 None] Detach volume completed successfully. Sep 03 11:19:01 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4347cc02-f673-47c0-b701-08e84148d5d5 tempest-VolumesActionsTest-1050327428 None] Lock "cinder-628a2fbf-5933-40a1-95dd-f1f79ff1b52b-detach_volume" released by "detach_volume" :: held 0.121s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:01 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-70aaf5b1-b6a8-4799-b25c-74347f8fa3bb tempest-VolumesActionsTest-849658457 None] Acquiring lock "cinder-628a2fbf-5933-40a1-95dd-f1f79ff1b52b-detach_volume" by "detach_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:01 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-70aaf5b1-b6a8-4799-b25c-74347f8fa3bb tempest-VolumesActionsTest-849658457 None] Lock "cinder-628a2fbf-5933-40a1-95dd-f1f79ff1b52b-detach_volume" acquired by "detach_volume" :: waited 0.047s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:01 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-70aaf5b1-b6a8-4799-b25c-74347f8fa3bb tempest-VolumesActionsTest-849658457 None] Volume detach called, but volume not attached. Sep 03 11:19:01 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-70aaf5b1-b6a8-4799-b25c-74347f8fa3bb tempest-VolumesActionsTest-849658457 None] Lock "cinder-628a2fbf-5933-40a1-95dd-f1f79ff1b52b-detach_volume" released by "detach_volume" :: held 0.058s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:02 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f2be3fe3-7191-4bee-913e-11a57dbe4a15 tempest-VolumesActionsTest-849658457 None] Acquiring lock "cinder-628a2fbf-5933-40a1-95dd-f1f79ff1b52b-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:02 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f2be3fe3-7191-4bee-913e-11a57dbe4a15 tempest-VolumesActionsTest-849658457 None] Lock "cinder-628a2fbf-5933-40a1-95dd-f1f79ff1b52b-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:02 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f2be3fe3-7191-4bee-913e-11a57dbe4a15 tempest-VolumesActionsTest-849658457 None] Acquiring lock "cinder-quobyte-628a2fbf-5933-40a1-95dd-f1f79ff1b52b" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:02 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f2be3fe3-7191-4bee-913e-11a57dbe4a15 tempest-VolumesActionsTest-849658457 None] Lock "cinder-quobyte-628a2fbf-5933-40a1-95dd-f1f79ff1b52b" acquired by "delete_volume" :: waited 0.047s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:02 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5811b1e-46b2-4af3-a005-09a3b3075d25]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:19:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f2be3fe3-7191-4bee-913e-11a57dbe4a15 tempest-VolumesActionsTest-849658457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-628a2fbf-5933-40a1-95dd-f1f79ff1b52b {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:03 devstack sudo[95227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-628a2fbf-5933-40a1-95dd-f1f79ff1b52b Sep 03 11:19:03 devstack sudo[95227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:03 devstack sudo[95227]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f2be3fe3-7191-4bee-913e-11a57dbe4a15 tempest-VolumesActionsTest-849658457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-628a2fbf-5933-40a1-95dd-f1f79ff1b52b" returned: 0 in 0.922s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f2be3fe3-7191-4bee-913e-11a57dbe4a15 tempest-VolumesActionsTest-849658457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-628a2fbf-5933-40a1-95dd-f1f79ff1b52b {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:03 devstack sudo[95233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-628a2fbf-5933-40a1-95dd-f1f79ff1b52b Sep 03 11:19:03 devstack sudo[95233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:04 devstack sudo[95233]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f2be3fe3-7191-4bee-913e-11a57dbe4a15 tempest-VolumesActionsTest-849658457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-628a2fbf-5933-40a1-95dd-f1f79ff1b52b" returned: 0 in 0.872s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:04 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f2be3fe3-7191-4bee-913e-11a57dbe4a15 tempest-VolumesActionsTest-849658457 None] Lock "cinder-quobyte-628a2fbf-5933-40a1-95dd-f1f79ff1b52b" released by "delete_volume" :: held 1.926s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:04 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-f2be3fe3-7191-4bee-913e-11a57dbe4a15 tempest-VolumesActionsTest-849658457 None] Created reservations ['c1e9d20c-f47a-41c8-af5d-7ba23a98a5ab', 'eca342d7-24a9-4029-abca-20a1ed3cdfe6', 'ebf3e1e8-e494-4a02-b238-70140afb8f2e', '1c430367-2f12-42aa-a2d6-c954d9d7c131'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:19:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f2be3fe3-7191-4bee-913e-11a57dbe4a15 tempest-VolumesActionsTest-849658457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f2be3fe3-7191-4bee-913e-11a57dbe4a15 tempest-VolumesActionsTest-849658457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:05 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f2be3fe3-7191-4bee-913e-11a57dbe4a15 tempest-VolumesActionsTest-849658457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:19:05 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f2be3fe3-7191-4bee-913e-11a57dbe4a15 tempest-VolumesActionsTest-849658457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:19:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f2be3fe3-7191-4bee-913e-11a57dbe4a15 tempest-VolumesActionsTest-849658457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f2be3fe3-7191-4bee-913e-11a57dbe4a15 tempest-VolumesActionsTest-849658457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:05 devstack sudo[95236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:19:05 devstack sudo[95236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:05 devstack sudo[95236]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f2be3fe3-7191-4bee-913e-11a57dbe4a15 tempest-VolumesActionsTest-849658457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.622s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:05 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-f2be3fe3-7191-4bee-913e-11a57dbe4a15 tempest-VolumesActionsTest-849658457 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:19:06 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-f2be3fe3-7191-4bee-913e-11a57dbe4a15 tempest-VolumesActionsTest-849658457 None] Deleted volume successfully. Sep 03 11:19:06 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-80c8879e-b4b6-4466-a441-8db6f931ff1a tempest-AttachVolumeTestJSON-470983266 None] Acquiring lock "cinder-e61d8bb3-a4ed-4f9b-bcb0-2b566a576fee-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:06 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f2be3fe3-7191-4bee-913e-11a57dbe4a15 tempest-VolumesActionsTest-849658457 None] Lock "cinder-628a2fbf-5933-40a1-95dd-f1f79ff1b52b-delete_volume" released by "delete_volume" :: held 3.522s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:06 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-80c8879e-b4b6-4466-a441-8db6f931ff1a tempest-AttachVolumeTestJSON-470983266 None] Lock "cinder-e61d8bb3-a4ed-4f9b-bcb0-2b566a576fee-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:06 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-80c8879e-b4b6-4466-a441-8db6f931ff1a tempest-AttachVolumeTestJSON-470983266 None] Acquiring lock "cinder-quobyte-e61d8bb3-a4ed-4f9b-bcb0-2b566a576fee" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:06 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-80c8879e-b4b6-4466-a441-8db6f931ff1a tempest-AttachVolumeTestJSON-470983266 None] Lock "cinder-quobyte-e61d8bb3-a4ed-4f9b-bcb0-2b566a576fee" acquired by "delete_volume" :: waited 0.053s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:06 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[37eca842-248d-4717-bbe4-56ce9d1fd20d]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:19:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-80c8879e-b4b6-4466-a441-8db6f931ff1a tempest-AttachVolumeTestJSON-470983266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e61d8bb3-a4ed-4f9b-bcb0-2b566a576fee {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:06 devstack sudo[95253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e61d8bb3-a4ed-4f9b-bcb0-2b566a576fee Sep 03 11:19:06 devstack sudo[95253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:07 devstack sudo[95253]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-80c8879e-b4b6-4466-a441-8db6f931ff1a tempest-AttachVolumeTestJSON-470983266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e61d8bb3-a4ed-4f9b-bcb0-2b566a576fee" returned: 0 in 1.107s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-80c8879e-b4b6-4466-a441-8db6f931ff1a tempest-AttachVolumeTestJSON-470983266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e61d8bb3-a4ed-4f9b-bcb0-2b566a576fee {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:07 devstack sudo[95267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e61d8bb3-a4ed-4f9b-bcb0-2b566a576fee Sep 03 11:19:07 devstack sudo[95267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:07 devstack sudo[95214]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa89f44d-2d66-4b30-8901-68b193d5a495" returned: 0 in 7.013s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:07 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Image conversion details: src /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4, size 1024.00 MB, duration 7.02 sec, destination /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa89f44d-2d66-4b30-8901-68b193d5a495 {{(pid=87038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:19:07 devstack cinder-volume[87038]: INFO cinder.image.image_utils [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Converted 1024.00 MB image at 145.96 MB/s Sep 03 11:19:07 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa89f44d-2d66-4b30-8901-68b193d5a495 is being set with open permissions: ugo+rw Sep 03 11:19:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa89f44d-2d66-4b30-8901-68b193d5a495 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:07 devstack sudo[95270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa89f44d-2d66-4b30-8901-68b193d5a495 Sep 03 11:19:07 devstack sudo[95270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:08 devstack sudo[95267]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-80c8879e-b4b6-4466-a441-8db6f931ff1a tempest-AttachVolumeTestJSON-470983266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e61d8bb3-a4ed-4f9b-bcb0-2b566a576fee" returned: 0 in 0.491s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-80c8879e-b4b6-4466-a441-8db6f931ff1a tempest-AttachVolumeTestJSON-470983266 None] Lock "cinder-quobyte-e61d8bb3-a4ed-4f9b-bcb0-2b566a576fee" released by "delete_volume" :: held 1.802s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:08 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-80c8879e-b4b6-4466-a441-8db6f931ff1a tempest-AttachVolumeTestJSON-470983266 None] Created reservations ['389d95f4-545a-4550-8eba-099cd91f943f', 'e52f161f-47e3-4030-a1cd-1e4cdbdded99', '31523d59-8f06-47de-b07e-1709c52547c4', '74b6afc0-69ea-4b32-8ebf-46fdb83d5caa'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:19:08 devstack sudo[95270]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa89f44d-2d66-4b30-8901-68b193d5a495" returned: 0 in 0.421s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-quobyte-aa89f44d-2d66-4b30-8901-68b193d5a495" released by "_copy_volume_from_snapshot" :: held 8.782s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-quobyte-b1d6d328-8959-42e1-b70a-30315b9ec2aa-aa89f44d-2d66-4b30-8901-68b193d5a495" released by "_create_volume_from_snapshot" :: held 8.910s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.992s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-80c8879e-b4b6-4466-a441-8db6f931ff1a tempest-AttachVolumeTestJSON-470983266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-80c8879e-b4b6-4466-a441-8db6f931ff1a tempest-AttachVolumeTestJSON-470983266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-80c8879e-b4b6-4466-a441-8db6f931ff1a tempest-AttachVolumeTestJSON-470983266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:19:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-80c8879e-b4b6-4466-a441-8db6f931ff1a tempest-AttachVolumeTestJSON-470983266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:19:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-80c8879e-b4b6-4466-a441-8db6f931ff1a tempest-AttachVolumeTestJSON-470983266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-80c8879e-b4b6-4466-a441-8db6f931ff1a tempest-AttachVolumeTestJSON-470983266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:08 devstack sudo[95274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:19:08 devstack sudo[95274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd19392f-e6c5-4654-8d18-2b6ab3df9ac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa89f44d-2d66-4b30-8901-68b193d5a495', 'volume_size': 1, 'snapshot_id': 'b1d6d328-8959-42e1-b70a-30315b9ec2aa'}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab5f982e-4b6c-4163-b402-3f4b310e6813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:08 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Volume volume-aa89f44d-2d66-4b30-8901-68b193d5a495 (aa89f44d-2d66-4b30-8901-68b193d5a495): created successfully Sep 03 11:19:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab5f982e-4b6c-4163-b402-3f4b310e6813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Flow 'volume_create_manager' (2193d364-a989-431c-9322-18b00c2a57db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:19:08 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-f2158c43-c9ad-4108-93bd-60b960959e4f tempest-VolumesSnapshotTestJSON-646131283 None] Created volume successfully. Sep 03 11:19:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d8572889-12e6-47c2-8a18-66d224a51684 tempest-AttachVolumeTestJSON-470983266 None] Acquiring lock "cinder-78fabb40-ed3c-4228-b3c0-6076e53a07ca-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d8572889-12e6-47c2-8a18-66d224a51684 tempest-AttachVolumeTestJSON-470983266 None] Lock "cinder-78fabb40-ed3c-4228-b3c0-6076e53a07ca-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d8572889-12e6-47c2-8a18-66d224a51684 tempest-AttachVolumeTestJSON-470983266 None] Acquiring lock "cinder-quobyte-78fabb40-ed3c-4228-b3c0-6076e53a07ca" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d8572889-12e6-47c2-8a18-66d224a51684 tempest-AttachVolumeTestJSON-470983266 None] Lock "cinder-quobyte-78fabb40-ed3c-4228-b3c0-6076e53a07ca" acquired by "delete_volume" :: waited 0.032s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:08 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1aaaf4-ffba-4647-b2f6-71cf43963399]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:19:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d8572889-12e6-47c2-8a18-66d224a51684 tempest-AttachVolumeTestJSON-470983266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-78fabb40-ed3c-4228-b3c0-6076e53a07ca {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:08 devstack sudo[95274]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-80c8879e-b4b6-4466-a441-8db6f931ff1a tempest-AttachVolumeTestJSON-470983266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.479s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:08 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-80c8879e-b4b6-4466-a441-8db6f931ff1a tempest-AttachVolumeTestJSON-470983266 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:19:08 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-80c8879e-b4b6-4466-a441-8db6f931ff1a tempest-AttachVolumeTestJSON-470983266 None] Deleted volume successfully. Sep 03 11:19:08 devstack sudo[95278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-78fabb40-ed3c-4228-b3c0-6076e53a07ca Sep 03 11:19:08 devstack sudo[95278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-80c8879e-b4b6-4466-a441-8db6f931ff1a tempest-AttachVolumeTestJSON-470983266 None] Lock "cinder-e61d8bb3-a4ed-4f9b-bcb0-2b566a576fee-delete_volume" released by "delete_volume" :: held 2.717s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:09 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-90c316fc-2a46-4ebb-b06e-e4108b755ace tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "cinder-aa89f44d-2d66-4b30-8901-68b193d5a495-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:09 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-90c316fc-2a46-4ebb-b06e-e4108b755ace tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-aa89f44d-2d66-4b30-8901-68b193d5a495-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:09 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-90c316fc-2a46-4ebb-b06e-e4108b755ace tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "cinder-quobyte-aa89f44d-2d66-4b30-8901-68b193d5a495" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:09 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-90c316fc-2a46-4ebb-b06e-e4108b755ace tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-quobyte-aa89f44d-2d66-4b30-8901-68b193d5a495" acquired by "delete_volume" :: waited 0.020s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:09 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[0289df53-bd4a-413c-a413-3cf60c46995c]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:19:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90c316fc-2a46-4ebb-b06e-e4108b755ace tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa89f44d-2d66-4b30-8901-68b193d5a495 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:09 devstack sudo[95278]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d8572889-12e6-47c2-8a18-66d224a51684 tempest-AttachVolumeTestJSON-470983266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-78fabb40-ed3c-4228-b3c0-6076e53a07ca" returned: 0 in 0.528s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d8572889-12e6-47c2-8a18-66d224a51684 tempest-AttachVolumeTestJSON-470983266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-78fabb40-ed3c-4228-b3c0-6076e53a07ca {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:09 devstack sudo[95285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-78fabb40-ed3c-4228-b3c0-6076e53a07ca Sep 03 11:19:09 devstack sudo[95285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:09 devstack sudo[95284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa89f44d-2d66-4b30-8901-68b193d5a495 Sep 03 11:19:09 devstack sudo[95284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:09 devstack sudo[95285]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d8572889-12e6-47c2-8a18-66d224a51684 tempest-AttachVolumeTestJSON-470983266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-78fabb40-ed3c-4228-b3c0-6076e53a07ca" returned: 0 in 0.320s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:09 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d8572889-12e6-47c2-8a18-66d224a51684 tempest-AttachVolumeTestJSON-470983266 None] Lock "cinder-quobyte-78fabb40-ed3c-4228-b3c0-6076e53a07ca" released by "delete_volume" :: held 0.906s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:09 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-d8572889-12e6-47c2-8a18-66d224a51684 tempest-AttachVolumeTestJSON-470983266 None] Created reservations ['73cc63d6-ea56-47eb-b7d3-2e8d35c3c19b', '575d3402-a1bd-44e6-b980-e60f2c80bf05', '90bb830e-9913-4725-8236-c0a4489ab8c0', 'c6200f01-d942-4862-b6e8-73e3baa5a14d'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:19:09 devstack sudo[95284]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90c316fc-2a46-4ebb-b06e-e4108b755ace tempest-VolumesSnapshotTestJSON-646131283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa89f44d-2d66-4b30-8901-68b193d5a495" returned: 0 in 0.498s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90c316fc-2a46-4ebb-b06e-e4108b755ace tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa89f44d-2d66-4b30-8901-68b193d5a495 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:09 devstack sudo[95292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa89f44d-2d66-4b30-8901-68b193d5a495 Sep 03 11:19:09 devstack sudo[95292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d8572889-12e6-47c2-8a18-66d224a51684 tempest-AttachVolumeTestJSON-470983266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d8572889-12e6-47c2-8a18-66d224a51684 tempest-AttachVolumeTestJSON-470983266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d8572889-12e6-47c2-8a18-66d224a51684 tempest-AttachVolumeTestJSON-470983266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:19:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d8572889-12e6-47c2-8a18-66d224a51684 tempest-AttachVolumeTestJSON-470983266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:19:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d8572889-12e6-47c2-8a18-66d224a51684 tempest-AttachVolumeTestJSON-470983266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d8572889-12e6-47c2-8a18-66d224a51684 tempest-AttachVolumeTestJSON-470983266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:09 devstack sudo[95296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:19:09 devstack sudo[95296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:09 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3a43c489-ecf8-4266-b792-217cadb38a4f tempest-AttachVolumeTestJSON-470983266 None] Acquiring lock "cinder-7a1fe29f-2bfa-41e0-981b-e2c9f37ce95c-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:09 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3a43c489-ecf8-4266-b792-217cadb38a4f tempest-AttachVolumeTestJSON-470983266 None] Lock "cinder-7a1fe29f-2bfa-41e0-981b-e2c9f37ce95c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:09 devstack sudo[95292]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90c316fc-2a46-4ebb-b06e-e4108b755ace tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa89f44d-2d66-4b30-8901-68b193d5a495" returned: 0 in 0.323s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:09 devstack sudo[95296]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d8572889-12e6-47c2-8a18-66d224a51684 tempest-AttachVolumeTestJSON-470983266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.295s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:10 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-d8572889-12e6-47c2-8a18-66d224a51684 tempest-AttachVolumeTestJSON-470983266 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:19:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-90c316fc-2a46-4ebb-b06e-e4108b755ace tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-quobyte-aa89f44d-2d66-4b30-8901-68b193d5a495" released by "delete_volume" :: held 0.894s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3a43c489-ecf8-4266-b792-217cadb38a4f tempest-AttachVolumeTestJSON-470983266 None] Acquiring lock "cinder-quobyte-7a1fe29f-2bfa-41e0-981b-e2c9f37ce95c" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:10 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-d8572889-12e6-47c2-8a18-66d224a51684 tempest-AttachVolumeTestJSON-470983266 None] Deleted volume successfully. Sep 03 11:19:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3a43c489-ecf8-4266-b792-217cadb38a4f tempest-AttachVolumeTestJSON-470983266 None] Lock "cinder-quobyte-7a1fe29f-2bfa-41e0-981b-e2c9f37ce95c" acquired by "delete_volume" :: waited 0.026s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d8572889-12e6-47c2-8a18-66d224a51684 tempest-AttachVolumeTestJSON-470983266 None] Lock "cinder-78fabb40-ed3c-4228-b3c0-6076e53a07ca-delete_volume" released by "delete_volume" :: held 1.492s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:10 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[018847a2-5437-4415-b5ad-efcc5dd84142]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:19:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3a43c489-ecf8-4266-b792-217cadb38a4f tempest-AttachVolumeTestJSON-470983266 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7a1fe29f-2bfa-41e0-981b-e2c9f37ce95c {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:10 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-90c316fc-2a46-4ebb-b06e-e4108b755ace tempest-VolumesSnapshotTestJSON-646131283 None] Created reservations ['8aa3f295-a079-48dc-8433-fc3493c88a33', 'f8905dc1-e687-46ce-a517-e5989b441967', 'f0d8d256-75d2-49f0-b9a6-919207ea4c8c', 'f5e8a449-4197-4693-af06-9a65a19dca64'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:19:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-90c316fc-2a46-4ebb-b06e-e4108b755ace tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-90c316fc-2a46-4ebb-b06e-e4108b755ace tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:10 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-90c316fc-2a46-4ebb-b06e-e4108b755ace tempest-VolumesSnapshotTestJSON-646131283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:19:10 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-90c316fc-2a46-4ebb-b06e-e4108b755ace tempest-VolumesSnapshotTestJSON-646131283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:19:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-90c316fc-2a46-4ebb-b06e-e4108b755ace tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90c316fc-2a46-4ebb-b06e-e4108b755ace tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:10 devstack sudo[95300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7a1fe29f-2bfa-41e0-981b-e2c9f37ce95c Sep 03 11:19:10 devstack sudo[95300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:10 devstack sudo[95302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:19:10 devstack sudo[95302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:10 devstack sudo[95300]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3a43c489-ecf8-4266-b792-217cadb38a4f tempest-AttachVolumeTestJSON-470983266 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7a1fe29f-2bfa-41e0-981b-e2c9f37ce95c" returned: 0 in 0.438s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3a43c489-ecf8-4266-b792-217cadb38a4f tempest-AttachVolumeTestJSON-470983266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7a1fe29f-2bfa-41e0-981b-e2c9f37ce95c {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:10 devstack sudo[95302]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90c316fc-2a46-4ebb-b06e-e4108b755ace tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.313s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:10 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-90c316fc-2a46-4ebb-b06e-e4108b755ace tempest-VolumesSnapshotTestJSON-646131283 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:19:10 devstack sudo[95310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7a1fe29f-2bfa-41e0-981b-e2c9f37ce95c Sep 03 11:19:10 devstack sudo[95310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:10 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-90c316fc-2a46-4ebb-b06e-e4108b755ace tempest-VolumesSnapshotTestJSON-646131283 None] Deleted volume successfully. Sep 03 11:19:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-90c316fc-2a46-4ebb-b06e-e4108b755ace tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-aa89f44d-2d66-4b30-8901-68b193d5a495-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:10 devstack sudo[95310]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3a43c489-ecf8-4266-b792-217cadb38a4f tempest-AttachVolumeTestJSON-470983266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7a1fe29f-2bfa-41e0-981b-e2c9f37ce95c" returned: 0 in 0.417s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3a43c489-ecf8-4266-b792-217cadb38a4f tempest-AttachVolumeTestJSON-470983266 None] Lock "cinder-quobyte-7a1fe29f-2bfa-41e0-981b-e2c9f37ce95c" released by "delete_volume" :: held 0.913s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-3a43c489-ecf8-4266-b792-217cadb38a4f tempest-AttachVolumeTestJSON-470983266 None] Created reservations ['6b37f6e3-f6ed-40d2-8179-21709329bdf8', '81cff791-3789-4b97-9c77-2796108fda63', '1fdb77e0-bf23-4830-907f-ba3ac770d183', '880f47e2-a1bb-48a0-ae27-e276dc6a103f'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3a43c489-ecf8-4266-b792-217cadb38a4f tempest-AttachVolumeTestJSON-470983266 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3a43c489-ecf8-4266-b792-217cadb38a4f tempest-AttachVolumeTestJSON-470983266 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-3a43c489-ecf8-4266-b792-217cadb38a4f tempest-AttachVolumeTestJSON-470983266 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-3a43c489-ecf8-4266-b792-217cadb38a4f tempest-AttachVolumeTestJSON-470983266 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3a43c489-ecf8-4266-b792-217cadb38a4f tempest-AttachVolumeTestJSON-470983266 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3a43c489-ecf8-4266-b792-217cadb38a4f tempest-AttachVolumeTestJSON-470983266 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:11 devstack sudo[95335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:19:11 devstack sudo[95335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-5491df93-1b4d-4c39-8dc9-7dcf7d6c36f0 tempest-VolumesActionsTest-849658457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5491df93-1b4d-4c39-8dc9-7dcf7d6c36f0 tempest-VolumesActionsTest-849658457 None] Flow 'volume_create_manager' (f640a74a-618c-42b7-9373-3c128250cb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5491df93-1b4d-4c39-8dc9-7dcf7d6c36f0 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae52ab99-d6fa-4520-909a-8811c50bdd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5491df93-1b4d-4c39-8dc9-7dcf7d6c36f0 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae52ab99-d6fa-4520-909a-8811c50bdd06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-985103040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b3093c9-bd11-48f9-87f1-bfbb3afb4627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68554cd8f42e427692f2042c9e6db115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:19:11Z,use_quota=True,user_id='9fdff0e3f9c54adb90c508fb6ea826d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5491df93-1b4d-4c39-8dc9-7dcf7d6c36f0 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c25a4b54-aa07-4c2a-9faf-bb17cedbcd48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5491df93-1b4d-4c39-8dc9-7dcf7d6c36f0 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c25a4b54-aa07-4c2a-9faf-bb17cedbcd48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5491df93-1b4d-4c39-8dc9-7dcf7d6c36f0 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f591ce5-d569-4eec-9bbe-b7569605ffda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5491df93-1b4d-4c39-8dc9-7dcf7d6c36f0 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f591ce5-d569-4eec-9bbe-b7569605ffda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b3093c9-bd11-48f9-87f1-bfbb3afb4627', 'volume_name': 'volume-8b3093c9-bd11-48f9-87f1-bfbb3afb4627', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5491df93-1b4d-4c39-8dc9-7dcf7d6c36f0 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68920d1a-b6d6-4fa9-a40a-47ce2179bd85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5491df93-1b4d-4c39-8dc9-7dcf7d6c36f0 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68920d1a-b6d6-4fa9-a40a-47ce2179bd85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5491df93-1b4d-4c39-8dc9-7dcf7d6c36f0 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59a4097e-4041-46f7-bde3-bce7d076f7f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:11 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-5491df93-1b4d-4c39-8dc9-7dcf7d6c36f0 tempest-VolumesActionsTest-849658457 None] Volume 8b3093c9-bd11-48f9-87f1-bfbb3afb4627: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b3093c9-bd11-48f9-87f1-bfbb3afb4627', 'volume_size': 1} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5491df93-1b4d-4c39-8dc9-7dcf7d6c36f0 tempest-VolumesActionsTest-849658457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5491df93-1b4d-4c39-8dc9-7dcf7d6c36f0 tempest-VolumesActionsTest-849658457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5491df93-1b4d-4c39-8dc9-7dcf7d6c36f0 tempest-VolumesActionsTest-849658457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:19:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-985103040',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b3093c9-bd11-48f9-87f1-bfbb3afb4627,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68554cd8f42e427692f2042c9e6db115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:19:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:19:11Z,use_quota=True,user_id='9fdff0e3f9c54adb90c508fb6ea826d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-5491df93-1b4d-4c39-8dc9-7dcf7d6c36f0 tempest-VolumesActionsTest-849658457 None] Creating volume 8b3093c9-bd11-48f9-87f1-bfbb3afb4627 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5491df93-1b4d-4c39-8dc9-7dcf7d6c36f0 tempest-VolumesActionsTest-849658457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5491df93-1b4d-4c39-8dc9-7dcf7d6c36f0 tempest-VolumesActionsTest-849658457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5491df93-1b4d-4c39-8dc9-7dcf7d6c36f0 tempest-VolumesActionsTest-849658457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5491df93-1b4d-4c39-8dc9-7dcf7d6c36f0 tempest-VolumesActionsTest-849658457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5491df93-1b4d-4c39-8dc9-7dcf7d6c36f0 tempest-VolumesActionsTest-849658457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5491df93-1b4d-4c39-8dc9-7dcf7d6c36f0 tempest-VolumesActionsTest-849658457 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:19:11 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-5491df93-1b4d-4c39-8dc9-7dcf7d6c36f0 tempest-VolumesActionsTest-849658457 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5491df93-1b4d-4c39-8dc9-7dcf7d6c36f0 tempest-VolumesActionsTest-849658457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8b3093c9-bd11-48f9-87f1-bfbb3afb4627 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b0343d76-c01a-4708-bc83-e873079573d1 tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "cinder-b1d6d328-8959-42e1-b70a-30315b9ec2aa-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:11 devstack sudo[95337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8b3093c9-bd11-48f9-87f1-bfbb3afb4627 1073741824 Sep 03 11:19:11 devstack sudo[95337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b0343d76-c01a-4708-bc83-e873079573d1 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-b1d6d328-8959-42e1-b70a-30315b9ec2aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b0343d76-c01a-4708-bc83-e873079573d1 tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "cinder-quobyte-ed3a7ccc-f43e-441a-924e-b3db614caae4" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b0343d76-c01a-4708-bc83-e873079573d1 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-quobyte-ed3a7ccc-f43e-441a-924e-b3db614caae4" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b0343d76-c01a-4708-bc83-e873079573d1 tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "cinder-quobyte-b1d6d328-8959-42e1-b70a-30315b9ec2aa" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b0343d76-c01a-4708-bc83-e873079573d1 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-quobyte-b1d6d328-8959-42e1-b70a-30315b9ec2aa" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-b0343d76-c01a-4708-bc83-e873079573d1 tempest-VolumesSnapshotTestJSON-646131283 None] Deleting offline snapshot b1d6d328-8959-42e1-b70a-30315b9ec2aa of volume ed3a7ccc-f43e-441a-924e-b3db614caae4 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-b0343d76-c01a-4708-bc83-e873079573d1 tempest-VolumesSnapshotTestJSON-646131283 None] snapshot_file for this snap is: volume-ed3a7ccc-f43e-441a-924e-b3db614caae4.b1d6d328-8959-42e1-b70a-30315b9ec2aa {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a709f6-be55-465b-8f54-ad3ed8f036cb]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b0343d76-c01a-4708-bc83-e873079573d1 tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4.b1d6d328-8959-42e1-b70a-30315b9ec2aa {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:11 devstack sudo[95335]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3a43c489-ecf8-4266-b792-217cadb38a4f tempest-AttachVolumeTestJSON-470983266 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.449s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-3a43c489-ecf8-4266-b792-217cadb38a4f tempest-AttachVolumeTestJSON-470983266 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:19:11 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-3a43c489-ecf8-4266-b792-217cadb38a4f tempest-AttachVolumeTestJSON-470983266 None] Deleted volume successfully. Sep 03 11:19:11 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3a43c489-ecf8-4266-b792-217cadb38a4f tempest-AttachVolumeTestJSON-470983266 None] Lock "cinder-7a1fe29f-2bfa-41e0-981b-e2c9f37ce95c-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:11 devstack sudo[95340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4.b1d6d328-8959-42e1-b70a-30315b9ec2aa Sep 03 11:19:11 devstack sudo[95340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:12 devstack sudo[95337]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5491df93-1b4d-4c39-8dc9-7dcf7d6c36f0 tempest-VolumesActionsTest-849658457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8b3093c9-bd11-48f9-87f1-bfbb3afb4627 1073741824" returned: 0 in 0.725s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:12 devstack sudo[95340]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b0343d76-c01a-4708-bc83-e873079573d1 tempest-VolumesSnapshotTestJSON-646131283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4.b1d6d328-8959-42e1-b70a-30315b9ec2aa" returned: 0 in 0.581s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-b0343d76-c01a-4708-bc83-e873079573d1 tempest-VolumesSnapshotTestJSON-646131283 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed3a7ccc-f43e-441a-924e-b3db614caae4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:19:12 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[8edf5d3c-ee0a-4c91-a6fb-3d7cfbdde4db]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:19:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b0343d76-c01a-4708-bc83-e873079573d1 tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5491df93-1b4d-4c39-8dc9-7dcf7d6c36f0 tempest-VolumesActionsTest-849658457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8b3093c9-bd11-48f9-87f1-bfbb3afb4627 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:12 devstack sudo[95351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8b3093c9-bd11-48f9-87f1-bfbb3afb4627 Sep 03 11:19:12 devstack sudo[95351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:12 devstack sudo[95350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4 Sep 03 11:19:12 devstack sudo[95350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:12 devstack sudo[95351]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5491df93-1b4d-4c39-8dc9-7dcf7d6c36f0 tempest-VolumesActionsTest-849658457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8b3093c9-bd11-48f9-87f1-bfbb3afb4627" returned: 0 in 0.326s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5491df93-1b4d-4c39-8dc9-7dcf7d6c36f0 tempest-VolumesActionsTest-849658457 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:19:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5491df93-1b4d-4c39-8dc9-7dcf7d6c36f0 tempest-VolumesActionsTest-849658457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5491df93-1b4d-4c39-8dc9-7dcf7d6c36f0 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59a4097e-4041-46f7-bde3-bce7d076f7f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b3093c9-bd11-48f9-87f1-bfbb3afb4627', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5491df93-1b4d-4c39-8dc9-7dcf7d6c36f0 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f51d2363-f1b5-4517-8baf-dc103711325b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:12 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-5491df93-1b4d-4c39-8dc9-7dcf7d6c36f0 tempest-VolumesActionsTest-849658457 None] Volume volume-8b3093c9-bd11-48f9-87f1-bfbb3afb4627 (8b3093c9-bd11-48f9-87f1-bfbb3afb4627): created successfully Sep 03 11:19:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5491df93-1b4d-4c39-8dc9-7dcf7d6c36f0 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f51d2363-f1b5-4517-8baf-dc103711325b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5491df93-1b4d-4c39-8dc9-7dcf7d6c36f0 tempest-VolumesActionsTest-849658457 None] Flow 'volume_create_manager' (f640a74a-618c-42b7-9373-3c128250cb42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:19:12 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-5491df93-1b4d-4c39-8dc9-7dcf7d6c36f0 tempest-VolumesActionsTest-849658457 None] Created volume successfully. Sep 03 11:19:13 devstack sudo[95350]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b0343d76-c01a-4708-bc83-e873079573d1 tempest-VolumesSnapshotTestJSON-646131283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4" returned: 0 in 0.807s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b0343d76-c01a-4708-bc83-e873079573d1 tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4.b1d6d328-8959-42e1-b70a-30315b9ec2aa {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:13 devstack sudo[95397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4.b1d6d328-8959-42e1-b70a-30315b9ec2aa Sep 03 11:19:13 devstack sudo[95397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:13 devstack sudo[95397]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b0343d76-c01a-4708-bc83-e873079573d1 tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4.b1d6d328-8959-42e1-b70a-30315b9ec2aa" returned: 0 in 0.473s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b0343d76-c01a-4708-bc83-e873079573d1 tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4.b1d6d328-8959-42e1-b70a-30315b9ec2aa {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:13 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-94536500-8a16-4358-b1bf-aaee8792a2da tempest-VolumesActionsTest-1050327428 None] Acquiring lock "cinder-8b3093c9-bd11-48f9-87f1-bfbb3afb4627-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:13 devstack sudo[95403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4.b1d6d328-8959-42e1-b70a-30315b9ec2aa Sep 03 11:19:13 devstack sudo[95403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:13 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-94536500-8a16-4358-b1bf-aaee8792a2da tempest-VolumesActionsTest-1050327428 None] Lock "cinder-8b3093c9-bd11-48f9-87f1-bfbb3afb4627-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:13 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=118,cinder:UPDATE=102,cinder:DELETE=11,cinder:INSERT=23 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:19:13 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=112,cinder:UPDATE=119,cinder:INSERT=28,cinder:DELETE=9 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:19:13 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-94536500-8a16-4358-b1bf-aaee8792a2da tempest-VolumesActionsTest-1050327428 None] Acquiring lock "cinder-quobyte-8b3093c9-bd11-48f9-87f1-bfbb3afb4627" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:13 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-94536500-8a16-4358-b1bf-aaee8792a2da tempest-VolumesActionsTest-1050327428 None] Lock "cinder-quobyte-8b3093c9-bd11-48f9-87f1-bfbb3afb4627" acquired by "delete_volume" :: waited 0.020s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:13 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[b817adef-1c52-439c-bdb7-39bb323c9c13]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:19:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-94536500-8a16-4358-b1bf-aaee8792a2da tempest-VolumesActionsTest-1050327428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8b3093c9-bd11-48f9-87f1-bfbb3afb4627 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:13 devstack sudo[95405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8b3093c9-bd11-48f9-87f1-bfbb3afb4627 Sep 03 11:19:13 devstack sudo[95405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:13 devstack sudo[95403]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b0343d76-c01a-4708-bc83-e873079573d1 tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4.b1d6d328-8959-42e1-b70a-30315b9ec2aa" returned: 0 in 0.292s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:13 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b0343d76-c01a-4708-bc83-e873079573d1 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-quobyte-b1d6d328-8959-42e1-b70a-30315b9ec2aa" released by "_delete_snapshot" :: held 2.289s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:13 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b0343d76-c01a-4708-bc83-e873079573d1 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-quobyte-ed3a7ccc-f43e-441a-924e-b3db614caae4" released by "delete_snapshot" :: held 2.330s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:13 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-b0343d76-c01a-4708-bc83-e873079573d1 tempest-VolumesSnapshotTestJSON-646131283 None] Created reservations ['60edeb58-3688-4174-8b70-5946e7957736', 'b5c823ea-0522-4da6-891b-c91139bb44a8', 'a6fedf92-0a95-4a64-a8bf-ae6b95c25d43', 'ced53b0f-40a5-4880-a037-64214b8c9546'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:19:14 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-b0343d76-c01a-4708-bc83-e873079573d1 tempest-VolumesSnapshotTestJSON-646131283 None] Delete snapshot completed successfully. Sep 03 11:19:14 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b0343d76-c01a-4708-bc83-e873079573d1 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-b1d6d328-8959-42e1-b70a-30315b9ec2aa-delete_snapshot" released by "delete_snapshot" :: held 2.496s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:14 devstack sudo[95405]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-94536500-8a16-4358-b1bf-aaee8792a2da tempest-VolumesActionsTest-1050327428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8b3093c9-bd11-48f9-87f1-bfbb3afb4627" returned: 0 in 0.380s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-94536500-8a16-4358-b1bf-aaee8792a2da tempest-VolumesActionsTest-1050327428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8b3093c9-bd11-48f9-87f1-bfbb3afb4627 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:14 devstack sudo[95412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8b3093c9-bd11-48f9-87f1-bfbb3afb4627 Sep 03 11:19:14 devstack sudo[95412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:14 devstack sudo[95412]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-94536500-8a16-4358-b1bf-aaee8792a2da tempest-VolumesActionsTest-1050327428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8b3093c9-bd11-48f9-87f1-bfbb3afb4627" returned: 0 in 0.290s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:14 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-94536500-8a16-4358-b1bf-aaee8792a2da tempest-VolumesActionsTest-1050327428 None] Lock "cinder-quobyte-8b3093c9-bd11-48f9-87f1-bfbb3afb4627" released by "delete_volume" :: held 0.719s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:14 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-94536500-8a16-4358-b1bf-aaee8792a2da tempest-VolumesActionsTest-1050327428 None] Created reservations ['1330dc38-de9b-4878-a224-64e51a7d5420', '36a0304b-11c8-41cf-a29a-8e2a557a3370', '828f9c0f-3c69-40f9-bd97-ce189a130265', '72196f34-303d-416e-aab3-e34163e84650'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:19:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-94536500-8a16-4358-b1bf-aaee8792a2da tempest-VolumesActionsTest-1050327428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-94536500-8a16-4358-b1bf-aaee8792a2da tempest-VolumesActionsTest-1050327428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:14 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-94536500-8a16-4358-b1bf-aaee8792a2da tempest-VolumesActionsTest-1050327428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:19:14 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-94536500-8a16-4358-b1bf-aaee8792a2da tempest-VolumesActionsTest-1050327428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:19:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-94536500-8a16-4358-b1bf-aaee8792a2da tempest-VolumesActionsTest-1050327428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-94536500-8a16-4358-b1bf-aaee8792a2da tempest-VolumesActionsTest-1050327428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:14 devstack sudo[95415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:19:14 devstack sudo[95415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:14 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4d62d899-6726-4d2c-9d55-52db2b2a3347 tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "cinder-ed3a7ccc-f43e-441a-924e-b3db614caae4-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:14 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4d62d899-6726-4d2c-9d55-52db2b2a3347 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-ed3a7ccc-f43e-441a-924e-b3db614caae4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:14 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4d62d899-6726-4d2c-9d55-52db2b2a3347 tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "cinder-quobyte-ed3a7ccc-f43e-441a-924e-b3db614caae4" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:14 devstack sudo[95415]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-94536500-8a16-4358-b1bf-aaee8792a2da tempest-VolumesActionsTest-1050327428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.416s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:14 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-94536500-8a16-4358-b1bf-aaee8792a2da tempest-VolumesActionsTest-1050327428 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:19:14 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-94536500-8a16-4358-b1bf-aaee8792a2da tempest-VolumesActionsTest-1050327428 None] Deleted volume successfully. Sep 03 11:19:14 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4d62d899-6726-4d2c-9d55-52db2b2a3347 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-quobyte-ed3a7ccc-f43e-441a-924e-b3db614caae4" acquired by "delete_volume" :: waited 0.036s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:15 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e1e0f3-0cf3-49f7-9377-ddcb6db166f4]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:19:15 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-94536500-8a16-4358-b1bf-aaee8792a2da tempest-VolumesActionsTest-1050327428 None] Lock "cinder-8b3093c9-bd11-48f9-87f1-bfbb3afb4627-delete_volume" released by "delete_volume" :: held 1.428s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4d62d899-6726-4d2c-9d55-52db2b2a3347 tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:15 devstack sudo[95418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4 Sep 03 11:19:15 devstack sudo[95418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:15 devstack sudo[95418]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4d62d899-6726-4d2c-9d55-52db2b2a3347 tempest-VolumesSnapshotTestJSON-646131283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4" returned: 0 in 0.515s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4d62d899-6726-4d2c-9d55-52db2b2a3347 tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:15 devstack sudo[95423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4 Sep 03 11:19:15 devstack sudo[95423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:15 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-38d8993e-14a0-4101-941c-86264f57c9f3 tempest-VolumesActionsTest-849658457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:19:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-38d8993e-14a0-4101-941c-86264f57c9f3 tempest-VolumesActionsTest-849658457 None] Flow 'volume_create_manager' (cf0341aa-09fe-474e-8ca5-6885ee6c54c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:19:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-38d8993e-14a0-4101-941c-86264f57c9f3 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13483375-8326-4cfa-9d5d-d4b757cb20b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-38d8993e-14a0-4101-941c-86264f57c9f3 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13483375-8326-4cfa-9d5d-d4b757cb20b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-378369220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d87b9b-d598-4437-b5d8-0b0a1084ce69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68554cd8f42e427692f2042c9e6db115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:19:15Z,use_quota=True,user_id='9fdff0e3f9c54adb90c508fb6ea826d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-38d8993e-14a0-4101-941c-86264f57c9f3 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (864edb6b-68ad-46f6-962d-5ced3ab7db9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-38d8993e-14a0-4101-941c-86264f57c9f3 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (864edb6b-68ad-46f6-962d-5ced3ab7db9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-38d8993e-14a0-4101-941c-86264f57c9f3 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a840a5b8-26cf-4067-b7e1-0bb3f49875df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-38d8993e-14a0-4101-941c-86264f57c9f3 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a840a5b8-26cf-4067-b7e1-0bb3f49875df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04d87b9b-d598-4437-b5d8-0b0a1084ce69', 'volume_name': 'volume-04d87b9b-d598-4437-b5d8-0b0a1084ce69', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-38d8993e-14a0-4101-941c-86264f57c9f3 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5af04a5-1dc9-4cd7-89f6-4de6cd8d7c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-38d8993e-14a0-4101-941c-86264f57c9f3 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5af04a5-1dc9-4cd7-89f6-4de6cd8d7c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-38d8993e-14a0-4101-941c-86264f57c9f3 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9358be15-f4ec-4b21-83f7-4fc4bcd33d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:15 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-38d8993e-14a0-4101-941c-86264f57c9f3 tempest-VolumesActionsTest-849658457 None] Volume 04d87b9b-d598-4437-b5d8-0b0a1084ce69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04d87b9b-d598-4437-b5d8-0b0a1084ce69', 'volume_size': 1} Sep 03 11:19:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-38d8993e-14a0-4101-941c-86264f57c9f3 tempest-VolumesActionsTest-849658457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-38d8993e-14a0-4101-941c-86264f57c9f3 tempest-VolumesActionsTest-849658457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:15 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-38d8993e-14a0-4101-941c-86264f57c9f3 tempest-VolumesActionsTest-849658457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:19:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-378369220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d87b9b-d598-4437-b5d8-0b0a1084ce69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68554cd8f42e427692f2042c9e6db115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:19:15Z,use_quota=True,user_id='9fdff0e3f9c54adb90c508fb6ea826d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:19:15 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-38d8993e-14a0-4101-941c-86264f57c9f3 tempest-VolumesActionsTest-849658457 None] Creating volume 04d87b9b-d598-4437-b5d8-0b0a1084ce69 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:19:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-38d8993e-14a0-4101-941c-86264f57c9f3 tempest-VolumesActionsTest-849658457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-38d8993e-14a0-4101-941c-86264f57c9f3 tempest-VolumesActionsTest-849658457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:15 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-38d8993e-14a0-4101-941c-86264f57c9f3 tempest-VolumesActionsTest-849658457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:19:15 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-38d8993e-14a0-4101-941c-86264f57c9f3 tempest-VolumesActionsTest-849658457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:19:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-38d8993e-14a0-4101-941c-86264f57c9f3 tempest-VolumesActionsTest-849658457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:15 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-38d8993e-14a0-4101-941c-86264f57c9f3 tempest-VolumesActionsTest-849658457 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:19:15 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-38d8993e-14a0-4101-941c-86264f57c9f3 tempest-VolumesActionsTest-849658457 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:19:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-38d8993e-14a0-4101-941c-86264f57c9f3 tempest-VolumesActionsTest-849658457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-04d87b9b-d598-4437-b5d8-0b0a1084ce69 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:15 devstack sudo[95425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-04d87b9b-d598-4437-b5d8-0b0a1084ce69 1073741824 Sep 03 11:19:15 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:15 devstack sudo[95423]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4d62d899-6726-4d2c-9d55-52db2b2a3347 tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ed3a7ccc-f43e-441a-924e-b3db614caae4" returned: 0 in 0.287s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:15 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4d62d899-6726-4d2c-9d55-52db2b2a3347 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-quobyte-ed3a7ccc-f43e-441a-924e-b3db614caae4" released by "delete_volume" :: held 0.897s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:15 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-4d62d899-6726-4d2c-9d55-52db2b2a3347 tempest-VolumesSnapshotTestJSON-646131283 None] Created reservations ['e43a20e2-af88-4ed8-80bd-89034c9f8375', '7aa8be3b-c19e-4b7c-a5b8-edfbd011d91d', '2ea7e901-00bf-49e1-82fb-02ee12cd5fe5', '18c45131-c1e9-4567-a615-ca6b63e34b3a'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:19:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4d62d899-6726-4d2c-9d55-52db2b2a3347 tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4d62d899-6726-4d2c-9d55-52db2b2a3347 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:16 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4d62d899-6726-4d2c-9d55-52db2b2a3347 tempest-VolumesSnapshotTestJSON-646131283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:19:16 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4d62d899-6726-4d2c-9d55-52db2b2a3347 tempest-VolumesSnapshotTestJSON-646131283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:19:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4d62d899-6726-4d2c-9d55-52db2b2a3347 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4d62d899-6726-4d2c-9d55-52db2b2a3347 tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:16 devstack sudo[95431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:19:16 devstack sudo[95431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:16 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1d56064a-2707-4a31-9ebd-ced33d115929 tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "cinder-9815f917-95d5-428c-ba9a-88553f8fe4a5-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:16 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1d56064a-2707-4a31-9ebd-ced33d115929 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-9815f917-95d5-428c-ba9a-88553f8fe4a5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:16 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1d56064a-2707-4a31-9ebd-ced33d115929 tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "cinder-quobyte-9815f917-95d5-428c-ba9a-88553f8fe4a5" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:16 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-38d8993e-14a0-4101-941c-86264f57c9f3 tempest-VolumesActionsTest-849658457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-04d87b9b-d598-4437-b5d8-0b0a1084ce69 1073741824" returned: 0 in 0.677s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:16 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1d56064a-2707-4a31-9ebd-ced33d115929 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-quobyte-9815f917-95d5-428c-ba9a-88553f8fe4a5" acquired by "delete_volume" :: waited 0.066s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:16 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-4c858a23-2bb3-4eab-88d8-4121c0b0330d req-98d8a3c7-9f10-45a5-99c8-8a5ccb22c448 tempest-AttachVolumeNegativeTest-1135519864 None] Terminate volume connection completed successfully. Sep 03 11:19:16 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-4c858a23-2bb3-4eab-88d8-4121c0b0330d req-98d8a3c7-9f10-45a5-99c8-8a5ccb22c448 tempest-AttachVolumeNegativeTest-1135519864 None] Deleting attachment 74a0b20f-84c2-4156-a2bd-d0756890d5cb. {{(pid=87038) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:19:16 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[df517084-5695-4a6f-a12e-409baad979c0]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:19:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1d56064a-2707-4a31-9ebd-ced33d115929 tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:16 devstack sudo[95431]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4d62d899-6726-4d2c-9d55-52db2b2a3347 tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.413s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:16 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-4d62d899-6726-4d2c-9d55-52db2b2a3347 tempest-VolumesSnapshotTestJSON-646131283 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:19:16 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-4d62d899-6726-4d2c-9d55-52db2b2a3347 tempest-VolumesSnapshotTestJSON-646131283 None] Deleted volume successfully. Sep 03 11:19:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-38d8993e-14a0-4101-941c-86264f57c9f3 tempest-VolumesActionsTest-849658457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-04d87b9b-d598-4437-b5d8-0b0a1084ce69 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:16 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4d62d899-6726-4d2c-9d55-52db2b2a3347 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-ed3a7ccc-f43e-441a-924e-b3db614caae4-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:16 devstack sudo[95441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-04d87b9b-d598-4437-b5d8-0b0a1084ce69 Sep 03 11:19:16 devstack sudo[95441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:16 devstack sudo[95440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5 Sep 03 11:19:16 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:16 devstack sudo[95441]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-38d8993e-14a0-4101-941c-86264f57c9f3 tempest-VolumesActionsTest-849658457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-04d87b9b-d598-4437-b5d8-0b0a1084ce69" returned: 0 in 0.355s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:16 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-38d8993e-14a0-4101-941c-86264f57c9f3 tempest-VolumesActionsTest-849658457 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:19:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-38d8993e-14a0-4101-941c-86264f57c9f3 tempest-VolumesActionsTest-849658457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:16 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-38d8993e-14a0-4101-941c-86264f57c9f3 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9358be15-f4ec-4b21-83f7-4fc4bcd33d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04d87b9b-d598-4437-b5d8-0b0a1084ce69', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:16 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-38d8993e-14a0-4101-941c-86264f57c9f3 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b590eec8-a732-4e04-8396-70ad2349b6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:16 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-38d8993e-14a0-4101-941c-86264f57c9f3 tempest-VolumesActionsTest-849658457 None] Volume volume-04d87b9b-d598-4437-b5d8-0b0a1084ce69 (04d87b9b-d598-4437-b5d8-0b0a1084ce69): created successfully Sep 03 11:19:16 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-38d8993e-14a0-4101-941c-86264f57c9f3 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b590eec8-a732-4e04-8396-70ad2349b6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:16 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-38d8993e-14a0-4101-941c-86264f57c9f3 tempest-VolumesActionsTest-849658457 None] Flow 'volume_create_manager' (cf0341aa-09fe-474e-8ca5-6885ee6c54c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:19:16 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-38d8993e-14a0-4101-941c-86264f57c9f3 tempest-VolumesActionsTest-849658457 None] Created volume successfully. Sep 03 11:19:16 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1d56064a-2707-4a31-9ebd-ced33d115929 tempest-VolumesSnapshotTestJSON-646131283 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5" returned: 0 in 0.555s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1d56064a-2707-4a31-9ebd-ced33d115929 tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:17 devstack sudo[95448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5 Sep 03 11:19:17 devstack sudo[95448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:17 devstack sudo[95448]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1d56064a-2707-4a31-9ebd-ced33d115929 tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9815f917-95d5-428c-ba9a-88553f8fe4a5" returned: 0 in 0.310s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:17 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1d56064a-2707-4a31-9ebd-ced33d115929 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-quobyte-9815f917-95d5-428c-ba9a-88553f8fe4a5" released by "delete_volume" :: held 0.949s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:17 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-1d56064a-2707-4a31-9ebd-ced33d115929 tempest-VolumesSnapshotTestJSON-646131283 None] Created reservations ['474fc846-6713-41b4-bd09-6ecc8ab4d314', '4e335a24-d2fa-47c7-a9cf-997b84c3ab69', '28d77f7c-4691-4f41-8d43-6d318b7b223d', 'a4423ecb-4294-4dae-8a6e-0193f1dec364'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:19:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1d56064a-2707-4a31-9ebd-ced33d115929 tempest-VolumesSnapshotTestJSON-646131283 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1d56064a-2707-4a31-9ebd-ced33d115929 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1d56064a-2707-4a31-9ebd-ced33d115929 tempest-VolumesSnapshotTestJSON-646131283 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:19:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1d56064a-2707-4a31-9ebd-ced33d115929 tempest-VolumesSnapshotTestJSON-646131283 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:19:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1d56064a-2707-4a31-9ebd-ced33d115929 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1d56064a-2707-4a31-9ebd-ced33d115929 tempest-VolumesSnapshotTestJSON-646131283 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:17 devstack sudo[95451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:19:17 devstack sudo[95451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:17 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:19:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:19:17 devstack sudo[95451]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:19:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1d56064a-2707-4a31-9ebd-ced33d115929 tempest-VolumesSnapshotTestJSON-646131283 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.411s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:17 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-1d56064a-2707-4a31-9ebd-ced33d115929 tempest-VolumesSnapshotTestJSON-646131283 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:19:17 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-1d56064a-2707-4a31-9ebd-ced33d115929 tempest-VolumesSnapshotTestJSON-646131283 None] Deleted volume successfully. Sep 03 11:19:18 devstack sudo[95470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:19:18 devstack sudo[95470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:18 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1d56064a-2707-4a31-9ebd-ced33d115929 tempest-VolumesSnapshotTestJSON-646131283 None] Lock "cinder-9815f917-95d5-428c-ba9a-88553f8fe4a5-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:18 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d2a93451-dd44-4872-83f6-17b851cadb3e tempest-VolumesActionsTest-1050327428 None] Acquiring lock "cinder-04d87b9b-d598-4437-b5d8-0b0a1084ce69-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:18 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d2a93451-dd44-4872-83f6-17b851cadb3e tempest-VolumesActionsTest-1050327428 None] Lock "cinder-04d87b9b-d598-4437-b5d8-0b0a1084ce69-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:18 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d2a93451-dd44-4872-83f6-17b851cadb3e tempest-VolumesActionsTest-1050327428 None] Acquiring lock "cinder-quobyte-04d87b9b-d598-4437-b5d8-0b0a1084ce69" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:18 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d2a93451-dd44-4872-83f6-17b851cadb3e tempest-VolumesActionsTest-1050327428 None] Lock "cinder-quobyte-04d87b9b-d598-4437-b5d8-0b0a1084ce69" acquired by "delete_volume" :: waited 0.017s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:18 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb50a49-ed23-4271-8557-f020fe5e083e]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:19:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d2a93451-dd44-4872-83f6-17b851cadb3e tempest-VolumesActionsTest-1050327428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-04d87b9b-d598-4437-b5d8-0b0a1084ce69 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:18 devstack sudo[95477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-04d87b9b-d598-4437-b5d8-0b0a1084ce69 Sep 03 11:19:18 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:18 devstack sudo[95470]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.568s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:18 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:19:18 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:19:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread count: 28 {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:19:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread info: [<_MainThread(MainThread, started 139554943000704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:19:18 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d2a93451-dd44-4872-83f6-17b851cadb3e tempest-VolumesActionsTest-1050327428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-04d87b9b-d598-4437-b5d8-0b0a1084ce69" returned: 0 in 0.535s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d2a93451-dd44-4872-83f6-17b851cadb3e tempest-VolumesActionsTest-1050327428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-04d87b9b-d598-4437-b5d8-0b0a1084ce69 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:18 devstack sudo[95485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-04d87b9b-d598-4437-b5d8-0b0a1084ce69 Sep 03 11:19:18 devstack sudo[95485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:19 devstack sudo[95485]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d2a93451-dd44-4872-83f6-17b851cadb3e tempest-VolumesActionsTest-1050327428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-04d87b9b-d598-4437-b5d8-0b0a1084ce69" returned: 0 in 0.360s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:19 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d2a93451-dd44-4872-83f6-17b851cadb3e tempest-VolumesActionsTest-1050327428 None] Lock "cinder-quobyte-04d87b9b-d598-4437-b5d8-0b0a1084ce69" released by "delete_volume" :: held 0.963s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:19 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-d2a93451-dd44-4872-83f6-17b851cadb3e tempest-VolumesActionsTest-1050327428 None] Created reservations ['ab61037a-961e-4a5d-b2c2-d34ede0d471f', '75c56e01-3f15-434d-8344-3b6d56b6768f', '39342dc8-dfa3-410d-9f7c-91e04de66ebb', '1f8e4c7d-acff-4233-a990-4e7a6770c3a4'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:19:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d2a93451-dd44-4872-83f6-17b851cadb3e tempest-VolumesActionsTest-1050327428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d2a93451-dd44-4872-83f6-17b851cadb3e tempest-VolumesActionsTest-1050327428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:19 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d2a93451-dd44-4872-83f6-17b851cadb3e tempest-VolumesActionsTest-1050327428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:19:19 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d2a93451-dd44-4872-83f6-17b851cadb3e tempest-VolumesActionsTest-1050327428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:19:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d2a93451-dd44-4872-83f6-17b851cadb3e tempest-VolumesActionsTest-1050327428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d2a93451-dd44-4872-83f6-17b851cadb3e tempest-VolumesActionsTest-1050327428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:19 devstack sudo[95488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:19:19 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:19 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d2a93451-dd44-4872-83f6-17b851cadb3e tempest-VolumesActionsTest-1050327428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.296s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:19 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-d2a93451-dd44-4872-83f6-17b851cadb3e tempest-VolumesActionsTest-1050327428 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:19:19 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-d2a93451-dd44-4872-83f6-17b851cadb3e tempest-VolumesActionsTest-1050327428 None] Deleted volume successfully. Sep 03 11:19:19 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d2a93451-dd44-4872-83f6-17b851cadb3e tempest-VolumesActionsTest-1050327428 None] Lock "cinder-04d87b9b-d598-4437-b5d8-0b0a1084ce69-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:20 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec92ad55-1a37-4ca5-8a93-80ea2673f510 tempest-VolumesActionsTest-849658457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:19:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ec92ad55-1a37-4ca5-8a93-80ea2673f510 tempest-VolumesActionsTest-849658457 None] Flow 'volume_create_manager' (3dc99511-5ea5-4a1c-b23e-6d3f851640c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:19:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ec92ad55-1a37-4ca5-8a93-80ea2673f510 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61dc13d2-19af-4b9d-b2e7-a934434568e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ec92ad55-1a37-4ca5-8a93-80ea2673f510 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61dc13d2-19af-4b9d-b2e7-a934434568e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1934162544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4bad87f-b7f5-41d2-ac5b-27849806074f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68554cd8f42e427692f2042c9e6db115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:19:20Z,use_quota=True,user_id='9fdff0e3f9c54adb90c508fb6ea826d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ec92ad55-1a37-4ca5-8a93-80ea2673f510 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a55647-2802-471d-bb49-fd94f02ba939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ec92ad55-1a37-4ca5-8a93-80ea2673f510 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7a55647-2802-471d-bb49-fd94f02ba939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ec92ad55-1a37-4ca5-8a93-80ea2673f510 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa95636-b59f-43ca-a0c3-234ca4dfda24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ec92ad55-1a37-4ca5-8a93-80ea2673f510 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fa95636-b59f-43ca-a0c3-234ca4dfda24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4bad87f-b7f5-41d2-ac5b-27849806074f', 'volume_name': 'volume-a4bad87f-b7f5-41d2-ac5b-27849806074f', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ec92ad55-1a37-4ca5-8a93-80ea2673f510 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c0f4f13-8ee0-4f7d-9c9d-3ca598b7eedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ec92ad55-1a37-4ca5-8a93-80ea2673f510 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c0f4f13-8ee0-4f7d-9c9d-3ca598b7eedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ec92ad55-1a37-4ca5-8a93-80ea2673f510 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7024602-b7e6-4817-a635-ac0c7bd63cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:20 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-ec92ad55-1a37-4ca5-8a93-80ea2673f510 tempest-VolumesActionsTest-849658457 None] Volume a4bad87f-b7f5-41d2-ac5b-27849806074f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4bad87f-b7f5-41d2-ac5b-27849806074f', 'volume_size': 1} Sep 03 11:19:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ec92ad55-1a37-4ca5-8a93-80ea2673f510 tempest-VolumesActionsTest-849658457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ec92ad55-1a37-4ca5-8a93-80ea2673f510 tempest-VolumesActionsTest-849658457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ec92ad55-1a37-4ca5-8a93-80ea2673f510 tempest-VolumesActionsTest-849658457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:19:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1934162544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4bad87f-b7f5-41d2-ac5b-27849806074f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68554cd8f42e427692f2042c9e6db115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:19:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:19:20Z,use_quota=True,user_id='9fdff0e3f9c54adb90c508fb6ea826d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:19:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-ec92ad55-1a37-4ca5-8a93-80ea2673f510 tempest-VolumesActionsTest-849658457 None] Creating volume a4bad87f-b7f5-41d2-ac5b-27849806074f {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:19:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ec92ad55-1a37-4ca5-8a93-80ea2673f510 tempest-VolumesActionsTest-849658457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ec92ad55-1a37-4ca5-8a93-80ea2673f510 tempest-VolumesActionsTest-849658457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ec92ad55-1a37-4ca5-8a93-80ea2673f510 tempest-VolumesActionsTest-849658457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:19:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ec92ad55-1a37-4ca5-8a93-80ea2673f510 tempest-VolumesActionsTest-849658457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:19:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ec92ad55-1a37-4ca5-8a93-80ea2673f510 tempest-VolumesActionsTest-849658457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ec92ad55-1a37-4ca5-8a93-80ea2673f510 tempest-VolumesActionsTest-849658457 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:19:20 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-ec92ad55-1a37-4ca5-8a93-80ea2673f510 tempest-VolumesActionsTest-849658457 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:19:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ec92ad55-1a37-4ca5-8a93-80ea2673f510 tempest-VolumesActionsTest-849658457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a4bad87f-b7f5-41d2-ac5b-27849806074f 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:20 devstack sudo[95493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a4bad87f-b7f5-41d2-ac5b-27849806074f 1073741824 Sep 03 11:19:20 devstack sudo[95493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:20 devstack sudo[95493]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ec92ad55-1a37-4ca5-8a93-80ea2673f510 tempest-VolumesActionsTest-849658457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a4bad87f-b7f5-41d2-ac5b-27849806074f 1073741824" returned: 0 in 0.542s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ec92ad55-1a37-4ca5-8a93-80ea2673f510 tempest-VolumesActionsTest-849658457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a4bad87f-b7f5-41d2-ac5b-27849806074f {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:20 devstack sudo[95500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a4bad87f-b7f5-41d2-ac5b-27849806074f Sep 03 11:19:20 devstack sudo[95500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:21 devstack sudo[95500]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ec92ad55-1a37-4ca5-8a93-80ea2673f510 tempest-VolumesActionsTest-849658457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a4bad87f-b7f5-41d2-ac5b-27849806074f" returned: 0 in 0.335s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:21 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ec92ad55-1a37-4ca5-8a93-80ea2673f510 tempest-VolumesActionsTest-849658457 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:19:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ec92ad55-1a37-4ca5-8a93-80ea2673f510 tempest-VolumesActionsTest-849658457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ec92ad55-1a37-4ca5-8a93-80ea2673f510 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7024602-b7e6-4817-a635-ac0c7bd63cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4bad87f-b7f5-41d2-ac5b-27849806074f', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ec92ad55-1a37-4ca5-8a93-80ea2673f510 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c653e0-a206-451a-8088-b55f35a51609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:21 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-ec92ad55-1a37-4ca5-8a93-80ea2673f510 tempest-VolumesActionsTest-849658457 None] Volume volume-a4bad87f-b7f5-41d2-ac5b-27849806074f (a4bad87f-b7f5-41d2-ac5b-27849806074f): created successfully Sep 03 11:19:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ec92ad55-1a37-4ca5-8a93-80ea2673f510 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c653e0-a206-451a-8088-b55f35a51609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ec92ad55-1a37-4ca5-8a93-80ea2673f510 tempest-VolumesActionsTest-849658457 None] Flow 'volume_create_manager' (3dc99511-5ea5-4a1c-b23e-6d3f851640c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:19:21 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-ec92ad55-1a37-4ca5-8a93-80ea2673f510 tempest-VolumesActionsTest-849658457 None] Created volume successfully. Sep 03 11:19:22 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-0ddb0e24-c0e2-4fb2-aec4-6586926a197e tempest-VolumesActionsTest-1050327428 None] Acquiring lock "cinder-a4bad87f-b7f5-41d2-ac5b-27849806074f-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:22 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-0ddb0e24-c0e2-4fb2-aec4-6586926a197e tempest-VolumesActionsTest-1050327428 None] Lock "cinder-a4bad87f-b7f5-41d2-ac5b-27849806074f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:22 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-0ddb0e24-c0e2-4fb2-aec4-6586926a197e tempest-VolumesActionsTest-1050327428 None] Acquiring lock "cinder-quobyte-a4bad87f-b7f5-41d2-ac5b-27849806074f" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:22 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-0ddb0e24-c0e2-4fb2-aec4-6586926a197e tempest-VolumesActionsTest-1050327428 None] Lock "cinder-quobyte-a4bad87f-b7f5-41d2-ac5b-27849806074f" acquired by "delete_volume" :: waited 0.017s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:22 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[509968d1-b314-49ad-8db6-e45f4f83bb96]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:19:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0ddb0e24-c0e2-4fb2-aec4-6586926a197e tempest-VolumesActionsTest-1050327428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a4bad87f-b7f5-41d2-ac5b-27849806074f {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:22 devstack sudo[95504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a4bad87f-b7f5-41d2-ac5b-27849806074f Sep 03 11:19:22 devstack sudo[95504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:23 devstack sudo[95504]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0ddb0e24-c0e2-4fb2-aec4-6586926a197e tempest-VolumesActionsTest-1050327428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a4bad87f-b7f5-41d2-ac5b-27849806074f" returned: 0 in 0.452s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0ddb0e24-c0e2-4fb2-aec4-6586926a197e tempest-VolumesActionsTest-1050327428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a4bad87f-b7f5-41d2-ac5b-27849806074f {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:23 devstack sudo[95509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a4bad87f-b7f5-41d2-ac5b-27849806074f Sep 03 11:19:23 devstack sudo[95509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:23 devstack sudo[95509]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0ddb0e24-c0e2-4fb2-aec4-6586926a197e tempest-VolumesActionsTest-1050327428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a4bad87f-b7f5-41d2-ac5b-27849806074f" returned: 0 in 0.426s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:23 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-0ddb0e24-c0e2-4fb2-aec4-6586926a197e tempest-VolumesActionsTest-1050327428 None] Lock "cinder-quobyte-a4bad87f-b7f5-41d2-ac5b-27849806074f" released by "delete_volume" :: held 0.932s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:23 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-0ddb0e24-c0e2-4fb2-aec4-6586926a197e tempest-VolumesActionsTest-1050327428 None] Created reservations ['3a5112cf-3bb5-4462-8563-6b4c0e6ed19c', '69411e94-cc91-4e1a-9390-8720ba1031dc', 'efa4bce6-cbe4-418a-bc57-16a4b0c0bb69', '08f4bf15-022b-4891-a926-4c0f16328305'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:19:23 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [req-9c613093-f2c3-4c82-b337-ef5cd69da999 req-65589e1c-459a-4f24-bfd2-1203b58b6a82 tempest-VolumesSnapshotsTestJSON-1823845794 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:19:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-9c613093-f2c3-4c82-b337-ef5cd69da999 req-65589e1c-459a-4f24-bfd2-1203b58b6a82 tempest-VolumesSnapshotsTestJSON-1823845794 None] Flow 'volume_create_manager' (d92bf737-9db3-439a-9ff3-7dfbceeae15e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:19:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-9c613093-f2c3-4c82-b337-ef5cd69da999 req-65589e1c-459a-4f24-bfd2-1203b58b6a82 tempest-VolumesSnapshotsTestJSON-1823845794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b4c647-2d7c-4fb4-ae62-b2c1188170bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-9c613093-f2c3-4c82-b337-ef5cd69da999 req-65589e1c-459a-4f24-bfd2-1203b58b6a82 tempest-VolumesSnapshotsTestJSON-1823845794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92b4c647-2d7c-4fb4-ae62-b2c1188170bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1984488560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac54eea4-643c-43ec-b7a2-1185df470ecc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7488e39be2a4ded93a2cfe5a9cba4bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:19:24Z,use_quota=True,user_id='a1a01f177e8a46729613c4037725328d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-9c613093-f2c3-4c82-b337-ef5cd69da999 req-65589e1c-459a-4f24-bfd2-1203b58b6a82 tempest-VolumesSnapshotsTestJSON-1823845794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ea8a6e-9af8-4d41-9464-49f6be9a3a24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-9c613093-f2c3-4c82-b337-ef5cd69da999 req-65589e1c-459a-4f24-bfd2-1203b58b6a82 tempest-VolumesSnapshotsTestJSON-1823845794 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1ea8a6e-9af8-4d41-9464-49f6be9a3a24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-9c613093-f2c3-4c82-b337-ef5cd69da999 req-65589e1c-459a-4f24-bfd2-1203b58b6a82 tempest-VolumesSnapshotsTestJSON-1823845794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (463d2eef-de80-4fb8-9892-9908aa4e207c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-9c613093-f2c3-4c82-b337-ef5cd69da999 req-65589e1c-459a-4f24-bfd2-1203b58b6a82 tempest-VolumesSnapshotsTestJSON-1823845794 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (463d2eef-de80-4fb8-9892-9908aa4e207c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac54eea4-643c-43ec-b7a2-1185df470ecc', 'volume_name': 'volume-ac54eea4-643c-43ec-b7a2-1185df470ecc', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-9c613093-f2c3-4c82-b337-ef5cd69da999 req-65589e1c-459a-4f24-bfd2-1203b58b6a82 tempest-VolumesSnapshotsTestJSON-1823845794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3063dac6-3d7b-4774-9abb-706d717c7714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-9c613093-f2c3-4c82-b337-ef5cd69da999 req-65589e1c-459a-4f24-bfd2-1203b58b6a82 tempest-VolumesSnapshotsTestJSON-1823845794 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3063dac6-3d7b-4774-9abb-706d717c7714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-9c613093-f2c3-4c82-b337-ef5cd69da999 req-65589e1c-459a-4f24-bfd2-1203b58b6a82 tempest-VolumesSnapshotsTestJSON-1823845794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b15dbf3a-e881-4c40-9dde-25a156926d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:23 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [req-9c613093-f2c3-4c82-b337-ef5cd69da999 req-65589e1c-459a-4f24-bfd2-1203b58b6a82 tempest-VolumesSnapshotsTestJSON-1823845794 None] Volume ac54eea4-643c-43ec-b7a2-1185df470ecc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac54eea4-643c-43ec-b7a2-1185df470ecc', 'volume_size': 1} Sep 03 11:19:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-9c613093-f2c3-4c82-b337-ef5cd69da999 req-65589e1c-459a-4f24-bfd2-1203b58b6a82 tempest-VolumesSnapshotsTestJSON-1823845794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-9c613093-f2c3-4c82-b337-ef5cd69da999 req-65589e1c-459a-4f24-bfd2-1203b58b6a82 tempest-VolumesSnapshotsTestJSON-1823845794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:23 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [req-9c613093-f2c3-4c82-b337-ef5cd69da999 req-65589e1c-459a-4f24-bfd2-1203b58b6a82 tempest-VolumesSnapshotsTestJSON-1823845794 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1984488560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac54eea4-643c-43ec-b7a2-1185df470ecc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7488e39be2a4ded93a2cfe5a9cba4bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:19:24Z,use_quota=True,user_id='a1a01f177e8a46729613c4037725328d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:19:23 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [req-9c613093-f2c3-4c82-b337-ef5cd69da999 req-65589e1c-459a-4f24-bfd2-1203b58b6a82 tempest-VolumesSnapshotsTestJSON-1823845794 None] Creating volume ac54eea4-643c-43ec-b7a2-1185df470ecc {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:19:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-9c613093-f2c3-4c82-b337-ef5cd69da999 req-65589e1c-459a-4f24-bfd2-1203b58b6a82 tempest-VolumesSnapshotsTestJSON-1823845794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-9c613093-f2c3-4c82-b337-ef5cd69da999 req-65589e1c-459a-4f24-bfd2-1203b58b6a82 tempest-VolumesSnapshotsTestJSON-1823845794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:23 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [req-9c613093-f2c3-4c82-b337-ef5cd69da999 req-65589e1c-459a-4f24-bfd2-1203b58b6a82 tempest-VolumesSnapshotsTestJSON-1823845794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:19:23 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [req-9c613093-f2c3-4c82-b337-ef5cd69da999 req-65589e1c-459a-4f24-bfd2-1203b58b6a82 tempest-VolumesSnapshotsTestJSON-1823845794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:19:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-9c613093-f2c3-4c82-b337-ef5cd69da999 req-65589e1c-459a-4f24-bfd2-1203b58b6a82 tempest-VolumesSnapshotsTestJSON-1823845794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:23 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [req-9c613093-f2c3-4c82-b337-ef5cd69da999 req-65589e1c-459a-4f24-bfd2-1203b58b6a82 tempest-VolumesSnapshotsTestJSON-1823845794 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:19:23 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [req-9c613093-f2c3-4c82-b337-ef5cd69da999 req-65589e1c-459a-4f24-bfd2-1203b58b6a82 tempest-VolumesSnapshotsTestJSON-1823845794 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:19:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-9c613093-f2c3-4c82-b337-ef5cd69da999 req-65589e1c-459a-4f24-bfd2-1203b58b6a82 tempest-VolumesSnapshotsTestJSON-1823845794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0ddb0e24-c0e2-4fb2-aec4-6586926a197e tempest-VolumesActionsTest-1050327428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0ddb0e24-c0e2-4fb2-aec4-6586926a197e tempest-VolumesActionsTest-1050327428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:23 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0ddb0e24-c0e2-4fb2-aec4-6586926a197e tempest-VolumesActionsTest-1050327428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:19:23 devstack sudo[95512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc 1073741824 Sep 03 11:19:23 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:23 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0ddb0e24-c0e2-4fb2-aec4-6586926a197e tempest-VolumesActionsTest-1050327428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:19:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0ddb0e24-c0e2-4fb2-aec4-6586926a197e tempest-VolumesActionsTest-1050327428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0ddb0e24-c0e2-4fb2-aec4-6586926a197e tempest-VolumesActionsTest-1050327428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:23 devstack sudo[95514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:19:23 devstack sudo[95514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:24 devstack sudo[95514]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0ddb0e24-c0e2-4fb2-aec4-6586926a197e tempest-VolumesActionsTest-1050327428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.354s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:24 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-0ddb0e24-c0e2-4fb2-aec4-6586926a197e tempest-VolumesActionsTest-1050327428 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:19:24 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-0ddb0e24-c0e2-4fb2-aec4-6586926a197e tempest-VolumesActionsTest-1050327428 None] Deleted volume successfully. Sep 03 11:19:24 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-0ddb0e24-c0e2-4fb2-aec4-6586926a197e tempest-VolumesActionsTest-1050327428 None] Lock "cinder-a4bad87f-b7f5-41d2-ac5b-27849806074f-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:24 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-9c613093-f2c3-4c82-b337-ef5cd69da999 req-65589e1c-459a-4f24-bfd2-1203b58b6a82 tempest-VolumesSnapshotsTestJSON-1823845794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc 1073741824" returned: 0 in 0.551s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-9c613093-f2c3-4c82-b337-ef5cd69da999 req-65589e1c-459a-4f24-bfd2-1203b58b6a82 tempest-VolumesSnapshotsTestJSON-1823845794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:24 devstack sudo[95521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc Sep 03 11:19:24 devstack sudo[95521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:24 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-98cdca03-3c77-4ddb-8fd1-11cbbccde1f4 tempest-VolumesActionsTest-849658457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:19:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-98cdca03-3c77-4ddb-8fd1-11cbbccde1f4 tempest-VolumesActionsTest-849658457 None] Flow 'volume_create_manager' (4abb6f04-6c2e-4df6-842c-16698c606e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:19:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-98cdca03-3c77-4ddb-8fd1-11cbbccde1f4 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (835b6a7e-4042-4c70-869c-b320cf4d39ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-98cdca03-3c77-4ddb-8fd1-11cbbccde1f4 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (835b6a7e-4042-4c70-869c-b320cf4d39ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1112841877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=651b270b-ff0a-42b9-9ee3-7d380f93329d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68554cd8f42e427692f2042c9e6db115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:19:24Z,use_quota=True,user_id='9fdff0e3f9c54adb90c508fb6ea826d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-98cdca03-3c77-4ddb-8fd1-11cbbccde1f4 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5467483d-0b34-4dad-8d65-7989646048d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-98cdca03-3c77-4ddb-8fd1-11cbbccde1f4 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5467483d-0b34-4dad-8d65-7989646048d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-98cdca03-3c77-4ddb-8fd1-11cbbccde1f4 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fa7eee1-37b3-43ff-8f8f-5c2b7bde1790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-98cdca03-3c77-4ddb-8fd1-11cbbccde1f4 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fa7eee1-37b3-43ff-8f8f-5c2b7bde1790) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '651b270b-ff0a-42b9-9ee3-7d380f93329d', 'volume_name': 'volume-651b270b-ff0a-42b9-9ee3-7d380f93329d', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-98cdca03-3c77-4ddb-8fd1-11cbbccde1f4 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a95ce0c-3a51-4fdb-b337-25dce10ee3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-98cdca03-3c77-4ddb-8fd1-11cbbccde1f4 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a95ce0c-3a51-4fdb-b337-25dce10ee3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-98cdca03-3c77-4ddb-8fd1-11cbbccde1f4 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37767d6d-f510-4029-a35e-2c7335a4799a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:24 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-98cdca03-3c77-4ddb-8fd1-11cbbccde1f4 tempest-VolumesActionsTest-849658457 None] Volume 651b270b-ff0a-42b9-9ee3-7d380f93329d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-651b270b-ff0a-42b9-9ee3-7d380f93329d', 'volume_size': 1} Sep 03 11:19:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-98cdca03-3c77-4ddb-8fd1-11cbbccde1f4 tempest-VolumesActionsTest-849658457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:24 devstack sudo[95521]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-9c613093-f2c3-4c82-b337-ef5cd69da999 req-65589e1c-459a-4f24-bfd2-1203b58b6a82 tempest-VolumesSnapshotsTestJSON-1823845794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc" returned: 0 in 0.418s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [req-9c613093-f2c3-4c82-b337-ef5cd69da999 req-65589e1c-459a-4f24-bfd2-1203b58b6a82 tempest-VolumesSnapshotsTestJSON-1823845794 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:19:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-9c613093-f2c3-4c82-b337-ef5cd69da999 req-65589e1c-459a-4f24-bfd2-1203b58b6a82 tempest-VolumesSnapshotsTestJSON-1823845794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-98cdca03-3c77-4ddb-8fd1-11cbbccde1f4 tempest-VolumesActionsTest-849658457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.205s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-98cdca03-3c77-4ddb-8fd1-11cbbccde1f4 tempest-VolumesActionsTest-849658457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1112841877',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=651b270b-ff0a-42b9-9ee3-7d380f93329d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68554cd8f42e427692f2042c9e6db115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:19:24Z,use_quota=True,user_id='9fdff0e3f9c54adb90c508fb6ea826d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:19:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-98cdca03-3c77-4ddb-8fd1-11cbbccde1f4 tempest-VolumesActionsTest-849658457 None] Creating volume 651b270b-ff0a-42b9-9ee3-7d380f93329d {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:19:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-98cdca03-3c77-4ddb-8fd1-11cbbccde1f4 tempest-VolumesActionsTest-849658457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-98cdca03-3c77-4ddb-8fd1-11cbbccde1f4 tempest-VolumesActionsTest-849658457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-98cdca03-3c77-4ddb-8fd1-11cbbccde1f4 tempest-VolumesActionsTest-849658457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:19:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-98cdca03-3c77-4ddb-8fd1-11cbbccde1f4 tempest-VolumesActionsTest-849658457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:19:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-98cdca03-3c77-4ddb-8fd1-11cbbccde1f4 tempest-VolumesActionsTest-849658457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-98cdca03-3c77-4ddb-8fd1-11cbbccde1f4 tempest-VolumesActionsTest-849658457 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:19:24 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-98cdca03-3c77-4ddb-8fd1-11cbbccde1f4 tempest-VolumesActionsTest-849658457 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:19:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-98cdca03-3c77-4ddb-8fd1-11cbbccde1f4 tempest-VolumesActionsTest-849658457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-651b270b-ff0a-42b9-9ee3-7d380f93329d 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-9c613093-f2c3-4c82-b337-ef5cd69da999 req-65589e1c-459a-4f24-bfd2-1203b58b6a82 tempest-VolumesSnapshotsTestJSON-1823845794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b15dbf3a-e881-4c40-9dde-25a156926d29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac54eea4-643c-43ec-b7a2-1185df470ecc', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-9c613093-f2c3-4c82-b337-ef5cd69da999 req-65589e1c-459a-4f24-bfd2-1203b58b6a82 tempest-VolumesSnapshotsTestJSON-1823845794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2bdcad2-1a36-4bb1-9a6b-2203cfd1921a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:24 devstack sudo[95524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-651b270b-ff0a-42b9-9ee3-7d380f93329d 1073741824 Sep 03 11:19:24 devstack sudo[95524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:24 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [req-9c613093-f2c3-4c82-b337-ef5cd69da999 req-65589e1c-459a-4f24-bfd2-1203b58b6a82 tempest-VolumesSnapshotsTestJSON-1823845794 None] Volume volume-ac54eea4-643c-43ec-b7a2-1185df470ecc (ac54eea4-643c-43ec-b7a2-1185df470ecc): created successfully Sep 03 11:19:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-9c613093-f2c3-4c82-b337-ef5cd69da999 req-65589e1c-459a-4f24-bfd2-1203b58b6a82 tempest-VolumesSnapshotsTestJSON-1823845794 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2bdcad2-1a36-4bb1-9a6b-2203cfd1921a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-9c613093-f2c3-4c82-b337-ef5cd69da999 req-65589e1c-459a-4f24-bfd2-1203b58b6a82 tempest-VolumesSnapshotsTestJSON-1823845794 None] Flow 'volume_create_manager' (d92bf737-9db3-439a-9ff3-7dfbceeae15e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:19:24 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-9c613093-f2c3-4c82-b337-ef5cd69da999 req-65589e1c-459a-4f24-bfd2-1203b58b6a82 tempest-VolumesSnapshotsTestJSON-1823845794 None] Created volume successfully. Sep 03 11:19:25 devstack sudo[95524]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-98cdca03-3c77-4ddb-8fd1-11cbbccde1f4 tempest-VolumesActionsTest-849658457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-651b270b-ff0a-42b9-9ee3-7d380f93329d 1073741824" returned: 0 in 0.590s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-98cdca03-3c77-4ddb-8fd1-11cbbccde1f4 tempest-VolumesActionsTest-849658457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-651b270b-ff0a-42b9-9ee3-7d380f93329d {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:25 devstack sudo[95530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-651b270b-ff0a-42b9-9ee3-7d380f93329d Sep 03 11:19:25 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:25 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-98cdca03-3c77-4ddb-8fd1-11cbbccde1f4 tempest-VolumesActionsTest-849658457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-651b270b-ff0a-42b9-9ee3-7d380f93329d" returned: 0 in 0.372s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:25 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-98cdca03-3c77-4ddb-8fd1-11cbbccde1f4 tempest-VolumesActionsTest-849658457 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:19:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-98cdca03-3c77-4ddb-8fd1-11cbbccde1f4 tempest-VolumesActionsTest-849658457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-98cdca03-3c77-4ddb-8fd1-11cbbccde1f4 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37767d6d-f510-4029-a35e-2c7335a4799a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-651b270b-ff0a-42b9-9ee3-7d380f93329d', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-98cdca03-3c77-4ddb-8fd1-11cbbccde1f4 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dae4aa9-076a-44e6-bedf-6c8bd74f65a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:25 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-98cdca03-3c77-4ddb-8fd1-11cbbccde1f4 tempest-VolumesActionsTest-849658457 None] Volume volume-651b270b-ff0a-42b9-9ee3-7d380f93329d (651b270b-ff0a-42b9-9ee3-7d380f93329d): created successfully Sep 03 11:19:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-98cdca03-3c77-4ddb-8fd1-11cbbccde1f4 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1dae4aa9-076a-44e6-bedf-6c8bd74f65a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-98cdca03-3c77-4ddb-8fd1-11cbbccde1f4 tempest-VolumesActionsTest-849658457 None] Flow 'volume_create_manager' (4abb6f04-6c2e-4df6-842c-16698c606e19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:19:25 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-98cdca03-3c77-4ddb-8fd1-11cbbccde1f4 tempest-VolumesActionsTest-849658457 None] Created volume successfully. Sep 03 11:19:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-94c20424-e0dd-40ad-8487-8063e42bedb0 req-c39d67e7-e740-42cf-b4fe-c22e653531b9 tempest-VolumesSnapshotsTestJSON-1823845794 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-94c20424-e0dd-40ad-8487-8063e42bedb0 req-c39d67e7-e740-42cf-b4fe-c22e653531b9 tempest-VolumesSnapshotsTestJSON-1823845794 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:26 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [req-94c20424-e0dd-40ad-8487-8063e42bedb0 req-c39d67e7-e740-42cf-b4fe-c22e653531b9 tempest-VolumesSnapshotsTestJSON-1823845794 None] Creating offline snapshot ff976c93-8caa-4f0b-994b-23f357f7e320 of volume ac54eea4-643c-43ec-b7a2-1185df470ecc {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:19:26 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f76e0f5-555f-484f-98bc-db0209cc902a]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:19:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-94c20424-e0dd-40ad-8487-8063e42bedb0 req-c39d67e7-e740-42cf-b4fe-c22e653531b9 tempest-VolumesSnapshotsTestJSON-1823845794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:26 devstack sudo[95537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc Sep 03 11:19:26 devstack sudo[95537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:26 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-38106ebb-9587-4f6b-9b99-4a512b13b70d tempest-VolumesActionsTest-1050327428 None] Acquiring lock "cinder-651b270b-ff0a-42b9-9ee3-7d380f93329d-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:26 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-38106ebb-9587-4f6b-9b99-4a512b13b70d tempest-VolumesActionsTest-1050327428 None] Lock "cinder-651b270b-ff0a-42b9-9ee3-7d380f93329d-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:26 devstack sudo[95537]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-94c20424-e0dd-40ad-8487-8063e42bedb0 req-c39d67e7-e740-42cf-b4fe-c22e653531b9 tempest-VolumesSnapshotsTestJSON-1823845794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc" returned: 0 in 0.611s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-94c20424-e0dd-40ad-8487-8063e42bedb0 req-c39d67e7-e740-42cf-b4fe-c22e653531b9 tempest-VolumesSnapshotsTestJSON-1823845794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc.ff976c93-8caa-4f0b-994b-23f357f7e320 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:26 devstack sudo[95542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc.ff976c93-8caa-4f0b-994b-23f357f7e320 1G Sep 03 11:19:26 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:26 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-38106ebb-9587-4f6b-9b99-4a512b13b70d tempest-VolumesActionsTest-1050327428 None] Acquiring lock "cinder-quobyte-651b270b-ff0a-42b9-9ee3-7d380f93329d" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:26 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-38106ebb-9587-4f6b-9b99-4a512b13b70d tempest-VolumesActionsTest-1050327428 None] Lock "cinder-quobyte-651b270b-ff0a-42b9-9ee3-7d380f93329d" acquired by "delete_volume" :: waited 0.019s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:26 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e751b20-8e9a-44f7-92e7-acecc02c4053]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:19:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-38106ebb-9587-4f6b-9b99-4a512b13b70d tempest-VolumesActionsTest-1050327428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-651b270b-ff0a-42b9-9ee3-7d380f93329d {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:27 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-651b270b-ff0a-42b9-9ee3-7d380f93329d Sep 03 11:19:27 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:27 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-38106ebb-9587-4f6b-9b99-4a512b13b70d tempest-VolumesActionsTest-1050327428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-651b270b-ff0a-42b9-9ee3-7d380f93329d" returned: 0 in 0.505s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-38106ebb-9587-4f6b-9b99-4a512b13b70d tempest-VolumesActionsTest-1050327428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-651b270b-ff0a-42b9-9ee3-7d380f93329d {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:27 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-94c20424-e0dd-40ad-8487-8063e42bedb0 req-c39d67e7-e740-42cf-b4fe-c22e653531b9 tempest-VolumesSnapshotsTestJSON-1823845794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc.ff976c93-8caa-4f0b-994b-23f357f7e320 1G" returned: 0 in 0.621s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-94c20424-e0dd-40ad-8487-8063e42bedb0 req-c39d67e7-e740-42cf-b4fe-c22e653531b9 tempest-VolumesSnapshotsTestJSON-1823845794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac54eea4-643c-43ec-b7a2-1185df470ecc -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc.ff976c93-8caa-4f0b-994b-23f357f7e320 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:27 devstack sudo[95553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-651b270b-ff0a-42b9-9ee3-7d380f93329d Sep 03 11:19:27 devstack sudo[95553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:27 devstack sudo[95555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac54eea4-643c-43ec-b7a2-1185df470ecc -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc.ff976c93-8caa-4f0b-994b-23f357f7e320 Sep 03 11:19:27 devstack sudo[95555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:27 devstack sudo[95553]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-38106ebb-9587-4f6b-9b99-4a512b13b70d tempest-VolumesActionsTest-1050327428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-651b270b-ff0a-42b9-9ee3-7d380f93329d" returned: 0 in 0.347s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:27 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-38106ebb-9587-4f6b-9b99-4a512b13b70d tempest-VolumesActionsTest-1050327428 None] Lock "cinder-quobyte-651b270b-ff0a-42b9-9ee3-7d380f93329d" released by "delete_volume" :: held 0.899s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:27 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-38106ebb-9587-4f6b-9b99-4a512b13b70d tempest-VolumesActionsTest-1050327428 None] Created reservations ['086616c0-c333-4c8e-be9c-cfb70108fd2d', 'f1f331fe-1880-4943-b849-1c0366b90cbb', '5cf1a5ab-3d20-4332-aab4-a3427cd0a16b', '76f0384b-4c2c-4c06-8ca8-30a4bee1955c'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:19:27 devstack sudo[95555]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-94c20424-e0dd-40ad-8487-8063e42bedb0 req-c39d67e7-e740-42cf-b4fe-c22e653531b9 tempest-VolumesSnapshotsTestJSON-1823845794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac54eea4-643c-43ec-b7a2-1185df470ecc -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc.ff976c93-8caa-4f0b-994b-23f357f7e320" returned: 0 in 0.501s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:27 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [req-94c20424-e0dd-40ad-8487-8063e42bedb0 req-c39d67e7-e740-42cf-b4fe-c22e653531b9 tempest-VolumesSnapshotsTestJSON-1823845794 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc.ff976c93-8caa-4f0b-994b-23f357f7e320 is being set with open permissions: ugo+rw Sep 03 11:19:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-94c20424-e0dd-40ad-8487-8063e42bedb0 req-c39d67e7-e740-42cf-b4fe-c22e653531b9 tempest-VolumesSnapshotsTestJSON-1823845794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc.ff976c93-8caa-4f0b-994b-23f357f7e320 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:27 devstack sudo[95563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc.ff976c93-8caa-4f0b-994b-23f357f7e320 Sep 03 11:19:28 devstack sudo[95563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-38106ebb-9587-4f6b-9b99-4a512b13b70d tempest-VolumesActionsTest-1050327428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-38106ebb-9587-4f6b-9b99-4a512b13b70d tempest-VolumesActionsTest-1050327428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:28 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-38106ebb-9587-4f6b-9b99-4a512b13b70d tempest-VolumesActionsTest-1050327428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:19:28 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-38106ebb-9587-4f6b-9b99-4a512b13b70d tempest-VolumesActionsTest-1050327428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:19:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-38106ebb-9587-4f6b-9b99-4a512b13b70d tempest-VolumesActionsTest-1050327428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-38106ebb-9587-4f6b-9b99-4a512b13b70d tempest-VolumesActionsTest-1050327428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:28 devstack sudo[95565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:19:28 devstack sudo[95565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:28 devstack sudo[95563]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-94c20424-e0dd-40ad-8487-8063e42bedb0 req-c39d67e7-e740-42cf-b4fe-c22e653531b9 tempest-VolumesSnapshotsTestJSON-1823845794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc.ff976c93-8caa-4f0b-994b-23f357f7e320" returned: 0 in 0.419s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-94c20424-e0dd-40ad-8487-8063e42bedb0 req-c39d67e7-e740-42cf-b4fe-c22e653531b9 tempest-VolumesSnapshotsTestJSON-1823845794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:28 devstack sudo[95580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc.info Sep 03 11:19:28 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:28 devstack sudo[95565]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-38106ebb-9587-4f6b-9b99-4a512b13b70d tempest-VolumesActionsTest-1050327428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.439s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:28 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-38106ebb-9587-4f6b-9b99-4a512b13b70d tempest-VolumesActionsTest-1050327428 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:19:28 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-38106ebb-9587-4f6b-9b99-4a512b13b70d tempest-VolumesActionsTest-1050327428 None] Deleted volume successfully. Sep 03 11:19:28 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-38106ebb-9587-4f6b-9b99-4a512b13b70d tempest-VolumesActionsTest-1050327428 None] Lock "cinder-651b270b-ff0a-42b9-9ee3-7d380f93329d-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:28 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-94c20424-e0dd-40ad-8487-8063e42bedb0 req-c39d67e7-e740-42cf-b4fe-c22e653531b9 tempest-VolumesSnapshotsTestJSON-1823845794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc.info" returned: 0 in 0.329s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:28 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [req-94c20424-e0dd-40ad-8487-8063e42bedb0 req-c39d67e7-e740-42cf-b4fe-c22e653531b9 tempest-VolumesSnapshotsTestJSON-1823845794 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc.info is being set with open permissions: ugo+rw Sep 03 11:19:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-94c20424-e0dd-40ad-8487-8063e42bedb0 req-c39d67e7-e740-42cf-b4fe-c22e653531b9 tempest-VolumesSnapshotsTestJSON-1823845794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:28 devstack sudo[95586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc.info Sep 03 11:19:28 devstack sudo[95586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:29 devstack sudo[95586]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-94c20424-e0dd-40ad-8487-8063e42bedb0 req-c39d67e7-e740-42cf-b4fe-c22e653531b9 tempest-VolumesSnapshotsTestJSON-1823845794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc.info" returned: 0 in 0.439s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-94c20424-e0dd-40ad-8487-8063e42bedb0 req-c39d67e7-e740-42cf-b4fe-c22e653531b9 tempest-VolumesSnapshotsTestJSON-1823845794 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.086s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-06aab4e0-97cf-4807-b22e-63a9c87aab42 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-06aab4e0-97cf-4807-b22e-63a9c87aab42 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Flow 'volume_create_manager' (7d34cf67-a58f-4989-a960-a9a21e9026dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-06aab4e0-97cf-4807-b22e-63a9c87aab42 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9686712-b7e0-4c7d-8793-b61652aff5f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:29 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-94c20424-e0dd-40ad-8487-8063e42bedb0 req-c39d67e7-e740-42cf-b4fe-c22e653531b9 tempest-VolumesSnapshotsTestJSON-1823845794 None] Create snapshot completed successfully Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-06aab4e0-97cf-4807-b22e-63a9c87aab42 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9686712-b7e0-4c7d-8793-b61652aff5f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-331581531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa35cb2a-1ecf-40f9-a9de-73fe63ce0838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d2d2e51ba004232ad96830502d81b26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:19:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:19:29Z,use_quota=True,user_id='47f42502b99f42a7bbaf646cf5365592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-06aab4e0-97cf-4807-b22e-63a9c87aab42 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a215cc9-22ad-49c5-a941-a8c9e25d133e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-06aab4e0-97cf-4807-b22e-63a9c87aab42 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a215cc9-22ad-49c5-a941-a8c9e25d133e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-06aab4e0-97cf-4807-b22e-63a9c87aab42 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc06915-518d-4cbe-82c4-d74356dbca50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-06aab4e0-97cf-4807-b22e-63a9c87aab42 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cc06915-518d-4cbe-82c4-d74356dbca50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa35cb2a-1ecf-40f9-a9de-73fe63ce0838', 'volume_name': 'volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838', 'volume_size': 2}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-06aab4e0-97cf-4807-b22e-63a9c87aab42 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aba5241-acff-4360-800e-ddd1a07e5cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-06aab4e0-97cf-4807-b22e-63a9c87aab42 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aba5241-acff-4360-800e-ddd1a07e5cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-06aab4e0-97cf-4807-b22e-63a9c87aab42 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01dcb1ea-64df-4b08-8f44-295dda64c302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:29 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-06aab4e0-97cf-4807-b22e-63a9c87aab42 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Volume aa35cb2a-1ecf-40f9-a9de-73fe63ce0838: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838', 'volume_size': 2} Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-06aab4e0-97cf-4807-b22e-63a9c87aab42 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-06aab4e0-97cf-4807-b22e-63a9c87aab42 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-06aab4e0-97cf-4807-b22e-63a9c87aab42 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-331581531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa35cb2a-1ecf-40f9-a9de-73fe63ce0838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d2d2e51ba004232ad96830502d81b26',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:19:29Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:19:29Z,use_quota=True,user_id='47f42502b99f42a7bbaf646cf5365592',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-06aab4e0-97cf-4807-b22e-63a9c87aab42 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Creating volume aa35cb2a-1ecf-40f9-a9de-73fe63ce0838 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-06aab4e0-97cf-4807-b22e-63a9c87aab42 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-06aab4e0-97cf-4807-b22e-63a9c87aab42 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-06aab4e0-97cf-4807-b22e-63a9c87aab42 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-06aab4e0-97cf-4807-b22e-63a9c87aab42 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-06aab4e0-97cf-4807-b22e-63a9c87aab42 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-06aab4e0-97cf-4807-b22e-63a9c87aab42 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:19:29 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-06aab4e0-97cf-4807-b22e-63a9c87aab42 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-06aab4e0-97cf-4807-b22e-63a9c87aab42 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838 2147483648 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:29 devstack sudo[95591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838 2147483648 Sep 03 11:19:29 devstack sudo[95591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-a285e283-99d2-4c1a-bb93-953cda244254 tempest-VolumesActionsTest-849658457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a285e283-99d2-4c1a-bb93-953cda244254 tempest-VolumesActionsTest-849658457 None] Flow 'volume_create_manager' (cd737da8-8726-4fc5-a158-47646197b454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a285e283-99d2-4c1a-bb93-953cda244254 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c07559aa-7d1e-46be-a4a8-4d4616a4a570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a285e283-99d2-4c1a-bb93-953cda244254 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c07559aa-7d1e-46be-a4a8-4d4616a4a570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-900222933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f6ef70-f9fc-4405-82a6-992d21f1f915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68554cd8f42e427692f2042c9e6db115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:19:30Z,use_quota=True,user_id='9fdff0e3f9c54adb90c508fb6ea826d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a285e283-99d2-4c1a-bb93-953cda244254 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ce69f4-4d13-40bd-9dff-188def3020e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a285e283-99d2-4c1a-bb93-953cda244254 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ce69f4-4d13-40bd-9dff-188def3020e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a285e283-99d2-4c1a-bb93-953cda244254 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f42b2433-c10c-4dc2-bc47-3539366623d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a285e283-99d2-4c1a-bb93-953cda244254 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f42b2433-c10c-4dc2-bc47-3539366623d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95f6ef70-f9fc-4405-82a6-992d21f1f915', 'volume_name': 'volume-95f6ef70-f9fc-4405-82a6-992d21f1f915', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a285e283-99d2-4c1a-bb93-953cda244254 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (671b7c6d-4af7-4d6d-9d9a-0077610682ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a285e283-99d2-4c1a-bb93-953cda244254 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (671b7c6d-4af7-4d6d-9d9a-0077610682ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a285e283-99d2-4c1a-bb93-953cda244254 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e53f43fc-6036-469f-991d-5ea828b52e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:29 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-a285e283-99d2-4c1a-bb93-953cda244254 tempest-VolumesActionsTest-849658457 None] Volume 95f6ef70-f9fc-4405-82a6-992d21f1f915: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95f6ef70-f9fc-4405-82a6-992d21f1f915', 'volume_size': 1} Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a285e283-99d2-4c1a-bb93-953cda244254 tempest-VolumesActionsTest-849658457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:29 devstack sudo[95591]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-06aab4e0-97cf-4807-b22e-63a9c87aab42 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838 2147483648" returned: 0 in 0.604s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-06aab4e0-97cf-4807-b22e-63a9c87aab42 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:30 devstack sudo[95596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838 Sep 03 11:19:30 devstack sudo[95596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [req-dfce50a9-ffce-4e68-bec2-792f5adac7bb req-dfb68588-bba2-4f75-975e-f46eb64f7580 tempest-VolumesSnapshotsTestJSON-1823845794 None] Acquiring lock "cinder-ff976c93-8caa-4f0b-994b-23f357f7e320-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [req-dfce50a9-ffce-4e68-bec2-792f5adac7bb req-dfb68588-bba2-4f75-975e-f46eb64f7580 tempest-VolumesSnapshotsTestJSON-1823845794 None] Lock "cinder-ff976c93-8caa-4f0b-994b-23f357f7e320-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [req-dfce50a9-ffce-4e68-bec2-792f5adac7bb req-dfb68588-bba2-4f75-975e-f46eb64f7580 tempest-VolumesSnapshotsTestJSON-1823845794 None] Acquiring lock "cinder-quobyte-ac54eea4-643c-43ec-b7a2-1185df470ecc" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [req-dfce50a9-ffce-4e68-bec2-792f5adac7bb req-dfb68588-bba2-4f75-975e-f46eb64f7580 tempest-VolumesSnapshotsTestJSON-1823845794 None] Lock "cinder-quobyte-ac54eea4-643c-43ec-b7a2-1185df470ecc" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [req-dfce50a9-ffce-4e68-bec2-792f5adac7bb req-dfb68588-bba2-4f75-975e-f46eb64f7580 tempest-VolumesSnapshotsTestJSON-1823845794 None] Acquiring lock "cinder-quobyte-ff976c93-8caa-4f0b-994b-23f357f7e320" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:30 devstack sudo[95596]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-06aab4e0-97cf-4807-b22e-63a9c87aab42 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838" returned: 0 in 0.303s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-06aab4e0-97cf-4807-b22e-63a9c87aab42 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] <== create_volume: return (944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:19:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-06aab4e0-97cf-4807-b22e-63a9c87aab42 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a285e283-99d2-4c1a-bb93-953cda244254 tempest-VolumesActionsTest-849658457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.448s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a285e283-99d2-4c1a-bb93-953cda244254 tempest-VolumesActionsTest-849658457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:19:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-900222933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95f6ef70-f9fc-4405-82a6-992d21f1f915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68554cd8f42e427692f2042c9e6db115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:19:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:19:30Z,use_quota=True,user_id='9fdff0e3f9c54adb90c508fb6ea826d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:19:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-a285e283-99d2-4c1a-bb93-953cda244254 tempest-VolumesActionsTest-849658457 None] Creating volume 95f6ef70-f9fc-4405-82a6-992d21f1f915 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:19:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a285e283-99d2-4c1a-bb93-953cda244254 tempest-VolumesActionsTest-849658457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a285e283-99d2-4c1a-bb93-953cda244254 tempest-VolumesActionsTest-849658457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a285e283-99d2-4c1a-bb93-953cda244254 tempest-VolumesActionsTest-849658457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:19:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a285e283-99d2-4c1a-bb93-953cda244254 tempest-VolumesActionsTest-849658457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:19:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a285e283-99d2-4c1a-bb93-953cda244254 tempest-VolumesActionsTest-849658457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a285e283-99d2-4c1a-bb93-953cda244254 tempest-VolumesActionsTest-849658457 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:19:30 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-a285e283-99d2-4c1a-bb93-953cda244254 tempest-VolumesActionsTest-849658457 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:19:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a285e283-99d2-4c1a-bb93-953cda244254 tempest-VolumesActionsTest-849658457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-95f6ef70-f9fc-4405-82a6-992d21f1f915 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-06aab4e0-97cf-4807-b22e-63a9c87aab42 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01dcb1ea-64df-4b08-8f44-295dda64c302) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838', 'volume_size': 2}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-06aab4e0-97cf-4807-b22e-63a9c87aab42 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b58415db-7ad0-4aa9-8122-c958d0a51374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:30 devstack sudo[95599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-95f6ef70-f9fc-4405-82a6-992d21f1f915 1073741824 Sep 03 11:19:30 devstack sudo[95599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [req-dfce50a9-ffce-4e68-bec2-792f5adac7bb req-dfb68588-bba2-4f75-975e-f46eb64f7580 tempest-VolumesSnapshotsTestJSON-1823845794 None] Lock "cinder-quobyte-ff976c93-8caa-4f0b-994b-23f357f7e320" acquired by "_delete_snapshot" :: waited 0.076s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [req-dfce50a9-ffce-4e68-bec2-792f5adac7bb req-dfb68588-bba2-4f75-975e-f46eb64f7580 tempest-VolumesSnapshotsTestJSON-1823845794 None] Deleting offline snapshot ff976c93-8caa-4f0b-994b-23f357f7e320 of volume ac54eea4-643c-43ec-b7a2-1185df470ecc {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:19:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [req-dfce50a9-ffce-4e68-bec2-792f5adac7bb req-dfb68588-bba2-4f75-975e-f46eb64f7580 tempest-VolumesSnapshotsTestJSON-1823845794 None] snapshot_file for this snap is: volume-ac54eea4-643c-43ec-b7a2-1185df470ecc.ff976c93-8caa-4f0b-994b-23f357f7e320 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:19:30 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-06aab4e0-97cf-4807-b22e-63a9c87aab42 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Volume volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838 (aa35cb2a-1ecf-40f9-a9de-73fe63ce0838): created successfully Sep 03 11:19:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-06aab4e0-97cf-4807-b22e-63a9c87aab42 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b58415db-7ad0-4aa9-8122-c958d0a51374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-06aab4e0-97cf-4807-b22e-63a9c87aab42 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Flow 'volume_create_manager' (7d34cf67-a58f-4989-a960-a9a21e9026dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:19:30 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[e109183a-d354-4133-91cc-99f5160d3426]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:19:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-dfce50a9-ffce-4e68-bec2-792f5adac7bb req-dfb68588-bba2-4f75-975e-f46eb64f7580 tempest-VolumesSnapshotsTestJSON-1823845794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc.ff976c93-8caa-4f0b-994b-23f357f7e320 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:30 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-06aab4e0-97cf-4807-b22e-63a9c87aab42 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Created volume successfully. Sep 03 11:19:30 devstack sudo[95602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc.ff976c93-8caa-4f0b-994b-23f357f7e320 Sep 03 11:19:30 devstack sudo[95602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:30 devstack sudo[95599]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a285e283-99d2-4c1a-bb93-953cda244254 tempest-VolumesActionsTest-849658457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-95f6ef70-f9fc-4405-82a6-992d21f1f915 1073741824" returned: 0 in 0.482s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a285e283-99d2-4c1a-bb93-953cda244254 tempest-VolumesActionsTest-849658457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-95f6ef70-f9fc-4405-82a6-992d21f1f915 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:30 devstack sudo[95602]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-dfce50a9-ffce-4e68-bec2-792f5adac7bb req-dfb68588-bba2-4f75-975e-f46eb64f7580 tempest-VolumesSnapshotsTestJSON-1823845794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc.ff976c93-8caa-4f0b-994b-23f357f7e320" returned: 0 in 0.447s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [req-dfce50a9-ffce-4e68-bec2-792f5adac7bb req-dfb68588-bba2-4f75-975e-f46eb64f7580 tempest-VolumesSnapshotsTestJSON-1823845794 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac54eea4-643c-43ec-b7a2-1185df470ecc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:19:30 devstack sudo[95612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-95f6ef70-f9fc-4405-82a6-992d21f1f915 Sep 03 11:19:30 devstack sudo[95612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:30 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb46338f-25ff-4315-b3d5-d4f97ed52a0c]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:19:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-dfce50a9-ffce-4e68-bec2-792f5adac7bb req-dfb68588-bba2-4f75-975e-f46eb64f7580 tempest-VolumesSnapshotsTestJSON-1823845794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:31 devstack sudo[95614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc Sep 03 11:19:31 devstack sudo[95614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:31 devstack sudo[95612]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a285e283-99d2-4c1a-bb93-953cda244254 tempest-VolumesActionsTest-849658457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-95f6ef70-f9fc-4405-82a6-992d21f1f915" returned: 0 in 0.454s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a285e283-99d2-4c1a-bb93-953cda244254 tempest-VolumesActionsTest-849658457 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:19:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a285e283-99d2-4c1a-bb93-953cda244254 tempest-VolumesActionsTest-849658457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a285e283-99d2-4c1a-bb93-953cda244254 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e53f43fc-6036-469f-991d-5ea828b52e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95f6ef70-f9fc-4405-82a6-992d21f1f915', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a285e283-99d2-4c1a-bb93-953cda244254 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (798460d3-fb3d-491e-a197-cef09b0d7279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:31 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-a285e283-99d2-4c1a-bb93-953cda244254 tempest-VolumesActionsTest-849658457 None] Volume volume-95f6ef70-f9fc-4405-82a6-992d21f1f915 (95f6ef70-f9fc-4405-82a6-992d21f1f915): created successfully Sep 03 11:19:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a285e283-99d2-4c1a-bb93-953cda244254 tempest-VolumesActionsTest-849658457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (798460d3-fb3d-491e-a197-cef09b0d7279) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a285e283-99d2-4c1a-bb93-953cda244254 tempest-VolumesActionsTest-849658457 None] Flow 'volume_create_manager' (cd737da8-8726-4fc5-a158-47646197b454) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:19:31 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-a285e283-99d2-4c1a-bb93-953cda244254 tempest-VolumesActionsTest-849658457 None] Created volume successfully. Sep 03 11:19:31 devstack sudo[95614]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-dfce50a9-ffce-4e68-bec2-792f5adac7bb req-dfb68588-bba2-4f75-975e-f46eb64f7580 tempest-VolumesSnapshotsTestJSON-1823845794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc" returned: 0 in 0.767s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-dfce50a9-ffce-4e68-bec2-792f5adac7bb req-dfb68588-bba2-4f75-975e-f46eb64f7580 tempest-VolumesSnapshotsTestJSON-1823845794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc.ff976c93-8caa-4f0b-994b-23f357f7e320 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:31 devstack sudo[95665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc.ff976c93-8caa-4f0b-994b-23f357f7e320 Sep 03 11:19:31 devstack sudo[95665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5c70a5dd-8a1f-4c06-b2a0-6687e7f71ecf tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5c70a5dd-8a1f-4c06-b2a0-6687e7f71ecf tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-5c70a5dd-8a1f-4c06-b2a0-6687e7f71ecf tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Creating offline snapshot f2efe80d-011d-4722-b336-dec230bff8f2 of volume aa35cb2a-1ecf-40f9-a9de-73fe63ce0838 {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:19:31 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce7a053-3518-44f5-8cbd-669ca37652ae]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:19:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5c70a5dd-8a1f-4c06-b2a0-6687e7f71ecf tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:32 devstack sudo[95679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838 Sep 03 11:19:32 devstack sudo[95679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:32 devstack sudo[95665]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-dfce50a9-ffce-4e68-bec2-792f5adac7bb req-dfb68588-bba2-4f75-975e-f46eb64f7580 tempest-VolumesSnapshotsTestJSON-1823845794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc.ff976c93-8caa-4f0b-994b-23f357f7e320" returned: 0 in 0.837s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-dfce50a9-ffce-4e68-bec2-792f5adac7bb req-dfb68588-bba2-4f75-975e-f46eb64f7580 tempest-VolumesSnapshotsTestJSON-1823845794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc.ff976c93-8caa-4f0b-994b-23f357f7e320 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:32 devstack sudo[95697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc.ff976c93-8caa-4f0b-994b-23f357f7e320 Sep 03 11:19:32 devstack sudo[95697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:32 devstack sudo[95679]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5c70a5dd-8a1f-4c06-b2a0-6687e7f71ecf tempest-VolumesSnapshotNegativeTestJSON-407904325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838" returned: 0 in 0.723s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5c70a5dd-8a1f-4c06-b2a0-6687e7f71ecf tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838.f2efe80d-011d-4722-b336-dec230bff8f2 2G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:32 devstack sudo[95699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838.f2efe80d-011d-4722-b336-dec230bff8f2 2G Sep 03 11:19:32 devstack sudo[95699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:32 devstack sudo[95697]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-dfce50a9-ffce-4e68-bec2-792f5adac7bb req-dfb68588-bba2-4f75-975e-f46eb64f7580 tempest-VolumesSnapshotsTestJSON-1823845794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc.ff976c93-8caa-4f0b-994b-23f357f7e320" returned: 0 in 0.439s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:33 devstack cinder-volume[87038]: DEBUG cinder.coordination [req-dfce50a9-ffce-4e68-bec2-792f5adac7bb req-dfb68588-bba2-4f75-975e-f46eb64f7580 tempest-VolumesSnapshotsTestJSON-1823845794 None] Lock "cinder-quobyte-ff976c93-8caa-4f0b-994b-23f357f7e320" released by "_delete_snapshot" :: held 2.680s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:33 devstack cinder-volume[87038]: DEBUG cinder.coordination [req-dfce50a9-ffce-4e68-bec2-792f5adac7bb req-dfb68588-bba2-4f75-975e-f46eb64f7580 tempest-VolumesSnapshotsTestJSON-1823845794 None] Lock "cinder-quobyte-ac54eea4-643c-43ec-b7a2-1185df470ecc" released by "delete_snapshot" :: held 2.764s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:33 devstack cinder-volume[87038]: DEBUG cinder.quota [req-dfce50a9-ffce-4e68-bec2-792f5adac7bb req-dfb68588-bba2-4f75-975e-f46eb64f7580 tempest-VolumesSnapshotsTestJSON-1823845794 None] Created reservations ['541cd444-11fb-4a9d-b7e8-29be95eb9fa6', '3bc3c6ea-c712-4cc6-aae2-fd9f8cd3d27a', '13deb868-4086-4e4f-969a-6f3aa53ae96a', '9b09fc2f-7a20-4ab1-98f0-d568aec1041c'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:19:33 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b4c8be1b-8364-422f-9e5f-faa572193513 tempest-VolumesActionsTest-849658457 None] Acquiring lock "cinder-95f6ef70-f9fc-4405-82a6-992d21f1f915-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:33 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b4c8be1b-8364-422f-9e5f-faa572193513 tempest-VolumesActionsTest-849658457 None] Lock "cinder-95f6ef70-f9fc-4405-82a6-992d21f1f915-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:33 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b4c8be1b-8364-422f-9e5f-faa572193513 tempest-VolumesActionsTest-849658457 None] Acquiring lock "cinder-quobyte-95f6ef70-f9fc-4405-82a6-992d21f1f915" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:33 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-dfce50a9-ffce-4e68-bec2-792f5adac7bb req-dfb68588-bba2-4f75-975e-f46eb64f7580 tempest-VolumesSnapshotsTestJSON-1823845794 None] Delete snapshot completed successfully. Sep 03 11:19:33 devstack cinder-volume[87038]: DEBUG cinder.coordination [req-dfce50a9-ffce-4e68-bec2-792f5adac7bb req-dfb68588-bba2-4f75-975e-f46eb64f7580 tempest-VolumesSnapshotsTestJSON-1823845794 None] Lock "cinder-ff976c93-8caa-4f0b-994b-23f357f7e320-delete_snapshot" released by "delete_snapshot" :: held 3.107s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:33 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b4c8be1b-8364-422f-9e5f-faa572193513 tempest-VolumesActionsTest-849658457 None] Lock "cinder-quobyte-95f6ef70-f9fc-4405-82a6-992d21f1f915" acquired by "delete_volume" :: waited 0.033s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:33 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[964a86b9-5984-416a-9320-06885c8ad128]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:19:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b4c8be1b-8364-422f-9e5f-faa572193513 tempest-VolumesActionsTest-849658457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-95f6ef70-f9fc-4405-82a6-992d21f1f915 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:33 devstack sudo[95699]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5c70a5dd-8a1f-4c06-b2a0-6687e7f71ecf tempest-VolumesSnapshotNegativeTestJSON-407904325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838.f2efe80d-011d-4722-b336-dec230bff8f2 2G" returned: 0 in 0.847s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5c70a5dd-8a1f-4c06-b2a0-6687e7f71ecf tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838.f2efe80d-011d-4722-b336-dec230bff8f2 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:33 devstack sudo[95709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838.f2efe80d-011d-4722-b336-dec230bff8f2 Sep 03 11:19:33 devstack sudo[95709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:33 devstack sudo[95708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-95f6ef70-f9fc-4405-82a6-992d21f1f915 Sep 03 11:19:33 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:33 devstack cinder-volume[87038]: DEBUG cinder.coordination [req-b76fdb52-6055-405a-bcf5-8b4589e72129 req-4d7d4023-4ee9-42bf-8d7e-23f99a05189a tempest-VolumesSnapshotsTestJSON-1823845794 None] Acquiring lock "cinder-ac54eea4-643c-43ec-b7a2-1185df470ecc-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:33 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:33 devstack cinder-volume[87038]: DEBUG cinder.coordination [req-b76fdb52-6055-405a-bcf5-8b4589e72129 req-4d7d4023-4ee9-42bf-8d7e-23f99a05189a tempest-VolumesSnapshotsTestJSON-1823845794 None] Lock "cinder-ac54eea4-643c-43ec-b7a2-1185df470ecc-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b4c8be1b-8364-422f-9e5f-faa572193513 tempest-VolumesActionsTest-849658457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-95f6ef70-f9fc-4405-82a6-992d21f1f915" returned: 0 in 0.482s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b4c8be1b-8364-422f-9e5f-faa572193513 tempest-VolumesActionsTest-849658457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-95f6ef70-f9fc-4405-82a6-992d21f1f915 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:33 devstack sudo[95709]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5c70a5dd-8a1f-4c06-b2a0-6687e7f71ecf tempest-VolumesSnapshotNegativeTestJSON-407904325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838.f2efe80d-011d-4722-b336-dec230bff8f2" returned: 0 in 0.449s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:33 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-5c70a5dd-8a1f-4c06-b2a0-6687e7f71ecf tempest-VolumesSnapshotNegativeTestJSON-407904325 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838.f2efe80d-011d-4722-b336-dec230bff8f2 is being set with open permissions: ugo+rw Sep 03 11:19:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5c70a5dd-8a1f-4c06-b2a0-6687e7f71ecf tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838.f2efe80d-011d-4722-b336-dec230bff8f2 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:33 devstack sudo[95720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-95f6ef70-f9fc-4405-82a6-992d21f1f915 Sep 03 11:19:33 devstack sudo[95720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:33 devstack sudo[95721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838.f2efe80d-011d-4722-b336-dec230bff8f2 Sep 03 11:19:33 devstack sudo[95721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:34 devstack cinder-volume[87038]: DEBUG cinder.coordination [req-b76fdb52-6055-405a-bcf5-8b4589e72129 req-4d7d4023-4ee9-42bf-8d7e-23f99a05189a tempest-VolumesSnapshotsTestJSON-1823845794 None] Acquiring lock "cinder-quobyte-ac54eea4-643c-43ec-b7a2-1185df470ecc" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:34 devstack cinder-volume[87038]: DEBUG cinder.coordination [req-b76fdb52-6055-405a-bcf5-8b4589e72129 req-4d7d4023-4ee9-42bf-8d7e-23f99a05189a tempest-VolumesSnapshotsTestJSON-1823845794 None] Lock "cinder-quobyte-ac54eea4-643c-43ec-b7a2-1185df470ecc" acquired by "delete_volume" :: waited 0.027s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:34 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[80341198-553e-4a3d-9358-f3b0fb0fc9e9]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:19:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-b76fdb52-6055-405a-bcf5-8b4589e72129 req-4d7d4023-4ee9-42bf-8d7e-23f99a05189a tempest-VolumesSnapshotsTestJSON-1823845794 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:34 devstack sudo[95724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc Sep 03 11:19:34 devstack sudo[95724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:34 devstack sudo[95721]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5c70a5dd-8a1f-4c06-b2a0-6687e7f71ecf tempest-VolumesSnapshotNegativeTestJSON-407904325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838.f2efe80d-011d-4722-b336-dec230bff8f2" returned: 0 in 0.461s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:34 devstack sudo[95720]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b4c8be1b-8364-422f-9e5f-faa572193513 tempest-VolumesActionsTest-849658457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-95f6ef70-f9fc-4405-82a6-992d21f1f915" returned: 0 in 0.509s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:34 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b4c8be1b-8364-422f-9e5f-faa572193513 tempest-VolumesActionsTest-849658457 None] Lock "cinder-quobyte-95f6ef70-f9fc-4405-82a6-992d21f1f915" released by "delete_volume" :: held 1.065s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5c70a5dd-8a1f-4c06-b2a0-6687e7f71ecf tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:34 devstack sudo[95728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838.info Sep 03 11:19:34 devstack sudo[95728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:34 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-b4c8be1b-8364-422f-9e5f-faa572193513 tempest-VolumesActionsTest-849658457 None] Created reservations ['edcdb924-a769-4ab9-8fe1-79e12083124a', '6e9448a1-75a2-4237-b7d4-b85354961526', '79927a74-fe50-413a-9078-d99ac6a32154', 'df0dd452-a876-4b90-915d-5a26f28233bc'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:19:34 devstack sudo[95724]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-b76fdb52-6055-405a-bcf5-8b4589e72129 req-4d7d4023-4ee9-42bf-8d7e-23f99a05189a tempest-VolumesSnapshotsTestJSON-1823845794 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc" returned: 0 in 0.603s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-b76fdb52-6055-405a-bcf5-8b4589e72129 req-4d7d4023-4ee9-42bf-8d7e-23f99a05189a tempest-VolumesSnapshotsTestJSON-1823845794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b4c8be1b-8364-422f-9e5f-faa572193513 tempest-VolumesActionsTest-849658457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b4c8be1b-8364-422f-9e5f-faa572193513 tempest-VolumesActionsTest-849658457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:34 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-b4c8be1b-8364-422f-9e5f-faa572193513 tempest-VolumesActionsTest-849658457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:19:34 devstack sudo[95733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc Sep 03 11:19:34 devstack sudo[95733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:34 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-b4c8be1b-8364-422f-9e5f-faa572193513 tempest-VolumesActionsTest-849658457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:19:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b4c8be1b-8364-422f-9e5f-faa572193513 tempest-VolumesActionsTest-849658457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b4c8be1b-8364-422f-9e5f-faa572193513 tempest-VolumesActionsTest-849658457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:34 devstack sudo[95738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:19:34 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:35 devstack sudo[95728]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5c70a5dd-8a1f-4c06-b2a0-6687e7f71ecf tempest-VolumesSnapshotNegativeTestJSON-407904325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838.info" returned: 0 in 0.502s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:35 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-5c70a5dd-8a1f-4c06-b2a0-6687e7f71ecf tempest-VolumesSnapshotNegativeTestJSON-407904325 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838.info is being set with open permissions: ugo+rw Sep 03 11:19:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5c70a5dd-8a1f-4c06-b2a0-6687e7f71ecf tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:35 devstack sudo[95733]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-b76fdb52-6055-405a-bcf5-8b4589e72129 req-4d7d4023-4ee9-42bf-8d7e-23f99a05189a tempest-VolumesSnapshotsTestJSON-1823845794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac54eea4-643c-43ec-b7a2-1185df470ecc" returned: 0 in 0.367s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:35 devstack sudo[95745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838.info Sep 03 11:19:35 devstack sudo[95745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [req-b76fdb52-6055-405a-bcf5-8b4589e72129 req-4d7d4023-4ee9-42bf-8d7e-23f99a05189a tempest-VolumesSnapshotsTestJSON-1823845794 None] Lock "cinder-quobyte-ac54eea4-643c-43ec-b7a2-1185df470ecc" released by "delete_volume" :: held 1.103s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:35 devstack cinder-volume[87038]: DEBUG cinder.quota [req-b76fdb52-6055-405a-bcf5-8b4589e72129 req-4d7d4023-4ee9-42bf-8d7e-23f99a05189a tempest-VolumesSnapshotsTestJSON-1823845794 None] Created reservations ['757ccdd7-18e9-48eb-9d78-43fe608f97a2', 'd48235f0-40fe-4c2b-9398-814e1a4fde5a', '30386f61-8416-45e3-934f-77f191c6605d', '11d9e149-be13-48c6-adee-827bbed85a24'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:19:35 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b4c8be1b-8364-422f-9e5f-faa572193513 tempest-VolumesActionsTest-849658457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.494s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:35 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-b4c8be1b-8364-422f-9e5f-faa572193513 tempest-VolumesActionsTest-849658457 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:19:35 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-b4c8be1b-8364-422f-9e5f-faa572193513 tempest-VolumesActionsTest-849658457 None] Deleted volume successfully. Sep 03 11:19:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b4c8be1b-8364-422f-9e5f-faa572193513 tempest-VolumesActionsTest-849658457 None] Lock "cinder-95f6ef70-f9fc-4405-82a6-992d21f1f915-delete_volume" released by "delete_volume" :: held 2.111s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:35 devstack sudo[95745]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5c70a5dd-8a1f-4c06-b2a0-6687e7f71ecf tempest-VolumesSnapshotNegativeTestJSON-407904325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838.info" returned: 0 in 0.363s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5c70a5dd-8a1f-4c06-b2a0-6687e7f71ecf tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.581s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-b76fdb52-6055-405a-bcf5-8b4589e72129 req-4d7d4023-4ee9-42bf-8d7e-23f99a05189a tempest-VolumesSnapshotsTestJSON-1823845794 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-b76fdb52-6055-405a-bcf5-8b4589e72129 req-4d7d4023-4ee9-42bf-8d7e-23f99a05189a tempest-VolumesSnapshotsTestJSON-1823845794 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:35 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [req-b76fdb52-6055-405a-bcf5-8b4589e72129 req-4d7d4023-4ee9-42bf-8d7e-23f99a05189a tempest-VolumesSnapshotsTestJSON-1823845794 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:19:35 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [req-b76fdb52-6055-405a-bcf5-8b4589e72129 req-4d7d4023-4ee9-42bf-8d7e-23f99a05189a tempest-VolumesSnapshotsTestJSON-1823845794 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:19:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-b76fdb52-6055-405a-bcf5-8b4589e72129 req-4d7d4023-4ee9-42bf-8d7e-23f99a05189a tempest-VolumesSnapshotsTestJSON-1823845794 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-b76fdb52-6055-405a-bcf5-8b4589e72129 req-4d7d4023-4ee9-42bf-8d7e-23f99a05189a tempest-VolumesSnapshotsTestJSON-1823845794 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:35 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-5c70a5dd-8a1f-4c06-b2a0-6687e7f71ecf tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Create snapshot completed successfully Sep 03 11:19:35 devstack sudo[95749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:19:35 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:35 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-b76fdb52-6055-405a-bcf5-8b4589e72129 req-4d7d4023-4ee9-42bf-8d7e-23f99a05189a tempest-VolumesSnapshotsTestJSON-1823845794 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.300s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:35 devstack cinder-volume[87038]: DEBUG cinder.manager [req-b76fdb52-6055-405a-bcf5-8b4589e72129 req-4d7d4023-4ee9-42bf-8d7e-23f99a05189a tempest-VolumesSnapshotsTestJSON-1823845794 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:19:35 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-b76fdb52-6055-405a-bcf5-8b4589e72129 req-4d7d4023-4ee9-42bf-8d7e-23f99a05189a tempest-VolumesSnapshotsTestJSON-1823845794 None] Deleted volume successfully. Sep 03 11:19:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [req-b76fdb52-6055-405a-bcf5-8b4589e72129 req-4d7d4023-4ee9-42bf-8d7e-23f99a05189a tempest-VolumesSnapshotsTestJSON-1823845794 None] Lock "cinder-ac54eea4-643c-43ec-b7a2-1185df470ecc-delete_volume" released by "delete_volume" :: held 1.918s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-44965ce9-b9de-43bb-b521-3a13ce5df072 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Acquiring lock "cinder-f2efe80d-011d-4722-b336-dec230bff8f2-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-44965ce9-b9de-43bb-b521-3a13ce5df072 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Lock "cinder-f2efe80d-011d-4722-b336-dec230bff8f2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-44965ce9-b9de-43bb-b521-3a13ce5df072 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Acquiring lock "cinder-quobyte-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-44965ce9-b9de-43bb-b521-3a13ce5df072 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Lock "cinder-quobyte-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-44965ce9-b9de-43bb-b521-3a13ce5df072 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Acquiring lock "cinder-quobyte-f2efe80d-011d-4722-b336-dec230bff8f2" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-44965ce9-b9de-43bb-b521-3a13ce5df072 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Lock "cinder-quobyte-f2efe80d-011d-4722-b336-dec230bff8f2" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:36 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-44965ce9-b9de-43bb-b521-3a13ce5df072 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Deleting offline snapshot f2efe80d-011d-4722-b336-dec230bff8f2 of volume aa35cb2a-1ecf-40f9-a9de-73fe63ce0838 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:19:36 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-44965ce9-b9de-43bb-b521-3a13ce5df072 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] snapshot_file for this snap is: volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838.f2efe80d-011d-4722-b336-dec230bff8f2 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:19:36 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d54f91-e46e-4e62-b028-8cf37cdab4b9]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:19:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-44965ce9-b9de-43bb-b521-3a13ce5df072 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838.f2efe80d-011d-4722-b336-dec230bff8f2 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:36 devstack sudo[95754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838.f2efe80d-011d-4722-b336-dec230bff8f2 Sep 03 11:19:36 devstack sudo[95754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:36 devstack sudo[95754]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-44965ce9-b9de-43bb-b521-3a13ce5df072 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838.f2efe80d-011d-4722-b336-dec230bff8f2" returned: 0 in 0.496s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:36 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-44965ce9-b9de-43bb-b521-3a13ce5df072 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:19:37 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[7893c00e-3c6d-470c-890d-c0aa365e853e]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:19:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-44965ce9-b9de-43bb-b521-3a13ce5df072 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:37 devstack sudo[95759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838 Sep 03 11:19:37 devstack sudo[95759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:37 devstack sudo[95759]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-44965ce9-b9de-43bb-b521-3a13ce5df072 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838" returned: 0 in 0.670s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-44965ce9-b9de-43bb-b521-3a13ce5df072 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838.f2efe80d-011d-4722-b336-dec230bff8f2 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:37 devstack sudo[95765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838.f2efe80d-011d-4722-b336-dec230bff8f2 Sep 03 11:19:37 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:38 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-44965ce9-b9de-43bb-b521-3a13ce5df072 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838.f2efe80d-011d-4722-b336-dec230bff8f2" returned: 0 in 0.576s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-44965ce9-b9de-43bb-b521-3a13ce5df072 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838.f2efe80d-011d-4722-b336-dec230bff8f2 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:38 devstack sudo[95773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838.f2efe80d-011d-4722-b336-dec230bff8f2 Sep 03 11:19:38 devstack sudo[95773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:38 devstack sudo[95773]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-44965ce9-b9de-43bb-b521-3a13ce5df072 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838.f2efe80d-011d-4722-b336-dec230bff8f2" returned: 0 in 0.394s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:38 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-44965ce9-b9de-43bb-b521-3a13ce5df072 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Lock "cinder-quobyte-f2efe80d-011d-4722-b336-dec230bff8f2" released by "_delete_snapshot" :: held 2.378s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:38 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-44965ce9-b9de-43bb-b521-3a13ce5df072 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Lock "cinder-quobyte-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838" released by "delete_snapshot" :: held 2.428s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:38 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-44965ce9-b9de-43bb-b521-3a13ce5df072 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Created reservations ['661adaeb-7770-4c30-b44a-18f907440544', 'a6c2dcf6-e0dd-4256-aa38-8782cf633fd8', '568f8bec-011e-4eba-823d-5cb90b01489f', 'cf30e3c0-3955-425b-a2b1-4b43fde9f40b'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:19:38 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-44965ce9-b9de-43bb-b521-3a13ce5df072 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Delete snapshot completed successfully. Sep 03 11:19:38 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-44965ce9-b9de-43bb-b521-3a13ce5df072 tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Lock "cinder-f2efe80d-011d-4722-b336-dec230bff8f2-delete_snapshot" released by "delete_snapshot" :: held 2.633s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:39 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4e261b6e-6ae3-4005-a9f7-2137cfc71e2e tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Acquiring lock "cinder-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:39 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4e261b6e-6ae3-4005-a9f7-2137cfc71e2e tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Lock "cinder-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:39 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4e261b6e-6ae3-4005-a9f7-2137cfc71e2e tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Acquiring lock "cinder-quobyte-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:39 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4e261b6e-6ae3-4005-a9f7-2137cfc71e2e tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Lock "cinder-quobyte-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838" acquired by "delete_volume" :: waited 0.021s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:39 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc633166-7570-4f66-942c-6d363aba6a13]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:19:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4e261b6e-6ae3-4005-a9f7-2137cfc71e2e tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:39 devstack sudo[95776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838 Sep 03 11:19:39 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:40 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4e261b6e-6ae3-4005-a9f7-2137cfc71e2e tempest-VolumesSnapshotNegativeTestJSON-407904325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838" returned: 0 in 0.419s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4e261b6e-6ae3-4005-a9f7-2137cfc71e2e tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:40 devstack sudo[95781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838 Sep 03 11:19:40 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:40 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4e261b6e-6ae3-4005-a9f7-2137cfc71e2e tempest-VolumesSnapshotNegativeTestJSON-407904325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838" returned: 0 in 0.478s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:40 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4e261b6e-6ae3-4005-a9f7-2137cfc71e2e tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Lock "cinder-quobyte-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838" released by "delete_volume" :: held 0.964s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:40 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-4e261b6e-6ae3-4005-a9f7-2137cfc71e2e tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Created reservations ['63eb27d1-c1d4-48e6-bf47-10ab24195228', 'fce5ee4c-eb1f-4037-bc20-2a82282c0487', '405cc46e-964b-4798-af3a-75bb0fca7909', '9e144d75-112f-4940-92a7-e207b59ffa73'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:19:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4e261b6e-6ae3-4005-a9f7-2137cfc71e2e tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4e261b6e-6ae3-4005-a9f7-2137cfc71e2e tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:40 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4e261b6e-6ae3-4005-a9f7-2137cfc71e2e tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:19:40 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4e261b6e-6ae3-4005-a9f7-2137cfc71e2e tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:19:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4e261b6e-6ae3-4005-a9f7-2137cfc71e2e tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4e261b6e-6ae3-4005-a9f7-2137cfc71e2e tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:40 devstack sudo[95784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:19:40 devstack sudo[95784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:41 devstack sudo[95784]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4e261b6e-6ae3-4005-a9f7-2137cfc71e2e tempest-VolumesSnapshotNegativeTestJSON-407904325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.290s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:41 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-4e261b6e-6ae3-4005-a9f7-2137cfc71e2e tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:19:41 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-4e261b6e-6ae3-4005-a9f7-2137cfc71e2e tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Deleted volume successfully. Sep 03 11:19:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4e261b6e-6ae3-4005-a9f7-2137cfc71e2e tempest-VolumesSnapshotNegativeTestJSON-407904325 None] Lock "cinder-aa35cb2a-1ecf-40f9-a9de-73fe63ce0838-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-950a9376-5003-43c5-8212-0117112b5b72 tempest-BackendsCapabilitiesAdminTestsJSON-1810319157 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8491134643555, 'free_capacity_gb': 1773.8491134643555, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87038) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 03 11:19:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6f76ebb8-7cea-4b8a-8e83-f5e5021b75ee tempest-BackendsCapabilitiesAdminTestsJSON-1810319157 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8491134643555, 'free_capacity_gb': 1773.8491134643555, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87038) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 03 11:19:48 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-20f79818-27f0-4972-9be2-0a1055d763a4 tempest-GroupSnapshotsV319Test-1660463634 None] Group tempest-GroupSnapshotsV319Test-Group-2094004289: creating Sep 03 11:19:48 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-20f79818-27f0-4972-9be2-0a1055d763a4 tempest-GroupSnapshotsV319Test-1660463634 None] Group tempest-GroupSnapshotsV319Test-Group-2094004289: created successfully Sep 03 11:19:48 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-20f79818-27f0-4972-9be2-0a1055d763a4 tempest-GroupSnapshotsV319Test-1660463634 None] Create group completed successfully. Sep 03 11:19:50 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-6205c94e-c4fe-4fe9-949f-dcefdfd59777 tempest-GroupSnapshotsV319Test-1660463634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:19:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6205c94e-c4fe-4fe9-949f-dcefdfd59777 tempest-GroupSnapshotsV319Test-1660463634 None] Flow 'volume_create_manager' (8b57d6ab-aa3c-4354-82e3-22269c5dc483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:19:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6205c94e-c4fe-4fe9-949f-dcefdfd59777 tempest-GroupSnapshotsV319Test-1660463634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86ad92a5-f649-4004-89ba-1e0ccd6bbfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6205c94e-c4fe-4fe9-949f-dcefdfd59777 tempest-GroupSnapshotsV319Test-1660463634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86ad92a5-f649-4004-89ba-1e0ccd6bbfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1340181217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d2b5dffa-9e55-4e1f-9993-c3ea1b6daad2,host='devstack@QuobyteHD#QuobyteHD',id=897815eb-cdbf-4474-a695-06eb98c5aff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6791f4e8ce1471b8508812bd64c6ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:19:50Z,use_quota=True,user_id='5d3cac0c627d4c2a996a45cdb4b0acc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bafb7f1a-4beb-4b21-b880-634417b5cfae),volume_type_id=bafb7f1a-4beb-4b21-b880-634417b5cfae)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6205c94e-c4fe-4fe9-949f-dcefdfd59777 tempest-GroupSnapshotsV319Test-1660463634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c930e469-da70-43e4-823a-74d4fae6fa72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6205c94e-c4fe-4fe9-949f-dcefdfd59777 tempest-GroupSnapshotsV319Test-1660463634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c930e469-da70-43e4-823a-74d4fae6fa72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6205c94e-c4fe-4fe9-949f-dcefdfd59777 tempest-GroupSnapshotsV319Test-1660463634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c05a9d64-4379-431b-89d0-171278aedb90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6205c94e-c4fe-4fe9-949f-dcefdfd59777 tempest-GroupSnapshotsV319Test-1660463634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c05a9d64-4379-431b-89d0-171278aedb90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '897815eb-cdbf-4474-a695-06eb98c5aff0', 'volume_name': 'volume-897815eb-cdbf-4474-a695-06eb98c5aff0', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6205c94e-c4fe-4fe9-949f-dcefdfd59777 tempest-GroupSnapshotsV319Test-1660463634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba50a4f-1441-4afb-9d42-29d438957a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6205c94e-c4fe-4fe9-949f-dcefdfd59777 tempest-GroupSnapshotsV319Test-1660463634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cba50a4f-1441-4afb-9d42-29d438957a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6205c94e-c4fe-4fe9-949f-dcefdfd59777 tempest-GroupSnapshotsV319Test-1660463634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9626a45-66a0-495e-9acb-5a53a7e09b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:50 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-6205c94e-c4fe-4fe9-949f-dcefdfd59777 tempest-GroupSnapshotsV319Test-1660463634 None] Volume 897815eb-cdbf-4474-a695-06eb98c5aff0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-897815eb-cdbf-4474-a695-06eb98c5aff0', 'volume_size': 1} Sep 03 11:19:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6205c94e-c4fe-4fe9-949f-dcefdfd59777 tempest-GroupSnapshotsV319Test-1660463634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6205c94e-c4fe-4fe9-949f-dcefdfd59777 tempest-GroupSnapshotsV319Test-1660463634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:50 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6205c94e-c4fe-4fe9-949f-dcefdfd59777 tempest-GroupSnapshotsV319Test-1660463634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d2b5dffa-9e55-4e1f-9993-c3ea1b6daad2,created_at=2026-09-03T09:19:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1340181217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d2b5dffa-9e55-4e1f-9993-c3ea1b6daad2,host='devstack@QuobyteHD#QuobyteHD',id=897815eb-cdbf-4474-a695-06eb98c5aff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e6791f4e8ce1471b8508812bd64c6ef2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:19:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:19:50Z,use_quota=True,user_id='5d3cac0c627d4c2a996a45cdb4b0acc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bafb7f1a-4beb-4b21-b880-634417b5cfae),volume_type_id=bafb7f1a-4beb-4b21-b880-634417b5cfae)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:19:50 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-6205c94e-c4fe-4fe9-949f-dcefdfd59777 tempest-GroupSnapshotsV319Test-1660463634 None] Creating volume 897815eb-cdbf-4474-a695-06eb98c5aff0 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:19:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6205c94e-c4fe-4fe9-949f-dcefdfd59777 tempest-GroupSnapshotsV319Test-1660463634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6205c94e-c4fe-4fe9-949f-dcefdfd59777 tempest-GroupSnapshotsV319Test-1660463634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:50 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6205c94e-c4fe-4fe9-949f-dcefdfd59777 tempest-GroupSnapshotsV319Test-1660463634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:19:50 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6205c94e-c4fe-4fe9-949f-dcefdfd59777 tempest-GroupSnapshotsV319Test-1660463634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:19:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6205c94e-c4fe-4fe9-949f-dcefdfd59777 tempest-GroupSnapshotsV319Test-1660463634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:50 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6205c94e-c4fe-4fe9-949f-dcefdfd59777 tempest-GroupSnapshotsV319Test-1660463634 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:19:50 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-6205c94e-c4fe-4fe9-949f-dcefdfd59777 tempest-GroupSnapshotsV319Test-1660463634 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:19:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6205c94e-c4fe-4fe9-949f-dcefdfd59777 tempest-GroupSnapshotsV319Test-1660463634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:50 devstack sudo[95818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0 1073741824 Sep 03 11:19:50 devstack sudo[95818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:51 devstack sudo[95818]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6205c94e-c4fe-4fe9-949f-dcefdfd59777 tempest-GroupSnapshotsV319Test-1660463634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0 1073741824" returned: 0 in 0.458s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6205c94e-c4fe-4fe9-949f-dcefdfd59777 tempest-GroupSnapshotsV319Test-1660463634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:51 devstack sudo[95824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0 Sep 03 11:19:51 devstack sudo[95824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:51 devstack sudo[95824]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6205c94e-c4fe-4fe9-949f-dcefdfd59777 tempest-GroupSnapshotsV319Test-1660463634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0" returned: 0 in 0.328s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:51 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6205c94e-c4fe-4fe9-949f-dcefdfd59777 tempest-GroupSnapshotsV319Test-1660463634 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:19:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6205c94e-c4fe-4fe9-949f-dcefdfd59777 tempest-GroupSnapshotsV319Test-1660463634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6205c94e-c4fe-4fe9-949f-dcefdfd59777 tempest-GroupSnapshotsV319Test-1660463634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9626a45-66a0-495e-9acb-5a53a7e09b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-897815eb-cdbf-4474-a695-06eb98c5aff0', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6205c94e-c4fe-4fe9-949f-dcefdfd59777 tempest-GroupSnapshotsV319Test-1660463634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30731e71-3e05-41dd-b5de-7dbc8cfcd257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:51 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-6205c94e-c4fe-4fe9-949f-dcefdfd59777 tempest-GroupSnapshotsV319Test-1660463634 None] Volume volume-897815eb-cdbf-4474-a695-06eb98c5aff0 (897815eb-cdbf-4474-a695-06eb98c5aff0): created successfully Sep 03 11:19:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6205c94e-c4fe-4fe9-949f-dcefdfd59777 tempest-GroupSnapshotsV319Test-1660463634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30731e71-3e05-41dd-b5de-7dbc8cfcd257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6205c94e-c4fe-4fe9-949f-dcefdfd59777 tempest-GroupSnapshotsV319Test-1660463634 None] Flow 'volume_create_manager' (8b57d6ab-aa3c-4354-82e3-22269c5dc483) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:19:51 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-6205c94e-c4fe-4fe9-949f-dcefdfd59777 tempest-GroupSnapshotsV319Test-1660463634 None] Created volume successfully. Sep 03 11:19:52 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-a30aed6b-d43a-4ace-b59b-181ac29d8b4c tempest-GroupSnapshotsV319Test-1660463634 None] GroupSnapshot 50effd10-b0c7-473e-ac34-bfbe634d1c20: creating. Sep 03 11:19:52 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a30aed6b-d43a-4ace-b59b-181ac29d8b4c tempest-GroupSnapshotsV319Test-1660463634 None] Group snapshot 50effd10-b0c7-473e-ac34-bfbe634d1c20: creating. {{(pid=87038) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 03 11:19:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a30aed6b-d43a-4ace-b59b-181ac29d8b4c tempest-GroupSnapshotsV319Test-1660463634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a30aed6b-d43a-4ace-b59b-181ac29d8b4c tempest-GroupSnapshotsV319Test-1660463634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:52 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-a30aed6b-d43a-4ace-b59b-181ac29d8b4c tempest-GroupSnapshotsV319Test-1660463634 None] Creating offline snapshot 4a8d1910-accf-4c76-ad6b-44cb44fc68ef of volume 897815eb-cdbf-4474-a695-06eb98c5aff0 {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:19:52 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfcf5fd8-3069-4525-95e3-4c59d41a895c]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:19:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a30aed6b-d43a-4ace-b59b-181ac29d8b4c tempest-GroupSnapshotsV319Test-1660463634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:52 devstack sudo[95827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0 Sep 03 11:19:52 devstack sudo[95827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:52 devstack sudo[95827]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a30aed6b-d43a-4ace-b59b-181ac29d8b4c tempest-GroupSnapshotsV319Test-1660463634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0" returned: 0 in 0.385s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a30aed6b-d43a-4ace-b59b-181ac29d8b4c tempest-GroupSnapshotsV319Test-1660463634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0.4a8d1910-accf-4c76-ad6b-44cb44fc68ef 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:52 devstack sudo[95832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0.4a8d1910-accf-4c76-ad6b-44cb44fc68ef 1G Sep 03 11:19:52 devstack sudo[95832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:53 devstack sudo[95832]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a30aed6b-d43a-4ace-b59b-181ac29d8b4c tempest-GroupSnapshotsV319Test-1660463634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0.4a8d1910-accf-4c76-ad6b-44cb44fc68ef 1G" returned: 0 in 0.622s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a30aed6b-d43a-4ace-b59b-181ac29d8b4c tempest-GroupSnapshotsV319Test-1660463634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-897815eb-cdbf-4474-a695-06eb98c5aff0 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0.4a8d1910-accf-4c76-ad6b-44cb44fc68ef {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:53 devstack sudo[95837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-897815eb-cdbf-4474-a695-06eb98c5aff0 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0.4a8d1910-accf-4c76-ad6b-44cb44fc68ef Sep 03 11:19:53 devstack sudo[95837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:53 devstack sudo[95837]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a30aed6b-d43a-4ace-b59b-181ac29d8b4c tempest-GroupSnapshotsV319Test-1660463634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-897815eb-cdbf-4474-a695-06eb98c5aff0 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0.4a8d1910-accf-4c76-ad6b-44cb44fc68ef" returned: 0 in 0.544s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:53 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-a30aed6b-d43a-4ace-b59b-181ac29d8b4c tempest-GroupSnapshotsV319Test-1660463634 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0.4a8d1910-accf-4c76-ad6b-44cb44fc68ef is being set with open permissions: ugo+rw: NotImplementedError Sep 03 11:19:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a30aed6b-d43a-4ace-b59b-181ac29d8b4c tempest-GroupSnapshotsV319Test-1660463634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0.4a8d1910-accf-4c76-ad6b-44cb44fc68ef {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:53 devstack sudo[95842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0.4a8d1910-accf-4c76-ad6b-44cb44fc68ef Sep 03 11:19:53 devstack sudo[95842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:54 devstack sudo[95842]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a30aed6b-d43a-4ace-b59b-181ac29d8b4c tempest-GroupSnapshotsV319Test-1660463634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0.4a8d1910-accf-4c76-ad6b-44cb44fc68ef" returned: 0 in 0.432s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a30aed6b-d43a-4ace-b59b-181ac29d8b4c tempest-GroupSnapshotsV319Test-1660463634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:54 devstack sudo[95845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0.info Sep 03 11:19:54 devstack sudo[95845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:54 devstack sudo[95845]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a30aed6b-d43a-4ace-b59b-181ac29d8b4c tempest-GroupSnapshotsV319Test-1660463634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0.info" returned: 0 in 0.440s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:54 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-a30aed6b-d43a-4ace-b59b-181ac29d8b4c tempest-GroupSnapshotsV319Test-1660463634 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0.info is being set with open permissions: ugo+rw: NotImplementedError Sep 03 11:19:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a30aed6b-d43a-4ace-b59b-181ac29d8b4c tempest-GroupSnapshotsV319Test-1660463634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:54 devstack sudo[95848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0.info Sep 03 11:19:54 devstack sudo[95848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:55 devstack sudo[95848]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a30aed6b-d43a-4ace-b59b-181ac29d8b4c tempest-GroupSnapshotsV319Test-1660463634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0.info" returned: 0 in 0.351s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a30aed6b-d43a-4ace-b59b-181ac29d8b4c tempest-GroupSnapshotsV319Test-1660463634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.978s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:55 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-a30aed6b-d43a-4ace-b59b-181ac29d8b4c tempest-GroupSnapshotsV319Test-1660463634 None] group_snapshot 50effd10-b0c7-473e-ac34-bfbe634d1c20: created successfully Sep 03 11:19:55 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-00e69699-8e01-4494-8707-3354abac89a9 tempest-GroupSnapshotsV319Test-1660463634 None] group_snapshot 50effd10-b0c7-473e-ac34-bfbe634d1c20: deleting Sep 03 11:19:55 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-00e69699-8e01-4494-8707-3354abac89a9 tempest-GroupSnapshotsV319Test-1660463634 None] group_snapshot 50effd10-b0c7-473e-ac34-bfbe634d1c20: deleting {{(pid=87038) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 03 11:19:55 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-00e69699-8e01-4494-8707-3354abac89a9 tempest-GroupSnapshotsV319Test-1660463634 None] Acquiring lock "cinder-quobyte-897815eb-cdbf-4474-a695-06eb98c5aff0" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:55 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-00e69699-8e01-4494-8707-3354abac89a9 tempest-GroupSnapshotsV319Test-1660463634 None] Lock "cinder-quobyte-897815eb-cdbf-4474-a695-06eb98c5aff0" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:55 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-00e69699-8e01-4494-8707-3354abac89a9 tempest-GroupSnapshotsV319Test-1660463634 None] Acquiring lock "cinder-quobyte-4a8d1910-accf-4c76-ad6b-44cb44fc68ef" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:55 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-00e69699-8e01-4494-8707-3354abac89a9 tempest-GroupSnapshotsV319Test-1660463634 None] Lock "cinder-quobyte-4a8d1910-accf-4c76-ad6b-44cb44fc68ef" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-00e69699-8e01-4494-8707-3354abac89a9 tempest-GroupSnapshotsV319Test-1660463634 None] Deleting offline snapshot 4a8d1910-accf-4c76-ad6b-44cb44fc68ef of volume 897815eb-cdbf-4474-a695-06eb98c5aff0 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:19:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-00e69699-8e01-4494-8707-3354abac89a9 tempest-GroupSnapshotsV319Test-1660463634 None] snapshot_file for this snap is: volume-897815eb-cdbf-4474-a695-06eb98c5aff0.4a8d1910-accf-4c76-ad6b-44cb44fc68ef {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:19:56 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1b45c1-5754-4b6d-aab5-907686ef73ee]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:19:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-00e69699-8e01-4494-8707-3354abac89a9 tempest-GroupSnapshotsV319Test-1660463634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0.4a8d1910-accf-4c76-ad6b-44cb44fc68ef {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:56 devstack sudo[95853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0.4a8d1910-accf-4c76-ad6b-44cb44fc68ef Sep 03 11:19:56 devstack sudo[95853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:56 devstack sudo[95853]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-00e69699-8e01-4494-8707-3354abac89a9 tempest-GroupSnapshotsV319Test-1660463634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0.4a8d1910-accf-4c76-ad6b-44cb44fc68ef" returned: 0 in 0.548s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-00e69699-8e01-4494-8707-3354abac89a9 tempest-GroupSnapshotsV319Test-1660463634 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-897815eb-cdbf-4474-a695-06eb98c5aff0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:19:56 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[a056d774-2031-4849-8baf-3885e8cc5575]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:19:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-00e69699-8e01-4494-8707-3354abac89a9 tempest-GroupSnapshotsV319Test-1660463634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:56 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a887818-9666-4797-b579-74bef1e6b54e tempest-AttachVolumeNegativeTest-1135519864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:19:56 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4a887818-9666-4797-b579-74bef1e6b54e tempest-AttachVolumeNegativeTest-1135519864 None] Flow 'volume_create_manager' (2cbdbde1-1435-48f0-92e1-405cbdecd42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:19:56 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4a887818-9666-4797-b579-74bef1e6b54e tempest-AttachVolumeNegativeTest-1135519864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b984aab4-7174-44af-b38a-ba0ea72857c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:56 devstack sudo[95859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0 Sep 03 11:19:56 devstack sudo[95859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:56 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4a887818-9666-4797-b579-74bef1e6b54e tempest-AttachVolumeNegativeTest-1135519864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b984aab4-7174-44af-b38a-ba0ea72857c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-498584132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5c0aace-4cad-420a-9acc-65f02c9cfdcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d61409d09184c5993bb335ccbb39155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:19:57Z,use_quota=True,user_id='b17a20289dae429a8682705ff233e9b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:56 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4a887818-9666-4797-b579-74bef1e6b54e tempest-AttachVolumeNegativeTest-1135519864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ec82232-4f2d-4927-9359-56d67ae0b043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:56 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4a887818-9666-4797-b579-74bef1e6b54e tempest-AttachVolumeNegativeTest-1135519864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ec82232-4f2d-4927-9359-56d67ae0b043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:56 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4a887818-9666-4797-b579-74bef1e6b54e tempest-AttachVolumeNegativeTest-1135519864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52050160-9296-4add-9fe6-9db4ba1df9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:56 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4a887818-9666-4797-b579-74bef1e6b54e tempest-AttachVolumeNegativeTest-1135519864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52050160-9296-4add-9fe6-9db4ba1df9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5c0aace-4cad-420a-9acc-65f02c9cfdcc', 'volume_name': 'volume-d5c0aace-4cad-420a-9acc-65f02c9cfdcc', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:56 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4a887818-9666-4797-b579-74bef1e6b54e tempest-AttachVolumeNegativeTest-1135519864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (438c00bc-e6f2-480e-a63b-a242f7392b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:56 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4a887818-9666-4797-b579-74bef1e6b54e tempest-AttachVolumeNegativeTest-1135519864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (438c00bc-e6f2-480e-a63b-a242f7392b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:56 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4a887818-9666-4797-b579-74bef1e6b54e tempest-AttachVolumeNegativeTest-1135519864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a35c009-2289-4efa-8340-1f1a149d6014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:56 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-4a887818-9666-4797-b579-74bef1e6b54e tempest-AttachVolumeNegativeTest-1135519864 None] Volume d5c0aace-4cad-420a-9acc-65f02c9cfdcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5c0aace-4cad-420a-9acc-65f02c9cfdcc', 'volume_size': 1} Sep 03 11:19:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4a887818-9666-4797-b579-74bef1e6b54e tempest-AttachVolumeNegativeTest-1135519864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4a887818-9666-4797-b579-74bef1e6b54e tempest-AttachVolumeNegativeTest-1135519864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4a887818-9666-4797-b579-74bef1e6b54e tempest-AttachVolumeNegativeTest-1135519864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:19:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-498584132',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5c0aace-4cad-420a-9acc-65f02c9cfdcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d61409d09184c5993bb335ccbb39155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:19:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:19:57Z,use_quota=True,user_id='b17a20289dae429a8682705ff233e9b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:19:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-4a887818-9666-4797-b579-74bef1e6b54e tempest-AttachVolumeNegativeTest-1135519864 None] Creating volume d5c0aace-4cad-420a-9acc-65f02c9cfdcc {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:19:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4a887818-9666-4797-b579-74bef1e6b54e tempest-AttachVolumeNegativeTest-1135519864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4a887818-9666-4797-b579-74bef1e6b54e tempest-AttachVolumeNegativeTest-1135519864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4a887818-9666-4797-b579-74bef1e6b54e tempest-AttachVolumeNegativeTest-1135519864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:19:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4a887818-9666-4797-b579-74bef1e6b54e tempest-AttachVolumeNegativeTest-1135519864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:19:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4a887818-9666-4797-b579-74bef1e6b54e tempest-AttachVolumeNegativeTest-1135519864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4a887818-9666-4797-b579-74bef1e6b54e tempest-AttachVolumeNegativeTest-1135519864 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:19:56 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-4a887818-9666-4797-b579-74bef1e6b54e tempest-AttachVolumeNegativeTest-1135519864 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:19:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4a887818-9666-4797-b579-74bef1e6b54e tempest-AttachVolumeNegativeTest-1135519864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d5c0aace-4cad-420a-9acc-65f02c9cfdcc 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:56 devstack sudo[95861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d5c0aace-4cad-420a-9acc-65f02c9cfdcc 1073741824 Sep 03 11:19:56 devstack sudo[95861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:57 devstack sudo[95859]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-00e69699-8e01-4494-8707-3354abac89a9 tempest-GroupSnapshotsV319Test-1660463634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0" returned: 0 in 0.556s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-00e69699-8e01-4494-8707-3354abac89a9 tempest-GroupSnapshotsV319Test-1660463634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0.4a8d1910-accf-4c76-ad6b-44cb44fc68ef {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:57 devstack sudo[95868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0.4a8d1910-accf-4c76-ad6b-44cb44fc68ef Sep 03 11:19:57 devstack sudo[95868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:57 devstack sudo[95861]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4a887818-9666-4797-b579-74bef1e6b54e tempest-AttachVolumeNegativeTest-1135519864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d5c0aace-4cad-420a-9acc-65f02c9cfdcc 1073741824" returned: 0 in 0.795s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4a887818-9666-4797-b579-74bef1e6b54e tempest-AttachVolumeNegativeTest-1135519864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d5c0aace-4cad-420a-9acc-65f02c9cfdcc {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:57 devstack sudo[95868]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-00e69699-8e01-4494-8707-3354abac89a9 tempest-GroupSnapshotsV319Test-1660463634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0.4a8d1910-accf-4c76-ad6b-44cb44fc68ef" returned: 0 in 0.575s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:57 devstack sudo[95878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d5c0aace-4cad-420a-9acc-65f02c9cfdcc Sep 03 11:19:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-00e69699-8e01-4494-8707-3354abac89a9 tempest-GroupSnapshotsV319Test-1660463634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0.4a8d1910-accf-4c76-ad6b-44cb44fc68ef {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:57 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:57 devstack sudo[95880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0.4a8d1910-accf-4c76-ad6b-44cb44fc68ef Sep 03 11:19:57 devstack sudo[95880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:57 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-1dbe698a-8bd5-41fa-af4e-b850613dafd3 tempest-VolumesTransfersTest-575385967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:19:57 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1dbe698a-8bd5-41fa-af4e-b850613dafd3 tempest-VolumesTransfersTest-575385967 None] Flow 'volume_create_manager' (abd0529d-b3c6-46ef-83b0-8485f2cab09f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:19:57 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1dbe698a-8bd5-41fa-af4e-b850613dafd3 tempest-VolumesTransfersTest-575385967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f7fa4d-9cbe-4207-b97c-780a2b74e987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:57 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1dbe698a-8bd5-41fa-af4e-b850613dafd3 tempest-VolumesTransfersTest-575385967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8f7fa4d-9cbe-4207-b97c-780a2b74e987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-396351856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6618e15-7063-49bf-b86d-197ed8148166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6006f97cb2994d799d662c10ea582355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:19:58Z,use_quota=True,user_id='2fc39725440647c99e794a35b33bf622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:57 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1dbe698a-8bd5-41fa-af4e-b850613dafd3 tempest-VolumesTransfersTest-575385967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40041446-58c6-49c2-b096-de1f0d1dcecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:57 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1dbe698a-8bd5-41fa-af4e-b850613dafd3 tempest-VolumesTransfersTest-575385967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40041446-58c6-49c2-b096-de1f0d1dcecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:57 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1dbe698a-8bd5-41fa-af4e-b850613dafd3 tempest-VolumesTransfersTest-575385967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d9fca77-4b08-46bb-a8f4-8283d49f6077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:58 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1dbe698a-8bd5-41fa-af4e-b850613dafd3 tempest-VolumesTransfersTest-575385967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d9fca77-4b08-46bb-a8f4-8283d49f6077) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6618e15-7063-49bf-b86d-197ed8148166', 'volume_name': 'volume-d6618e15-7063-49bf-b86d-197ed8148166', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:58 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1dbe698a-8bd5-41fa-af4e-b850613dafd3 tempest-VolumesTransfersTest-575385967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9abbf131-68a0-496b-a9a3-f99cf1cd5203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:58 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1dbe698a-8bd5-41fa-af4e-b850613dafd3 tempest-VolumesTransfersTest-575385967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9abbf131-68a0-496b-a9a3-f99cf1cd5203) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:58 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1dbe698a-8bd5-41fa-af4e-b850613dafd3 tempest-VolumesTransfersTest-575385967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3276b7a-22f5-410a-9aeb-a492cba80ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:58 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-1dbe698a-8bd5-41fa-af4e-b850613dafd3 tempest-VolumesTransfersTest-575385967 None] Volume d6618e15-7063-49bf-b86d-197ed8148166: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6618e15-7063-49bf-b86d-197ed8148166', 'volume_size': 1} Sep 03 11:19:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1dbe698a-8bd5-41fa-af4e-b850613dafd3 tempest-VolumesTransfersTest-575385967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:58 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4a887818-9666-4797-b579-74bef1e6b54e tempest-AttachVolumeNegativeTest-1135519864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d5c0aace-4cad-420a-9acc-65f02c9cfdcc" returned: 0 in 0.301s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:58 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4a887818-9666-4797-b579-74bef1e6b54e tempest-AttachVolumeNegativeTest-1135519864 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:19:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4a887818-9666-4797-b579-74bef1e6b54e tempest-AttachVolumeNegativeTest-1135519864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1dbe698a-8bd5-41fa-af4e-b850613dafd3 tempest-VolumesTransfersTest-575385967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.031s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:58 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1dbe698a-8bd5-41fa-af4e-b850613dafd3 tempest-VolumesTransfersTest-575385967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:19:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-396351856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6618e15-7063-49bf-b86d-197ed8148166,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6006f97cb2994d799d662c10ea582355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:19:58Z,use_quota=True,user_id='2fc39725440647c99e794a35b33bf622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:19:58 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-1dbe698a-8bd5-41fa-af4e-b850613dafd3 tempest-VolumesTransfersTest-575385967 None] Creating volume d6618e15-7063-49bf-b86d-197ed8148166 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:19:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1dbe698a-8bd5-41fa-af4e-b850613dafd3 tempest-VolumesTransfersTest-575385967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1dbe698a-8bd5-41fa-af4e-b850613dafd3 tempest-VolumesTransfersTest-575385967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:58 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1dbe698a-8bd5-41fa-af4e-b850613dafd3 tempest-VolumesTransfersTest-575385967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:19:58 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1dbe698a-8bd5-41fa-af4e-b850613dafd3 tempest-VolumesTransfersTest-575385967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:19:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1dbe698a-8bd5-41fa-af4e-b850613dafd3 tempest-VolumesTransfersTest-575385967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:58 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1dbe698a-8bd5-41fa-af4e-b850613dafd3 tempest-VolumesTransfersTest-575385967 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:19:58 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-1dbe698a-8bd5-41fa-af4e-b850613dafd3 tempest-VolumesTransfersTest-575385967 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:19:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1dbe698a-8bd5-41fa-af4e-b850613dafd3 tempest-VolumesTransfersTest-575385967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d6618e15-7063-49bf-b86d-197ed8148166 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:58 devstack sudo[95880]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-00e69699-8e01-4494-8707-3354abac89a9 tempest-GroupSnapshotsV319Test-1660463634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0.4a8d1910-accf-4c76-ad6b-44cb44fc68ef" returned: 0 in 0.295s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:58 devstack sudo[95884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d6618e15-7063-49bf-b86d-197ed8148166 1073741824 Sep 03 11:19:58 devstack sudo[95884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:58 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4a887818-9666-4797-b579-74bef1e6b54e tempest-AttachVolumeNegativeTest-1135519864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a35c009-2289-4efa-8340-1f1a149d6014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5c0aace-4cad-420a-9acc-65f02c9cfdcc', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:58 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4a887818-9666-4797-b579-74bef1e6b54e tempest-AttachVolumeNegativeTest-1135519864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7a0035-e94e-4477-a219-ab45d761aa71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:58 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-00e69699-8e01-4494-8707-3354abac89a9 tempest-GroupSnapshotsV319Test-1660463634 None] Lock "cinder-quobyte-4a8d1910-accf-4c76-ad6b-44cb44fc68ef" released by "_delete_snapshot" :: held 2.154s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:58 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-00e69699-8e01-4494-8707-3354abac89a9 tempest-GroupSnapshotsV319Test-1660463634 None] Lock "cinder-quobyte-897815eb-cdbf-4474-a695-06eb98c5aff0" released by "delete_snapshot" :: held 2.194s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:19:58 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-4a887818-9666-4797-b579-74bef1e6b54e tempest-AttachVolumeNegativeTest-1135519864 None] Volume volume-d5c0aace-4cad-420a-9acc-65f02c9cfdcc (d5c0aace-4cad-420a-9acc-65f02c9cfdcc): created successfully Sep 03 11:19:58 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4a887818-9666-4797-b579-74bef1e6b54e tempest-AttachVolumeNegativeTest-1135519864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db7a0035-e94e-4477-a219-ab45d761aa71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:58 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4a887818-9666-4797-b579-74bef1e6b54e tempest-AttachVolumeNegativeTest-1135519864 None] Flow 'volume_create_manager' (2cbdbde1-1435-48f0-92e1-405cbdecd42a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:19:58 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-4a887818-9666-4797-b579-74bef1e6b54e tempest-AttachVolumeNegativeTest-1135519864 None] Created volume successfully. Sep 03 11:19:58 devstack cinder-volume[87038]: WARNING cinder.quota [None req-00e69699-8e01-4494-8707-3354abac89a9 tempest-GroupSnapshotsV319Test-1660463634 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1852541988 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1852541988, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:19:58 devstack cinder-volume[87038]: WARNING cinder.quota [None req-00e69699-8e01-4494-8707-3354abac89a9 tempest-GroupSnapshotsV319Test-1660463634 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1852541988 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1852541988, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:19:58 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-00e69699-8e01-4494-8707-3354abac89a9 tempest-GroupSnapshotsV319Test-1660463634 None] Created reservations ['23d50658-0ba5-4ed7-aa9d-b6eb4b5c107c', '762ae75d-9a59-472a-bbcd-199a19ce6d80', 'abac5e09-93b4-4a8c-a256-9db1433b3e5c', '4de80d1c-3aa8-4e46-a99d-62914587d4ad'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:19:58 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-00e69699-8e01-4494-8707-3354abac89a9 tempest-GroupSnapshotsV319Test-1660463634 None] group_snapshot 50effd10-b0c7-473e-ac34-bfbe634d1c20: deleted successfully Sep 03 11:19:58 devstack sudo[95884]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1dbe698a-8bd5-41fa-af4e-b850613dafd3 tempest-VolumesTransfersTest-575385967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d6618e15-7063-49bf-b86d-197ed8148166 1073741824" returned: 0 in 0.467s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1dbe698a-8bd5-41fa-af4e-b850613dafd3 tempest-VolumesTransfersTest-575385967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d6618e15-7063-49bf-b86d-197ed8148166 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:58 devstack sudo[95890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d6618e15-7063-49bf-b86d-197ed8148166 Sep 03 11:19:58 devstack sudo[95890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:19:58 devstack sudo[95890]: pam_unix(sudo:session): session closed for user root Sep 03 11:19:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1dbe698a-8bd5-41fa-af4e-b850613dafd3 tempest-VolumesTransfersTest-575385967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d6618e15-7063-49bf-b86d-197ed8148166" returned: 0 in 0.277s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:19:58 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1dbe698a-8bd5-41fa-af4e-b850613dafd3 tempest-VolumesTransfersTest-575385967 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:19:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1dbe698a-8bd5-41fa-af4e-b850613dafd3 tempest-VolumesTransfersTest-575385967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:58 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1dbe698a-8bd5-41fa-af4e-b850613dafd3 tempest-VolumesTransfersTest-575385967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3276b7a-22f5-410a-9aeb-a492cba80ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6618e15-7063-49bf-b86d-197ed8148166', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:58 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1dbe698a-8bd5-41fa-af4e-b850613dafd3 tempest-VolumesTransfersTest-575385967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584868fa-f737-4b9b-900b-b701e125b39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:19:58 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-1dbe698a-8bd5-41fa-af4e-b850613dafd3 tempest-VolumesTransfersTest-575385967 None] Volume volume-d6618e15-7063-49bf-b86d-197ed8148166 (d6618e15-7063-49bf-b86d-197ed8148166): created successfully Sep 03 11:19:58 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1dbe698a-8bd5-41fa-af4e-b850613dafd3 tempest-VolumesTransfersTest-575385967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (584868fa-f737-4b9b-900b-b701e125b39e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:19:58 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1dbe698a-8bd5-41fa-af4e-b850613dafd3 tempest-VolumesTransfersTest-575385967 None] Flow 'volume_create_manager' (abd0529d-b3c6-46ef-83b0-8485f2cab09f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:19:58 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-1dbe698a-8bd5-41fa-af4e-b850613dafd3 tempest-VolumesTransfersTest-575385967 None] Created volume successfully. Sep 03 11:19:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-324f14f3-b53c-4967-af09-4065a6ef528c req-3888e3fe-f1c8-4603-af9b-ef583ce72153 tempest-AttachVolumeNegativeTest-1135519864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:19:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-324f14f3-b53c-4967-af09-4065a6ef528c req-3888e3fe-f1c8-4603-af9b-ef583ce72153 tempest-AttachVolumeNegativeTest-1135519864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:19:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-324f14f3-b53c-4967-af09-4065a6ef528c req-3888e3fe-f1c8-4603-af9b-ef583ce72153 tempest-AttachVolumeNegativeTest-1135519864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:19:59 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f09274ac-bc3d-48af-af8f-7aedd5a94402 tempest-GroupSnapshotsV319Test-1660463634 None] Acquiring lock "cinder-quobyte-897815eb-cdbf-4474-a695-06eb98c5aff0" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:19:59 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f09274ac-bc3d-48af-af8f-7aedd5a94402 tempest-GroupSnapshotsV319Test-1660463634 None] Lock "cinder-quobyte-897815eb-cdbf-4474-a695-06eb98c5aff0" acquired by "delete_volume" :: waited 0.021s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:19:59 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-324f14f3-b53c-4967-af09-4065a6ef528c req-3888e3fe-f1c8-4603-af9b-ef583ce72153 tempest-AttachVolumeNegativeTest-1135519864 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912', 'name': 'volume-d5c0aace-4cad-420a-9acc-65f02c9cfdcc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd2d85829-dc3c-4120-864d-fa5e15d3f745', 'enforce_multipath': True} {{(pid=87038) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:19:59 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e76735d-d595-4d06-a88f-87b3219169ef]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:19:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f09274ac-bc3d-48af-af8f-7aedd5a94402 tempest-GroupSnapshotsV319Test-1660463634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:19:59 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-324f14f3-b53c-4967-af09-4065a6ef528c req-3888e3fe-f1c8-4603-af9b-ef583ce72153 tempest-AttachVolumeNegativeTest-1135519864 None] attachment_update completed successfully. Sep 03 11:19:59 devstack sudo[95904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0 Sep 03 11:19:59 devstack sudo[95904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:00 devstack sudo[95904]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f09274ac-bc3d-48af-af8f-7aedd5a94402 tempest-GroupSnapshotsV319Test-1660463634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0" returned: 0 in 0.531s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f09274ac-bc3d-48af-af8f-7aedd5a94402 tempest-GroupSnapshotsV319Test-1660463634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:00 devstack sudo[96294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0 Sep 03 11:20:00 devstack sudo[96294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:00 devstack sudo[96294]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f09274ac-bc3d-48af-af8f-7aedd5a94402 tempest-GroupSnapshotsV319Test-1660463634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-897815eb-cdbf-4474-a695-06eb98c5aff0" returned: 0 in 0.314s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:00 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f09274ac-bc3d-48af-af8f-7aedd5a94402 tempest-GroupSnapshotsV319Test-1660463634 None] Lock "cinder-quobyte-897815eb-cdbf-4474-a695-06eb98c5aff0" released by "delete_volume" :: held 0.918s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:20:00 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-f09274ac-bc3d-48af-af8f-7aedd5a94402 tempest-GroupSnapshotsV319Test-1660463634 None] Created reservations ['ec7a0b98-e27e-4c68-b5d2-d006d0250349'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:20:00 devstack cinder-volume[87038]: WARNING cinder.quota [None req-f09274ac-bc3d-48af-af8f-7aedd5a94402 tempest-GroupSnapshotsV319Test-1660463634 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1852541988 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1852541988, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:20:00 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-f09274ac-bc3d-48af-af8f-7aedd5a94402 tempest-GroupSnapshotsV319Test-1660463634 None] Created reservations ['054dc375-60e1-4947-8c02-4c1038c23999', 'b550063e-e633-4742-b14a-a2cf9de8ff8f', 'aa05d406-088c-415c-8f62-c63de7c61c40', '4b1f8225-c8da-4e6d-9078-b56d14f581d9'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:20:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f09274ac-bc3d-48af-af8f-7aedd5a94402 tempest-GroupSnapshotsV319Test-1660463634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:20:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f09274ac-bc3d-48af-af8f-7aedd5a94402 tempest-GroupSnapshotsV319Test-1660463634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:20:00 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f09274ac-bc3d-48af-af8f-7aedd5a94402 tempest-GroupSnapshotsV319Test-1660463634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:20:00 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f09274ac-bc3d-48af-af8f-7aedd5a94402 tempest-GroupSnapshotsV319Test-1660463634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:20:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f09274ac-bc3d-48af-af8f-7aedd5a94402 tempest-GroupSnapshotsV319Test-1660463634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:20:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f09274ac-bc3d-48af-af8f-7aedd5a94402 tempest-GroupSnapshotsV319Test-1660463634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:00 devstack sudo[96298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:20:00 devstack sudo[96298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:01 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-51f9937a-65a2-45bd-a2f8-be8b0951065a tempest-VolumesTransfersTest-1668368495 None] Transfer volume completed successfully. Sep 03 11:20:01 devstack sudo[96298]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:01 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f09274ac-bc3d-48af-af8f-7aedd5a94402 tempest-GroupSnapshotsV319Test-1660463634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.282s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:01 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-f09274ac-bc3d-48af-af8f-7aedd5a94402 tempest-GroupSnapshotsV319Test-1660463634 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:20:01 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-f09274ac-bc3d-48af-af8f-7aedd5a94402 tempest-GroupSnapshotsV319Test-1660463634 None] Delete group completed successfully. Sep 03 11:20:01 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-95b8d423-ef8f-4827-8332-0e1f813ca373 tempest-VolumesTransfersTest-706138422 None] Acquiring lock "cinder-d6618e15-7063-49bf-b86d-197ed8148166-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:20:01 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-95b8d423-ef8f-4827-8332-0e1f813ca373 tempest-VolumesTransfersTest-706138422 None] Lock "cinder-d6618e15-7063-49bf-b86d-197ed8148166-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:20:01 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-95b8d423-ef8f-4827-8332-0e1f813ca373 tempest-VolumesTransfersTest-706138422 None] Acquiring lock "cinder-quobyte-d6618e15-7063-49bf-b86d-197ed8148166" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:20:01 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-95b8d423-ef8f-4827-8332-0e1f813ca373 tempest-VolumesTransfersTest-706138422 None] Lock "cinder-quobyte-d6618e15-7063-49bf-b86d-197ed8148166" acquired by "delete_volume" :: waited 0.020s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:20:01 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee41fd2-27d9-477b-bbea-3ab5c3b8f2f1]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:20:01 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-95b8d423-ef8f-4827-8332-0e1f813ca373 tempest-VolumesTransfersTest-706138422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d6618e15-7063-49bf-b86d-197ed8148166 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:01 devstack sudo[96301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d6618e15-7063-49bf-b86d-197ed8148166 Sep 03 11:20:01 devstack sudo[96301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:02 devstack sudo[96301]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-95b8d423-ef8f-4827-8332-0e1f813ca373 tempest-VolumesTransfersTest-706138422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d6618e15-7063-49bf-b86d-197ed8148166" returned: 0 in 0.452s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-95b8d423-ef8f-4827-8332-0e1f813ca373 tempest-VolumesTransfersTest-706138422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d6618e15-7063-49bf-b86d-197ed8148166 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:02 devstack sudo[96306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d6618e15-7063-49bf-b86d-197ed8148166 Sep 03 11:20:02 devstack sudo[96306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:02 devstack sudo[96306]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-95b8d423-ef8f-4827-8332-0e1f813ca373 tempest-VolumesTransfersTest-706138422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d6618e15-7063-49bf-b86d-197ed8148166" returned: 0 in 0.339s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:02 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-95b8d423-ef8f-4827-8332-0e1f813ca373 tempest-VolumesTransfersTest-706138422 None] Lock "cinder-quobyte-d6618e15-7063-49bf-b86d-197ed8148166" released by "delete_volume" :: held 0.847s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:20:02 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-0f806ddb-0cae-40db-a580-c58fcf884751 req-99d2179f-a478-4e07-b071-1deac3e21cb3 tempest-AttachVolumeNegativeTest-1135519864 None] Terminate volume connection completed successfully. Sep 03 11:20:02 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-0f806ddb-0cae-40db-a580-c58fcf884751 req-99d2179f-a478-4e07-b071-1deac3e21cb3 tempest-AttachVolumeNegativeTest-1135519864 None] Deleting attachment d2d85829-dc3c-4120-864d-fa5e15d3f745. {{(pid=87038) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:20:02 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-95b8d423-ef8f-4827-8332-0e1f813ca373 tempest-VolumesTransfersTest-706138422 None] Created reservations ['2b043d62-94f2-478c-830e-dc3cd6f8c642', '80725b29-1d36-4377-a308-55afb7660692', 'bf2ad5eb-6ed9-4a42-b4f8-3831269b4da2', 'f1f07d8e-5367-41cb-ad9f-7f89f0cf102b'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:20:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-95b8d423-ef8f-4827-8332-0e1f813ca373 tempest-VolumesTransfersTest-706138422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:20:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-95b8d423-ef8f-4827-8332-0e1f813ca373 tempest-VolumesTransfersTest-706138422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:20:02 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-95b8d423-ef8f-4827-8332-0e1f813ca373 tempest-VolumesTransfersTest-706138422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:20:02 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-95b8d423-ef8f-4827-8332-0e1f813ca373 tempest-VolumesTransfersTest-706138422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:20:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-95b8d423-ef8f-4827-8332-0e1f813ca373 tempest-VolumesTransfersTest-706138422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:20:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-95b8d423-ef8f-4827-8332-0e1f813ca373 tempest-VolumesTransfersTest-706138422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:02 devstack sudo[96335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:20:02 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:03 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-95b8d423-ef8f-4827-8332-0e1f813ca373 tempest-VolumesTransfersTest-706138422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.480s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:03 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-95b8d423-ef8f-4827-8332-0e1f813ca373 tempest-VolumesTransfersTest-706138422 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:20:03 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-95b8d423-ef8f-4827-8332-0e1f813ca373 tempest-VolumesTransfersTest-706138422 None] Deleted volume successfully. Sep 03 11:20:03 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-95b8d423-ef8f-4827-8332-0e1f813ca373 tempest-VolumesTransfersTest-706138422 None] Lock "cinder-d6618e15-7063-49bf-b86d-197ed8148166-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:20:03 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-993fa5c4-e660-4fa5-a382-10022c0c98b4 tempest-VolumesTransfersTest-575385967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:20:03 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-993fa5c4-e660-4fa5-a382-10022c0c98b4 tempest-VolumesTransfersTest-575385967 None] Flow 'volume_create_manager' (1b3f6f2b-8f98-4a71-9349-c05655be8441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:20:04 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-993fa5c4-e660-4fa5-a382-10022c0c98b4 tempest-VolumesTransfersTest-575385967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8bf685f-d5fb-4a40-b455-e04c5f396737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:04 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-993fa5c4-e660-4fa5-a382-10022c0c98b4 tempest-VolumesTransfersTest-575385967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8bf685f-d5fb-4a40-b455-e04c5f396737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2083067860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59d5e305-cfd2-492c-91ed-1268a5a7cea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6006f97cb2994d799d662c10ea582355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:20:04Z,use_quota=True,user_id='2fc39725440647c99e794a35b33bf622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:04 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-993fa5c4-e660-4fa5-a382-10022c0c98b4 tempest-VolumesTransfersTest-575385967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (561f81a5-8aa3-4df3-be17-4131c93620d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:04 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-993fa5c4-e660-4fa5-a382-10022c0c98b4 tempest-VolumesTransfersTest-575385967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (561f81a5-8aa3-4df3-be17-4131c93620d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:04 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-993fa5c4-e660-4fa5-a382-10022c0c98b4 tempest-VolumesTransfersTest-575385967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (672d8282-6c2d-4608-b355-a06555ce6755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:04 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-993fa5c4-e660-4fa5-a382-10022c0c98b4 tempest-VolumesTransfersTest-575385967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (672d8282-6c2d-4608-b355-a06555ce6755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59d5e305-cfd2-492c-91ed-1268a5a7cea3', 'volume_name': 'volume-59d5e305-cfd2-492c-91ed-1268a5a7cea3', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:04 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-993fa5c4-e660-4fa5-a382-10022c0c98b4 tempest-VolumesTransfersTest-575385967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bce0f77b-653b-4768-9c35-b6c20388020d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:04 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-993fa5c4-e660-4fa5-a382-10022c0c98b4 tempest-VolumesTransfersTest-575385967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bce0f77b-653b-4768-9c35-b6c20388020d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:04 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-993fa5c4-e660-4fa5-a382-10022c0c98b4 tempest-VolumesTransfersTest-575385967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81e33777-0b1c-4987-9ac2-0d73fa466eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:04 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-993fa5c4-e660-4fa5-a382-10022c0c98b4 tempest-VolumesTransfersTest-575385967 None] Volume 59d5e305-cfd2-492c-91ed-1268a5a7cea3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59d5e305-cfd2-492c-91ed-1268a5a7cea3', 'volume_size': 1} Sep 03 11:20:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-993fa5c4-e660-4fa5-a382-10022c0c98b4 tempest-VolumesTransfersTest-575385967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:20:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-993fa5c4-e660-4fa5-a382-10022c0c98b4 tempest-VolumesTransfersTest-575385967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:20:04 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-993fa5c4-e660-4fa5-a382-10022c0c98b4 tempest-VolumesTransfersTest-575385967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:20:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2083067860',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59d5e305-cfd2-492c-91ed-1268a5a7cea3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6006f97cb2994d799d662c10ea582355',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:20:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:20:04Z,use_quota=True,user_id='2fc39725440647c99e794a35b33bf622',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:20:04 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-993fa5c4-e660-4fa5-a382-10022c0c98b4 tempest-VolumesTransfersTest-575385967 None] Creating volume 59d5e305-cfd2-492c-91ed-1268a5a7cea3 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:20:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-993fa5c4-e660-4fa5-a382-10022c0c98b4 tempest-VolumesTransfersTest-575385967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:20:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-993fa5c4-e660-4fa5-a382-10022c0c98b4 tempest-VolumesTransfersTest-575385967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:20:04 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-993fa5c4-e660-4fa5-a382-10022c0c98b4 tempest-VolumesTransfersTest-575385967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:20:04 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-993fa5c4-e660-4fa5-a382-10022c0c98b4 tempest-VolumesTransfersTest-575385967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:20:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-993fa5c4-e660-4fa5-a382-10022c0c98b4 tempest-VolumesTransfersTest-575385967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:20:04 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-993fa5c4-e660-4fa5-a382-10022c0c98b4 tempest-VolumesTransfersTest-575385967 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:20:04 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-993fa5c4-e660-4fa5-a382-10022c0c98b4 tempest-VolumesTransfersTest-575385967 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:20:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-993fa5c4-e660-4fa5-a382-10022c0c98b4 tempest-VolumesTransfersTest-575385967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-59d5e305-cfd2-492c-91ed-1268a5a7cea3 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:04 devstack sudo[96347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-59d5e305-cfd2-492c-91ed-1268a5a7cea3 1073741824 Sep 03 11:20:04 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:04 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-993fa5c4-e660-4fa5-a382-10022c0c98b4 tempest-VolumesTransfersTest-575385967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-59d5e305-cfd2-492c-91ed-1268a5a7cea3 1073741824" returned: 0 in 0.654s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-993fa5c4-e660-4fa5-a382-10022c0c98b4 tempest-VolumesTransfersTest-575385967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-59d5e305-cfd2-492c-91ed-1268a5a7cea3 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:04 devstack sudo[96364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-59d5e305-cfd2-492c-91ed-1268a5a7cea3 Sep 03 11:20:04 devstack sudo[96364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:05 devstack sudo[96364]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-993fa5c4-e660-4fa5-a382-10022c0c98b4 tempest-VolumesTransfersTest-575385967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-59d5e305-cfd2-492c-91ed-1268a5a7cea3" returned: 0 in 0.326s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:05 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-993fa5c4-e660-4fa5-a382-10022c0c98b4 tempest-VolumesTransfersTest-575385967 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:20:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-993fa5c4-e660-4fa5-a382-10022c0c98b4 tempest-VolumesTransfersTest-575385967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:20:05 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-993fa5c4-e660-4fa5-a382-10022c0c98b4 tempest-VolumesTransfersTest-575385967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (81e33777-0b1c-4987-9ac2-0d73fa466eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59d5e305-cfd2-492c-91ed-1268a5a7cea3', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:05 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-993fa5c4-e660-4fa5-a382-10022c0c98b4 tempest-VolumesTransfersTest-575385967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42925aa-6b4b-4691-883e-7228c2dc2bad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:05 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-993fa5c4-e660-4fa5-a382-10022c0c98b4 tempest-VolumesTransfersTest-575385967 None] Volume volume-59d5e305-cfd2-492c-91ed-1268a5a7cea3 (59d5e305-cfd2-492c-91ed-1268a5a7cea3): created successfully Sep 03 11:20:05 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-993fa5c4-e660-4fa5-a382-10022c0c98b4 tempest-VolumesTransfersTest-575385967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c42925aa-6b4b-4691-883e-7228c2dc2bad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:05 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-993fa5c4-e660-4fa5-a382-10022c0c98b4 tempest-VolumesTransfersTest-575385967 None] Flow 'volume_create_manager' (1b3f6f2b-8f98-4a71-9349-c05655be8441) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:20:05 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-993fa5c4-e660-4fa5-a382-10022c0c98b4 tempest-VolumesTransfersTest-575385967 None] Created volume successfully. Sep 03 11:20:06 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-abbc70e2-05a9-4c0e-9591-4c4aa95b72b8 tempest-VolumesTransfersTest-706138422 None] Acquiring lock "cinder-59d5e305-cfd2-492c-91ed-1268a5a7cea3-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:20:06 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-abbc70e2-05a9-4c0e-9591-4c4aa95b72b8 tempest-VolumesTransfersTest-706138422 None] Lock "cinder-59d5e305-cfd2-492c-91ed-1268a5a7cea3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:20:06 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-abbc70e2-05a9-4c0e-9591-4c4aa95b72b8 tempest-VolumesTransfersTest-706138422 None] Acquiring lock "cinder-quobyte-59d5e305-cfd2-492c-91ed-1268a5a7cea3" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:20:06 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-abbc70e2-05a9-4c0e-9591-4c4aa95b72b8 tempest-VolumesTransfersTest-706138422 None] Lock "cinder-quobyte-59d5e305-cfd2-492c-91ed-1268a5a7cea3" acquired by "delete_volume" :: waited 0.020s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:20:06 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[b229ae14-496d-4926-bf6f-ab7b93066be8]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:20:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-abbc70e2-05a9-4c0e-9591-4c4aa95b72b8 tempest-VolumesTransfersTest-706138422 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-59d5e305-cfd2-492c-91ed-1268a5a7cea3 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:06 devstack sudo[96368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-59d5e305-cfd2-492c-91ed-1268a5a7cea3 Sep 03 11:20:06 devstack sudo[96368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:06 devstack sudo[96368]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-abbc70e2-05a9-4c0e-9591-4c4aa95b72b8 tempest-VolumesTransfersTest-706138422 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-59d5e305-cfd2-492c-91ed-1268a5a7cea3" returned: 0 in 0.433s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-abbc70e2-05a9-4c0e-9591-4c4aa95b72b8 tempest-VolumesTransfersTest-706138422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-59d5e305-cfd2-492c-91ed-1268a5a7cea3 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:06 devstack sudo[96373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-59d5e305-cfd2-492c-91ed-1268a5a7cea3 Sep 03 11:20:06 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:07 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-abbc70e2-05a9-4c0e-9591-4c4aa95b72b8 tempest-VolumesTransfersTest-706138422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-59d5e305-cfd2-492c-91ed-1268a5a7cea3" returned: 0 in 0.305s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:07 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-abbc70e2-05a9-4c0e-9591-4c4aa95b72b8 tempest-VolumesTransfersTest-706138422 None] Lock "cinder-quobyte-59d5e305-cfd2-492c-91ed-1268a5a7cea3" released by "delete_volume" :: held 0.787s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:20:07 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-abbc70e2-05a9-4c0e-9591-4c4aa95b72b8 tempest-VolumesTransfersTest-706138422 None] Created reservations ['7fd4f91f-564a-4511-b4eb-afbea5c9b3f3', '39ef912e-ae90-46f0-893a-c46a3ce1e553', '8caa83f0-7493-40b7-b0e3-370ee6df6f52', '72a8193f-a6e4-40d4-8f93-36caa4cbd07f'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:20:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-abbc70e2-05a9-4c0e-9591-4c4aa95b72b8 tempest-VolumesTransfersTest-706138422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:20:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-abbc70e2-05a9-4c0e-9591-4c4aa95b72b8 tempest-VolumesTransfersTest-706138422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:20:07 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-abbc70e2-05a9-4c0e-9591-4c4aa95b72b8 tempest-VolumesTransfersTest-706138422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:20:07 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-abbc70e2-05a9-4c0e-9591-4c4aa95b72b8 tempest-VolumesTransfersTest-706138422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:20:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-abbc70e2-05a9-4c0e-9591-4c4aa95b72b8 tempest-VolumesTransfersTest-706138422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:20:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-abbc70e2-05a9-4c0e-9591-4c4aa95b72b8 tempest-VolumesTransfersTest-706138422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:07 devstack sudo[96377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:20:07 devstack sudo[96377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:07 devstack sudo[96377]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-abbc70e2-05a9-4c0e-9591-4c4aa95b72b8 tempest-VolumesTransfersTest-706138422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.415s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:07 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-abbc70e2-05a9-4c0e-9591-4c4aa95b72b8 tempest-VolumesTransfersTest-706138422 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:20:07 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-abbc70e2-05a9-4c0e-9591-4c4aa95b72b8 tempest-VolumesTransfersTest-706138422 None] Deleted volume successfully. Sep 03 11:20:07 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-abbc70e2-05a9-4c0e-9591-4c4aa95b72b8 tempest-VolumesTransfersTest-706138422 None] Lock "cinder-59d5e305-cfd2-492c-91ed-1268a5a7cea3-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:20:13 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-fedfa356-664c-41ca-b7b4-c8889c65554f tempest-GroupsV314Test-514744745 None] Group tempest-GroupsV314Test-Group-2142926401: creating Sep 03 11:20:13 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-fedfa356-664c-41ca-b7b4-c8889c65554f tempest-GroupsV314Test-514744745 None] Group tempest-GroupsV314Test-Group-2142926401: created successfully Sep 03 11:20:13 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-fedfa356-664c-41ca-b7b4-c8889c65554f tempest-GroupsV314Test-514744745 None] Create group completed successfully. Sep 03 11:20:14 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=131,cinder:INSERT=32,cinder:UPDATE=156,cinder:DELETE=9 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:20:14 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=133,cinder:INSERT=46,cinder:UPDATE=165,cinder:DELETE=14 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:20:14 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-e43b5adf-9f2e-42e8-999f-cb330145cfa5 tempest-TestInstancesWithCinderVolumes-2123003308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:20:14 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e43b5adf-9f2e-42e8-999f-cb330145cfa5 tempest-TestInstancesWithCinderVolumes-2123003308 None] Flow 'volume_create_manager' (a32496de-8160-4f92-9ff0-b898fd1daab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:20:14 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e43b5adf-9f2e-42e8-999f-cb330145cfa5 tempest-TestInstancesWithCinderVolumes-2123003308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (355679d0-b76c-44a2-9248-0bfc74718048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:14 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e43b5adf-9f2e-42e8-999f-cb330145cfa5 tempest-TestInstancesWithCinderVolumes-2123003308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (355679d0-b76c-44a2-9248-0bfc74718048) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-162204735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d6464e4-d026-42c7-b5d1-7d8912ddfe90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30cbe8eb4d0742e3942dc942aa7e4ea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:20:15Z,use_quota=True,user_id='4d37b156e6cf437099d46a395c06251a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec788b70-8ccb-401d-9e19-0a668d08ae7f),volume_type_id=ec788b70-8ccb-401d-9e19-0a668d08ae7f)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:14 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e43b5adf-9f2e-42e8-999f-cb330145cfa5 tempest-TestInstancesWithCinderVolumes-2123003308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d39c4a8-48b2-4f33-9e0b-205ef7f532c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:14 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e43b5adf-9f2e-42e8-999f-cb330145cfa5 tempest-TestInstancesWithCinderVolumes-2123003308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d39c4a8-48b2-4f33-9e0b-205ef7f532c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:14 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e43b5adf-9f2e-42e8-999f-cb330145cfa5 tempest-TestInstancesWithCinderVolumes-2123003308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4490ffe9-4894-42f5-a805-2dc2c9c209a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:14 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e43b5adf-9f2e-42e8-999f-cb330145cfa5 tempest-TestInstancesWithCinderVolumes-2123003308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4490ffe9-4894-42f5-a805-2dc2c9c209a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d6464e4-d026-42c7-b5d1-7d8912ddfe90', 'volume_name': 'volume-4d6464e4-d026-42c7-b5d1-7d8912ddfe90', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:14 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e43b5adf-9f2e-42e8-999f-cb330145cfa5 tempest-TestInstancesWithCinderVolumes-2123003308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08dcae67-e574-4edd-91d9-fbcfca9bdb82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:14 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e43b5adf-9f2e-42e8-999f-cb330145cfa5 tempest-TestInstancesWithCinderVolumes-2123003308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08dcae67-e574-4edd-91d9-fbcfca9bdb82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:14 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e43b5adf-9f2e-42e8-999f-cb330145cfa5 tempest-TestInstancesWithCinderVolumes-2123003308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cfd4c1d-2a40-4dab-a479-60f0ed4f183b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:14 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-e43b5adf-9f2e-42e8-999f-cb330145cfa5 tempest-TestInstancesWithCinderVolumes-2123003308 None] Volume 4d6464e4-d026-42c7-b5d1-7d8912ddfe90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d6464e4-d026-42c7-b5d1-7d8912ddfe90', 'volume_size': 1} Sep 03 11:20:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e43b5adf-9f2e-42e8-999f-cb330145cfa5 tempest-TestInstancesWithCinderVolumes-2123003308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:20:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e43b5adf-9f2e-42e8-999f-cb330145cfa5 tempest-TestInstancesWithCinderVolumes-2123003308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:20:14 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e43b5adf-9f2e-42e8-999f-cb330145cfa5 tempest-TestInstancesWithCinderVolumes-2123003308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-162204735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d6464e4-d026-42c7-b5d1-7d8912ddfe90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30cbe8eb4d0742e3942dc942aa7e4ea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:20:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:20:15Z,use_quota=True,user_id='4d37b156e6cf437099d46a395c06251a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ec788b70-8ccb-401d-9e19-0a668d08ae7f),volume_type_id=ec788b70-8ccb-401d-9e19-0a668d08ae7f)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:20:14 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-e43b5adf-9f2e-42e8-999f-cb330145cfa5 tempest-TestInstancesWithCinderVolumes-2123003308 None] Creating volume 4d6464e4-d026-42c7-b5d1-7d8912ddfe90 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:20:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e43b5adf-9f2e-42e8-999f-cb330145cfa5 tempest-TestInstancesWithCinderVolumes-2123003308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:20:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e43b5adf-9f2e-42e8-999f-cb330145cfa5 tempest-TestInstancesWithCinderVolumes-2123003308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:20:14 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e43b5adf-9f2e-42e8-999f-cb330145cfa5 tempest-TestInstancesWithCinderVolumes-2123003308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:20:14 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e43b5adf-9f2e-42e8-999f-cb330145cfa5 tempest-TestInstancesWithCinderVolumes-2123003308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:20:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e43b5adf-9f2e-42e8-999f-cb330145cfa5 tempest-TestInstancesWithCinderVolumes-2123003308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:20:14 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e43b5adf-9f2e-42e8-999f-cb330145cfa5 tempest-TestInstancesWithCinderVolumes-2123003308 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:20:14 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-e43b5adf-9f2e-42e8-999f-cb330145cfa5 tempest-TestInstancesWithCinderVolumes-2123003308 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:20:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e43b5adf-9f2e-42e8-999f-cb330145cfa5 tempest-TestInstancesWithCinderVolumes-2123003308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4d6464e4-d026-42c7-b5d1-7d8912ddfe90 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:14 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4d6464e4-d026-42c7-b5d1-7d8912ddfe90 1073741824 Sep 03 11:20:14 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:15 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e43b5adf-9f2e-42e8-999f-cb330145cfa5 tempest-TestInstancesWithCinderVolumes-2123003308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4d6464e4-d026-42c7-b5d1-7d8912ddfe90 1073741824" returned: 0 in 0.672s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e43b5adf-9f2e-42e8-999f-cb330145cfa5 tempest-TestInstancesWithCinderVolumes-2123003308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4d6464e4-d026-42c7-b5d1-7d8912ddfe90 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:15 devstack sudo[96427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4d6464e4-d026-42c7-b5d1-7d8912ddfe90 Sep 03 11:20:15 devstack sudo[96427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:15 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0a759fa-9d6c-4f35-b3c3-4f51a26ec5ac tempest-GroupsV314Test-514744745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:20:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a0a759fa-9d6c-4f35-b3c3-4f51a26ec5ac tempest-GroupsV314Test-514744745 None] Flow 'volume_create_manager' (749dc10e-b8ae-4eed-a699-e2a2ef2be2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:20:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a0a759fa-9d6c-4f35-b3c3-4f51a26ec5ac tempest-GroupsV314Test-514744745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9871beb-c5f8-432d-8725-546ee3589b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:15 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d4a4e42-d113-4d14-89d3-1c9f288c2a64 tempest-TestInstancesWithCinderVolumes-2123003308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:20:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7d4a4e42-d113-4d14-89d3-1c9f288c2a64 tempest-TestInstancesWithCinderVolumes-2123003308 None] Flow 'volume_create_manager' (33ded9b1-f4f5-4a89-9bdf-ddff2abbcf71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:20:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7d4a4e42-d113-4d14-89d3-1c9f288c2a64 tempest-TestInstancesWithCinderVolumes-2123003308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a24419-695a-4ef3-96b0-6ef2ac9bfef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a0a759fa-9d6c-4f35-b3c3-4f51a26ec5ac tempest-GroupsV314Test-514744745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9871beb-c5f8-432d-8725-546ee3589b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-236041534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7a55ba64-1c1e-4826-840f-dd9151fe6276,host='devstack@QuobyteHD#QuobyteHD',id=1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96f4040cbbd480d8d275f8cdaece056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:20:16Z,use_quota=True,user_id='0652a10225314bef9e89014082fbfb8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(766fd3ea-5462-4f79-985a-e66cb3c024ee),volume_type_id=766fd3ea-5462-4f79-985a-e66cb3c024ee)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a0a759fa-9d6c-4f35-b3c3-4f51a26ec5ac tempest-GroupsV314Test-514744745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c1f9f01-cf0f-46f8-a0f1-ea04ce164d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a0a759fa-9d6c-4f35-b3c3-4f51a26ec5ac tempest-GroupsV314Test-514744745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c1f9f01-cf0f-46f8-a0f1-ea04ce164d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a0a759fa-9d6c-4f35-b3c3-4f51a26ec5ac tempest-GroupsV314Test-514744745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82337a7c-92bd-45e6-b8e9-ce7cfdfad9be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a0a759fa-9d6c-4f35-b3c3-4f51a26ec5ac tempest-GroupsV314Test-514744745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82337a7c-92bd-45e6-b8e9-ce7cfdfad9be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0', 'volume_name': 'volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a0a759fa-9d6c-4f35-b3c3-4f51a26ec5ac tempest-GroupsV314Test-514744745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24acad5e-91e1-47ca-b2f7-53556c319473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a0a759fa-9d6c-4f35-b3c3-4f51a26ec5ac tempest-GroupsV314Test-514744745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24acad5e-91e1-47ca-b2f7-53556c319473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a0a759fa-9d6c-4f35-b3c3-4f51a26ec5ac tempest-GroupsV314Test-514744745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71beee07-0cec-4190-8a6f-eb6c8aa8426a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:15 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-a0a759fa-9d6c-4f35-b3c3-4f51a26ec5ac tempest-GroupsV314Test-514744745 None] Volume 1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0', 'volume_size': 1} Sep 03 11:20:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a0a759fa-9d6c-4f35-b3c3-4f51a26ec5ac tempest-GroupsV314Test-514744745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:20:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7d4a4e42-d113-4d14-89d3-1c9f288c2a64 tempest-TestInstancesWithCinderVolumes-2123003308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6a24419-695a-4ef3-96b0-6ef2ac9bfef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1167819101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13cc9434-8a78-4fc4-be4d-23d90583ee96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30cbe8eb4d0742e3942dc942aa7e4ea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:20:16Z,use_quota=True,user_id='4d37b156e6cf437099d46a395c06251a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0512f9ee-3409-4e7b-9ff8-1c4ed4ba55da),volume_type_id=0512f9ee-3409-4e7b-9ff8-1c4ed4ba55da)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7d4a4e42-d113-4d14-89d3-1c9f288c2a64 tempest-TestInstancesWithCinderVolumes-2123003308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14168ded-1ae7-4952-9b7a-faf1fc57b945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7d4a4e42-d113-4d14-89d3-1c9f288c2a64 tempest-TestInstancesWithCinderVolumes-2123003308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14168ded-1ae7-4952-9b7a-faf1fc57b945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7d4a4e42-d113-4d14-89d3-1c9f288c2a64 tempest-TestInstancesWithCinderVolumes-2123003308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6240a887-9dc3-456d-bd08-614218cc623d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7d4a4e42-d113-4d14-89d3-1c9f288c2a64 tempest-TestInstancesWithCinderVolumes-2123003308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6240a887-9dc3-456d-bd08-614218cc623d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13cc9434-8a78-4fc4-be4d-23d90583ee96', 'volume_name': 'volume-13cc9434-8a78-4fc4-be4d-23d90583ee96', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7d4a4e42-d113-4d14-89d3-1c9f288c2a64 tempest-TestInstancesWithCinderVolumes-2123003308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a15e195a-bbef-47bc-8596-e74739e3b235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7d4a4e42-d113-4d14-89d3-1c9f288c2a64 tempest-TestInstancesWithCinderVolumes-2123003308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a15e195a-bbef-47bc-8596-e74739e3b235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7d4a4e42-d113-4d14-89d3-1c9f288c2a64 tempest-TestInstancesWithCinderVolumes-2123003308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4182ec9c-2a13-4244-b0f2-92fe7a3de81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:15 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-7d4a4e42-d113-4d14-89d3-1c9f288c2a64 tempest-TestInstancesWithCinderVolumes-2123003308 None] Volume 13cc9434-8a78-4fc4-be4d-23d90583ee96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13cc9434-8a78-4fc4-be4d-23d90583ee96', 'volume_size': 1} Sep 03 11:20:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7d4a4e42-d113-4d14-89d3-1c9f288c2a64 tempest-TestInstancesWithCinderVolumes-2123003308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:20:16 devstack sudo[96427]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e43b5adf-9f2e-42e8-999f-cb330145cfa5 tempest-TestInstancesWithCinderVolumes-2123003308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4d6464e4-d026-42c7-b5d1-7d8912ddfe90" returned: 0 in 0.424s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:16 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e43b5adf-9f2e-42e8-999f-cb330145cfa5 tempest-TestInstancesWithCinderVolumes-2123003308 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:20:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e43b5adf-9f2e-42e8-999f-cb330145cfa5 tempest-TestInstancesWithCinderVolumes-2123003308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:20:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a0a759fa-9d6c-4f35-b3c3-4f51a26ec5ac tempest-GroupsV314Test-514744745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.083s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:20:16 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a0a759fa-9d6c-4f35-b3c3-4f51a26ec5ac tempest-GroupsV314Test-514744745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7a55ba64-1c1e-4826-840f-dd9151fe6276,created_at=2026-09-03T09:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-236041534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7a55ba64-1c1e-4826-840f-dd9151fe6276,host='devstack@QuobyteHD#QuobyteHD',id=1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e96f4040cbbd480d8d275f8cdaece056',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:20:16Z,use_quota=True,user_id='0652a10225314bef9e89014082fbfb8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(766fd3ea-5462-4f79-985a-e66cb3c024ee),volume_type_id=766fd3ea-5462-4f79-985a-e66cb3c024ee)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:20:16 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-a0a759fa-9d6c-4f35-b3c3-4f51a26ec5ac tempest-GroupsV314Test-514744745 None] Creating volume 1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:20:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a0a759fa-9d6c-4f35-b3c3-4f51a26ec5ac tempest-GroupsV314Test-514744745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:20:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a0a759fa-9d6c-4f35-b3c3-4f51a26ec5ac tempest-GroupsV314Test-514744745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:20:16 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a0a759fa-9d6c-4f35-b3c3-4f51a26ec5ac tempest-GroupsV314Test-514744745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:20:16 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a0a759fa-9d6c-4f35-b3c3-4f51a26ec5ac tempest-GroupsV314Test-514744745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:20:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a0a759fa-9d6c-4f35-b3c3-4f51a26ec5ac tempest-GroupsV314Test-514744745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:20:16 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a0a759fa-9d6c-4f35-b3c3-4f51a26ec5ac tempest-GroupsV314Test-514744745 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:20:16 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-a0a759fa-9d6c-4f35-b3c3-4f51a26ec5ac tempest-GroupsV314Test-514744745 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:20:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a0a759fa-9d6c-4f35-b3c3-4f51a26ec5ac tempest-GroupsV314Test-514744745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:16 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e43b5adf-9f2e-42e8-999f-cb330145cfa5 tempest-TestInstancesWithCinderVolumes-2123003308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7cfd4c1d-2a40-4dab-a479-60f0ed4f183b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d6464e4-d026-42c7-b5d1-7d8912ddfe90', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:16 devstack sudo[96430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0 1073741824 Sep 03 11:20:16 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e43b5adf-9f2e-42e8-999f-cb330145cfa5 tempest-TestInstancesWithCinderVolumes-2123003308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aee677db-f996-4679-a638-77172c50d38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:16 devstack sudo[96430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:16 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-e43b5adf-9f2e-42e8-999f-cb330145cfa5 tempest-TestInstancesWithCinderVolumes-2123003308 None] Volume volume-4d6464e4-d026-42c7-b5d1-7d8912ddfe90 (4d6464e4-d026-42c7-b5d1-7d8912ddfe90): created successfully Sep 03 11:20:16 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e43b5adf-9f2e-42e8-999f-cb330145cfa5 tempest-TestInstancesWithCinderVolumes-2123003308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aee677db-f996-4679-a638-77172c50d38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:16 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e43b5adf-9f2e-42e8-999f-cb330145cfa5 tempest-TestInstancesWithCinderVolumes-2123003308 None] Flow 'volume_create_manager' (a32496de-8160-4f92-9ff0-b898fd1daab9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:20:16 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-e43b5adf-9f2e-42e8-999f-cb330145cfa5 tempest-TestInstancesWithCinderVolumes-2123003308 None] Created volume successfully. Sep 03 11:20:16 devstack sudo[96430]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a0a759fa-9d6c-4f35-b3c3-4f51a26ec5ac tempest-GroupsV314Test-514744745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0 1073741824" returned: 0 in 0.665s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a0a759fa-9d6c-4f35-b3c3-4f51a26ec5ac tempest-GroupsV314Test-514744745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:16 devstack sudo[96439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0 Sep 03 11:20:16 devstack sudo[96439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Flow 'volume_create_manager' (af380d75-1d54-469c-bbef-ae823c6e91bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad409217-d870-4e01-8020-a10f3bbbf229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad409217-d870-4e01-8020-a10f3bbbf229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-618785189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d311a2f-d0a7-4f76-b40e-a9ccc15790d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30cbe8eb4d0742e3942dc942aa7e4ea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:20:17Z,use_quota=True,user_id='4d37b156e6cf437099d46a395c06251a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04c81815-d88b-4a4f-b46b-6560a7c9c486),volume_type_id=04c81815-d88b-4a4f-b46b-6560a7c9c486)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98e37ec5-4fe9-4c43-888a-81f4945ec784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98e37ec5-4fe9-4c43-888a-81f4945ec784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdebd028-2621-4cfa-aa47-9f5fe604876d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG cinder.image.glance [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Creating Keystone auth plugin from conf {{(pid=87038) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 11:20:17 devstack sudo[96439]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a0a759fa-9d6c-4f35-b3c3-4f51a26ec5ac tempest-GroupsV314Test-514744745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0" returned: 0 in 0.356s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a0a759fa-9d6c-4f35-b3c3-4f51a26ec5ac tempest-GroupsV314Test-514744745 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a0a759fa-9d6c-4f35-b3c3-4f51a26ec5ac tempest-GroupsV314Test-514744745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7d4a4e42-d113-4d14-89d3-1c9f288c2a64 tempest-TestInstancesWithCinderVolumes-2123003308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.149s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7d4a4e42-d113-4d14-89d3-1c9f288c2a64 tempest-TestInstancesWithCinderVolumes-2123003308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:20:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1167819101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13cc9434-8a78-4fc4-be4d-23d90583ee96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30cbe8eb4d0742e3942dc942aa7e4ea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:20:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:20:16Z,use_quota=True,user_id='4d37b156e6cf437099d46a395c06251a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0512f9ee-3409-4e7b-9ff8-1c4ed4ba55da),volume_type_id=0512f9ee-3409-4e7b-9ff8-1c4ed4ba55da)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-7d4a4e42-d113-4d14-89d3-1c9f288c2a64 tempest-TestInstancesWithCinderVolumes-2123003308 None] Creating volume 13cc9434-8a78-4fc4-be4d-23d90583ee96 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7d4a4e42-d113-4d14-89d3-1c9f288c2a64 tempest-TestInstancesWithCinderVolumes-2123003308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7d4a4e42-d113-4d14-89d3-1c9f288c2a64 tempest-TestInstancesWithCinderVolumes-2123003308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7d4a4e42-d113-4d14-89d3-1c9f288c2a64 tempest-TestInstancesWithCinderVolumes-2123003308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7d4a4e42-d113-4d14-89d3-1c9f288c2a64 tempest-TestInstancesWithCinderVolumes-2123003308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7d4a4e42-d113-4d14-89d3-1c9f288c2a64 tempest-TestInstancesWithCinderVolumes-2123003308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7d4a4e42-d113-4d14-89d3-1c9f288c2a64 tempest-TestInstancesWithCinderVolumes-2123003308 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:20:17 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-7d4a4e42-d113-4d14-89d3-1c9f288c2a64 tempest-TestInstancesWithCinderVolumes-2123003308 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7d4a4e42-d113-4d14-89d3-1c9f288c2a64 tempest-TestInstancesWithCinderVolumes-2123003308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-13cc9434-8a78-4fc4-be4d-23d90583ee96 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a0a759fa-9d6c-4f35-b3c3-4f51a26ec5ac tempest-GroupsV314Test-514744745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71beee07-0cec-4190-8a6f-eb6c8aa8426a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a0a759fa-9d6c-4f35-b3c3-4f51a26ec5ac tempest-GroupsV314Test-514744745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87d459ed-75e0-4069-83dd-2f4992c2e813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:17 devstack sudo[96442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-13cc9434-8a78-4fc4-be4d-23d90583ee96 1073741824 Sep 03 11:20:17 devstack sudo[96442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:17 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-a0a759fa-9d6c-4f35-b3c3-4f51a26ec5ac tempest-GroupsV314Test-514744745 None] Volume volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0 (1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0): created successfully Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a0a759fa-9d6c-4f35-b3c3-4f51a26ec5ac tempest-GroupsV314Test-514744745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87d459ed-75e0-4069-83dd-2f4992c2e813) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a0a759fa-9d6c-4f35-b3c3-4f51a26ec5ac tempest-GroupsV314Test-514744745 None] Flow 'volume_create_manager' (749dc10e-b8ae-4eed-a699-e2a2ef2be2f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:20:17 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-a0a759fa-9d6c-4f35-b3c3-4f51a26ec5ac tempest-GroupsV314Test-514744745 None] Created volume successfully. Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdebd028-2621-4cfa-aa47-9f5fe604876d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2d311a2f-d0a7-4f76-b40e-a9ccc15790d0', 'volume_name': 'volume-2d311a2f-d0a7-4f76-b40e-a9ccc15790d0', 'volume_size': 1, 'image_id': '711a3bc6-f4d3-44e1-9e3c-303c3f2804ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/711a3bc6-f4d3-44e1-9e3c-303c3f2804ae', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--577507297', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '30cbe8eb4d0742e3942dc942aa7e4ea0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '711a3bc6-f4d3-44e1-9e3c-303c3f2804ae', 'created_at': datetime.datetime(2026, 9, 3, 9, 20, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 20, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/711a3bc6-f4d3-44e1-9e3c-303c3f2804ae/file', 'properties': {}}, 'image_service': }' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95f59a7d-f64d-4cbd-ac92-0ec861377c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95f59a7d-f64d-4cbd-ac92-0ec861377c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f5f211e-451e-48d8-aa6f-ffcb6782a8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:17 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Volume 2d311a2f-d0a7-4f76-b40e-a9ccc15790d0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2d311a2f-d0a7-4f76-b40e-a9ccc15790d0', 'volume_size': 1, 'image_id': '711a3bc6-f4d3-44e1-9e3c-303c3f2804ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/711a3bc6-f4d3-44e1-9e3c-303c3f2804ae', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--577507297', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '30cbe8eb4d0742e3942dc942aa7e4ea0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '711a3bc6-f4d3-44e1-9e3c-303c3f2804ae', 'created_at': datetime.datetime(2026, 9, 3, 9, 20, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 20, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/711a3bc6-f4d3-44e1-9e3c-303c3f2804ae/file', 'properties': {}}, 'image_service': } Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Trying to clone 2d311a2f-d0a7-4f76-b40e-a9ccc15790d0 from image 711a3bc6-f4d3-44e1-9e3c-303c3f2804ae at location (None, [{'url': 'file:///opt/stack/data/glance/images/711a3bc6-f4d3-44e1-9e3c-303c3f2804ae', 'metadata': {}}]). {{(pid=87038) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 11:20:17 devstack sudo[96442]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7d4a4e42-d113-4d14-89d3-1c9f288c2a64 tempest-TestInstancesWithCinderVolumes-2123003308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-13cc9434-8a78-4fc4-be4d-23d90583ee96 1073741824" returned: 0 in 0.641s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7d4a4e42-d113-4d14-89d3-1c9f288c2a64 tempest-TestInstancesWithCinderVolumes-2123003308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-13cc9434-8a78-4fc4-be4d-23d90583ee96 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:17 devstack sudo[96449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-13cc9434-8a78-4fc4-be4d-23d90583ee96 Sep 03 11:20:17 devstack sudo[96449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:20:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:18 devstack sudo[96451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:20:18 devstack sudo[96451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:18 devstack sudo[96449]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7d4a4e42-d113-4d14-89d3-1c9f288c2a64 tempest-TestInstancesWithCinderVolumes-2123003308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-13cc9434-8a78-4fc4-be4d-23d90583ee96" returned: 0 in 0.421s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:18 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7d4a4e42-d113-4d14-89d3-1c9f288c2a64 tempest-TestInstancesWithCinderVolumes-2123003308 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:20:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7d4a4e42-d113-4d14-89d3-1c9f288c2a64 tempest-TestInstancesWithCinderVolumes-2123003308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:20:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7d4a4e42-d113-4d14-89d3-1c9f288c2a64 tempest-TestInstancesWithCinderVolumes-2123003308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4182ec9c-2a13-4244-b0f2-92fe7a3de81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13cc9434-8a78-4fc4-be4d-23d90583ee96', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7d4a4e42-d113-4d14-89d3-1c9f288c2a64 tempest-TestInstancesWithCinderVolumes-2123003308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b372241-5a1a-42ea-8e4f-ad3152c9d467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:18 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-7d4a4e42-d113-4d14-89d3-1c9f288c2a64 tempest-TestInstancesWithCinderVolumes-2123003308 None] Volume volume-13cc9434-8a78-4fc4-be4d-23d90583ee96 (13cc9434-8a78-4fc4-be4d-23d90583ee96): created successfully Sep 03 11:20:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7d4a4e42-d113-4d14-89d3-1c9f288c2a64 tempest-TestInstancesWithCinderVolumes-2123003308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b372241-5a1a-42ea-8e4f-ad3152c9d467) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7d4a4e42-d113-4d14-89d3-1c9f288c2a64 tempest-TestInstancesWithCinderVolumes-2123003308 None] Flow 'volume_create_manager' (33ded9b1-f4f5-4a89-9bdf-ddff2abbcf71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:20:18 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-7d4a4e42-d113-4d14-89d3-1c9f288c2a64 tempest-TestInstancesWithCinderVolumes-2123003308 None] Created volume successfully. Sep 03 11:20:18 devstack sudo[96451]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.563s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:18 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:20:18 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:20:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread count: 28 {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:20:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread info: [<_MainThread(MainThread, started 139554943000704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:20:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:20:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:20:19 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Cloning volume 1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0 to volume 4e86ccf2-e99d-44c0-8c1f-198c3ce0993b Sep 03 11:20:19 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Creating offline snapshot a192727e-2353-4ed9-a16d-e88a55bdcb41 of volume 1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0 {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:20:19 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[987091da-a15b-46c3-bc60-d38bb7d8d823]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:20:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:19 devstack sudo[96474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0 Sep 03 11:20:19 devstack sudo[96474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:20 devstack sudo[96474]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0" returned: 0 in 0.408s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0.a192727e-2353-4ed9-a16d-e88a55bdcb41 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:20 devstack sudo[96479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0.a192727e-2353-4ed9-a16d-e88a55bdcb41 1G Sep 03 11:20:20 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:20 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-09fc08a5-e31d-4beb-b07a-1cfad81800c0 tempest-VolumesTransfersV355Test-563144422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:20:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-09fc08a5-e31d-4beb-b07a-1cfad81800c0 tempest-VolumesTransfersV355Test-563144422 None] Flow 'volume_create_manager' (8d824775-8dcd-4cd4-bfe4-9864e3c1af09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:20:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-09fc08a5-e31d-4beb-b07a-1cfad81800c0 tempest-VolumesTransfersV355Test-563144422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb51019-b2c4-404d-83ef-c32a1507e977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-09fc08a5-e31d-4beb-b07a-1cfad81800c0 tempest-VolumesTransfersV355Test-563144422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deb51019-b2c4-404d-83ef-c32a1507e977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1402804952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6d70311-61fc-4dc8-be9d-1d6fbc4af992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f11ac288584f6a9c703dfc6c336633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:20:20Z,use_quota=True,user_id='e11478c51a0943edb8fc213826ca3ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-09fc08a5-e31d-4beb-b07a-1cfad81800c0 tempest-VolumesTransfersV355Test-563144422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (202ea094-aa9e-47ef-afa0-cd0d90aa71a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-09fc08a5-e31d-4beb-b07a-1cfad81800c0 tempest-VolumesTransfersV355Test-563144422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (202ea094-aa9e-47ef-afa0-cd0d90aa71a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-09fc08a5-e31d-4beb-b07a-1cfad81800c0 tempest-VolumesTransfersV355Test-563144422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f7fc476-203d-4163-809a-7635d9fa4c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-09fc08a5-e31d-4beb-b07a-1cfad81800c0 tempest-VolumesTransfersV355Test-563144422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f7fc476-203d-4163-809a-7635d9fa4c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6d70311-61fc-4dc8-be9d-1d6fbc4af992', 'volume_name': 'volume-b6d70311-61fc-4dc8-be9d-1d6fbc4af992', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-09fc08a5-e31d-4beb-b07a-1cfad81800c0 tempest-VolumesTransfersV355Test-563144422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d0dd66-3834-41e0-a16c-3a304209b5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-09fc08a5-e31d-4beb-b07a-1cfad81800c0 tempest-VolumesTransfersV355Test-563144422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1d0dd66-3834-41e0-a16c-3a304209b5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-09fc08a5-e31d-4beb-b07a-1cfad81800c0 tempest-VolumesTransfersV355Test-563144422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ad633e-b3fb-4f6a-bb1d-173ef0d29ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:20 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-09fc08a5-e31d-4beb-b07a-1cfad81800c0 tempest-VolumesTransfersV355Test-563144422 None] Volume b6d70311-61fc-4dc8-be9d-1d6fbc4af992: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6d70311-61fc-4dc8-be9d-1d6fbc4af992', 'volume_size': 1} Sep 03 11:20:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-09fc08a5-e31d-4beb-b07a-1cfad81800c0 tempest-VolumesTransfersV355Test-563144422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:20:20 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0.a192727e-2353-4ed9-a16d-e88a55bdcb41 1G" returned: 0 in 0.453s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0.a192727e-2353-4ed9-a16d-e88a55bdcb41 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:20 devstack sudo[96485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0.a192727e-2353-4ed9-a16d-e88a55bdcb41 Sep 03 11:20:20 devstack sudo[96485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:21 devstack sudo[96485]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0.a192727e-2353-4ed9-a16d-e88a55bdcb41" returned: 0 in 0.350s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:21 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0.a192727e-2353-4ed9-a16d-e88a55bdcb41 is being set with open permissions: ugo+rw: NotImplementedError Sep 03 11:20:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0.a192727e-2353-4ed9-a16d-e88a55bdcb41 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:21 devstack sudo[96491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0.a192727e-2353-4ed9-a16d-e88a55bdcb41 Sep 03 11:20:21 devstack sudo[96491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:21 devstack sudo[96491]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0.a192727e-2353-4ed9-a16d-e88a55bdcb41" returned: 0 in 0.285s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:21 devstack sudo[96494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0.info Sep 03 11:20:21 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:21 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0.info" returned: 0 in 0.280s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:21 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0.info is being set with open permissions: ugo+rw: NotImplementedError Sep 03 11:20:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:21 devstack sudo[96497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0.info Sep 03 11:20:21 devstack sudo[96497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:22 devstack sudo[96497]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0.info" returned: 0 in 0.253s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:22 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Acquiring lock "cinder-quobyte-4e86ccf2-e99d-44c0-8c1f-198c3ce0993b" by "_copy_volume_from_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:20:22 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Lock "cinder-quobyte-4e86ccf2-e99d-44c0-8c1f-198c3ce0993b" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:20:22 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] snapshot: a192727e-2353-4ed9-a16d-e88a55bdcb41, volume: 4e86ccf2-e99d-44c0-8c1f-198c3ce0993b, {{(pid=87038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 11:20:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:20:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:20:22 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:20:22 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:20:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:20:22 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[5303ed15-e174-4782-9e0b-6af967fec44a]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:20:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0.a192727e-2353-4ed9-a16d-e88a55bdcb41 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:22 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_711a3bc6-f4d3-44e1-9e3c-303c3f2804ae_yi3e3kwfdevstack@QuobyteHD, size 20.69 MB, duration 4.56 sec {{(pid=87038) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 11:20:22 devstack cinder-volume[87038]: INFO cinder.image.image_utils [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Image download 20.69 MB at 4.54 MB/s Sep 03 11:20:22 devstack sudo[96500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0.a192727e-2353-4ed9-a16d-e88a55bdcb41 Sep 03 11:20:22 devstack sudo[96500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:22 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[2163c4c3-46a1-4f0e-9d09-b50da60f4c1a]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:20:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_711a3bc6-f4d3-44e1-9e3c-303c3f2804ae_yi3e3kwfdevstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:22 devstack sudo[96502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_711a3bc6-f4d3-44e1-9e3c-303c3f2804ae_yi3e3kwfdevstack@QuobyteHD Sep 03 11:20:22 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:22 devstack sudo[96500]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0.a192727e-2353-4ed9-a16d-e88a55bdcb41" returned: 0 in 0.450s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:22 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:20:22 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[c482056a-07a5-4e14-988a-11460a760158]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:20:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:22 devstack sudo[96508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0 Sep 03 11:20:22 devstack sudo[96508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:22 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_711a3bc6-f4d3-44e1-9e3c-303c3f2804ae_yi3e3kwfdevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:22 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Temporary image 711a3bc6-f4d3-44e1-9e3c-303c3f2804ae is fetched for user 4d37b156e6cf437099d46a395c06251a. {{(pid=87038) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 11:20:23 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b0bdf6-bb40-4693-9663-8151ab1329f2]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:20:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_711a3bc6-f4d3-44e1-9e3c-303c3f2804ae_yi3e3kwfdevstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:23 devstack sudo[96508]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0" returned: 0 in 0.403s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:23 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0 {{(pid=87038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 11:20:23 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Creating direct copy from snapshot {{(pid=87038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 11:20:23 devstack cinder-volume[87038]: DEBUG cinder.utils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Path /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4e86ccf2-e99d-44c0-8c1f-198c3ce0993b not found in is_blk_device check {{(pid=87038) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 11:20:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4e86ccf2-e99d-44c0-8c1f-198c3ce0993b {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:23 devstack sudo[96517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4e86ccf2-e99d-44c0-8c1f-198c3ce0993b Sep 03 11:20:23 devstack sudo[96517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:23 devstack sudo[96516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_711a3bc6-f4d3-44e1-9e3c-303c3f2804ae_yi3e3kwfdevstack@QuobyteHD Sep 03 11:20:23 devstack sudo[96516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:23 devstack sudo[96516]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_711a3bc6-f4d3-44e1-9e3c-303c3f2804ae_yi3e3kwfdevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:20:29 devstack sudo[96517]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4e86ccf2-e99d-44c0-8c1f-198c3ce0993b" returned: 0 in 6.705s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:29 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Image conversion details: src /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0, size 1024.00 MB, duration 6.71 sec, destination /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4e86ccf2-e99d-44c0-8c1f-198c3ce0993b {{(pid=87038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:20:29 devstack cinder-volume[87038]: INFO cinder.image.image_utils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Converted 1024.00 MB image at 152.70 MB/s Sep 03 11:20:29 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4e86ccf2-e99d-44c0-8c1f-198c3ce0993b is being set with open permissions: ugo+rw: NotImplementedError Sep 03 11:20:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4e86ccf2-e99d-44c0-8c1f-198c3ce0993b {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:29 devstack sudo[96605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4e86ccf2-e99d-44c0-8c1f-198c3ce0993b Sep 03 11:20:29 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:30 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4e86ccf2-e99d-44c0-8c1f-198c3ce0993b" returned: 0 in 0.292s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Lock "cinder-quobyte-4e86ccf2-e99d-44c0-8c1f-198c3ce0993b" released by "_copy_volume_from_snapshot" :: held 7.943s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:20:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Acquiring lock "cinder-quobyte-a192727e-2353-4ed9-a16d-e88a55bdcb41" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:20:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Lock "cinder-quobyte-a192727e-2353-4ed9-a16d-e88a55bdcb41" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:20:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Deleting offline snapshot a192727e-2353-4ed9-a16d-e88a55bdcb41 of volume 1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:20:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] snapshot_file for this snap is: volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0.a192727e-2353-4ed9-a16d-e88a55bdcb41 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:20:30 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[c199bc0c-9f33-4c64-96c8-a82409c173bb]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:20:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0.a192727e-2353-4ed9-a16d-e88a55bdcb41 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:30 devstack sudo[96608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0.a192727e-2353-4ed9-a16d-e88a55bdcb41 Sep 03 11:20:30 devstack sudo[96608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:30 devstack sudo[96608]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0.a192727e-2353-4ed9-a16d-e88a55bdcb41" returned: 0 in 0.396s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:20:30 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5ac6b77-2250-4f92-bdff-e8fa98f355c3]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:20:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:30 devstack sudo[96614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0 Sep 03 11:20:30 devstack sudo[96614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:31 devstack sudo[96614]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0" returned: 0 in 0.593s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0.a192727e-2353-4ed9-a16d-e88a55bdcb41 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:31 devstack sudo[96620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0.a192727e-2353-4ed9-a16d-e88a55bdcb41 Sep 03 11:20:31 devstack sudo[96620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:31 devstack sudo[96620]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0.a192727e-2353-4ed9-a16d-e88a55bdcb41" returned: 0 in 0.337s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0.a192727e-2353-4ed9-a16d-e88a55bdcb41 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:31 devstack sudo[96626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0.a192727e-2353-4ed9-a16d-e88a55bdcb41 Sep 03 11:20:31 devstack sudo[96626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:31 devstack sudo[96626]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0.a192727e-2353-4ed9-a16d-e88a55bdcb41" returned: 0 in 0.263s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:31 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Lock "cinder-quobyte-a192727e-2353-4ed9-a16d-e88a55bdcb41" released by "_delete_snapshot" :: held 1.709s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:20:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.475s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:20:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-09fc08a5-e31d-4beb-b07a-1cfad81800c0 tempest-VolumesTransfersV355Test-563144422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.513s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:20:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-09fc08a5-e31d-4beb-b07a-1cfad81800c0 tempest-VolumesTransfersV355Test-563144422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:20:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1402804952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6d70311-61fc-4dc8-be9d-1d6fbc4af992,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f11ac288584f6a9c703dfc6c336633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:20:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:20:20Z,use_quota=True,user_id='e11478c51a0943edb8fc213826ca3ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:20:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-09fc08a5-e31d-4beb-b07a-1cfad81800c0 tempest-VolumesTransfersV355Test-563144422 None] Creating volume b6d70311-61fc-4dc8-be9d-1d6fbc4af992 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:20:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-09fc08a5-e31d-4beb-b07a-1cfad81800c0 tempest-VolumesTransfersV355Test-563144422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:20:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-09fc08a5-e31d-4beb-b07a-1cfad81800c0 tempest-VolumesTransfersV355Test-563144422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:20:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-09fc08a5-e31d-4beb-b07a-1cfad81800c0 tempest-VolumesTransfersV355Test-563144422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:20:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-09fc08a5-e31d-4beb-b07a-1cfad81800c0 tempest-VolumesTransfersV355Test-563144422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:20:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-09fc08a5-e31d-4beb-b07a-1cfad81800c0 tempest-VolumesTransfersV355Test-563144422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:20:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-09fc08a5-e31d-4beb-b07a-1cfad81800c0 tempest-VolumesTransfersV355Test-563144422 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:20:31 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-09fc08a5-e31d-4beb-b07a-1cfad81800c0 tempest-VolumesTransfersV355Test-563144422 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:20:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-09fc08a5-e31d-4beb-b07a-1cfad81800c0 tempest-VolumesTransfersV355Test-563144422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b6d70311-61fc-4dc8-be9d-1d6fbc4af992 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:31 devstack sudo[96629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b6d70311-61fc-4dc8-be9d-1d6fbc4af992 1073741824 Sep 03 11:20:31 devstack sudo[96629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:32 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-4b3eea5c-3200-4e0e-bdea-de0114d4a861 tempest-GroupsV314Test-514744745 None] Create group from source-group-7a55ba64-1c1e-4826-840f-dd9151fe6276 completed successfully. Sep 03 11:20:32 devstack sudo[96629]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-09fc08a5-e31d-4beb-b07a-1cfad81800c0 tempest-VolumesTransfersV355Test-563144422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b6d70311-61fc-4dc8-be9d-1d6fbc4af992 1073741824" returned: 0 in 0.447s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-09fc08a5-e31d-4beb-b07a-1cfad81800c0 tempest-VolumesTransfersV355Test-563144422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b6d70311-61fc-4dc8-be9d-1d6fbc4af992 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:32 devstack sudo[96638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b6d70311-61fc-4dc8-be9d-1d6fbc4af992 Sep 03 11:20:32 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:32 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-9659c3a1-5422-44c7-b9db-b435c3f12009 tempest-GroupsV314Test-514744745 None] Acquiring lock "cinder-quobyte-4e86ccf2-e99d-44c0-8c1f-198c3ce0993b" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:20:32 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-9659c3a1-5422-44c7-b9db-b435c3f12009 tempest-GroupsV314Test-514744745 None] Lock "cinder-quobyte-4e86ccf2-e99d-44c0-8c1f-198c3ce0993b" acquired by "delete_volume" :: waited 0.016s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:20:32 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[3263acd7-9f9f-4e45-8ca3-bd1aa993f105]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:20:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9659c3a1-5422-44c7-b9db-b435c3f12009 tempest-GroupsV314Test-514744745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4e86ccf2-e99d-44c0-8c1f-198c3ce0993b {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:32 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-09fc08a5-e31d-4beb-b07a-1cfad81800c0 tempest-VolumesTransfersV355Test-563144422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b6d70311-61fc-4dc8-be9d-1d6fbc4af992" returned: 0 in 0.291s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-09fc08a5-e31d-4beb-b07a-1cfad81800c0 tempest-VolumesTransfersV355Test-563144422 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:20:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-09fc08a5-e31d-4beb-b07a-1cfad81800c0 tempest-VolumesTransfersV355Test-563144422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:20:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.242s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:20:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:20:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-618785189',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d311a2f-d0a7-4f76-b40e-a9ccc15790d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30cbe8eb4d0742e3942dc942aa7e4ea0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:20:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:20:17Z,use_quota=True,user_id='4d37b156e6cf437099d46a395c06251a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(04c81815-d88b-4a4f-b46b-6560a7c9c486),volume_type_id=04c81815-d88b-4a4f-b46b-6560a7c9c486)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:20:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Creating volume 2d311a2f-d0a7-4f76-b40e-a9ccc15790d0 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:20:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:20:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:20:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:20:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:20:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:20:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:20:32 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:20:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2d311a2f-d0a7-4f76-b40e-a9ccc15790d0 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-09fc08a5-e31d-4beb-b07a-1cfad81800c0 tempest-VolumesTransfersV355Test-563144422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ad633e-b3fb-4f6a-bb1d-173ef0d29ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6d70311-61fc-4dc8-be9d-1d6fbc4af992', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:32 devstack sudo[96642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2d311a2f-d0a7-4f76-b40e-a9ccc15790d0 1073741824 Sep 03 11:20:32 devstack sudo[96642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-09fc08a5-e31d-4beb-b07a-1cfad81800c0 tempest-VolumesTransfersV355Test-563144422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (996dc6d8-e870-450d-be65-bfd1a9461701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:32 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-09fc08a5-e31d-4beb-b07a-1cfad81800c0 tempest-VolumesTransfersV355Test-563144422 None] Volume volume-b6d70311-61fc-4dc8-be9d-1d6fbc4af992 (b6d70311-61fc-4dc8-be9d-1d6fbc4af992): created successfully Sep 03 11:20:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-09fc08a5-e31d-4beb-b07a-1cfad81800c0 tempest-VolumesTransfersV355Test-563144422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (996dc6d8-e870-450d-be65-bfd1a9461701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:32 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4e86ccf2-e99d-44c0-8c1f-198c3ce0993b Sep 03 11:20:32 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-09fc08a5-e31d-4beb-b07a-1cfad81800c0 tempest-VolumesTransfersV355Test-563144422 None] Flow 'volume_create_manager' (8d824775-8dcd-4cd4-bfe4-9864e3c1af09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:20:32 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-09fc08a5-e31d-4beb-b07a-1cfad81800c0 tempest-VolumesTransfersV355Test-563144422 None] Created volume successfully. Sep 03 11:20:33 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9659c3a1-5422-44c7-b9db-b435c3f12009 tempest-GroupsV314Test-514744745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4e86ccf2-e99d-44c0-8c1f-198c3ce0993b" returned: 0 in 0.451s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9659c3a1-5422-44c7-b9db-b435c3f12009 tempest-GroupsV314Test-514744745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4e86ccf2-e99d-44c0-8c1f-198c3ce0993b {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:33 devstack sudo[96652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4e86ccf2-e99d-44c0-8c1f-198c3ce0993b Sep 03 11:20:33 devstack sudo[96652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:33 devstack sudo[96642]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2d311a2f-d0a7-4f76-b40e-a9ccc15790d0 1073741824" returned: 0 in 0.560s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2d311a2f-d0a7-4f76-b40e-a9ccc15790d0 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:33 devstack sudo[96656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2d311a2f-d0a7-4f76-b40e-a9ccc15790d0 Sep 03 11:20:33 devstack sudo[96656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:33 devstack sudo[96652]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9659c3a1-5422-44c7-b9db-b435c3f12009 tempest-GroupsV314Test-514744745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4e86ccf2-e99d-44c0-8c1f-198c3ce0993b" returned: 0 in 0.326s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:33 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-9659c3a1-5422-44c7-b9db-b435c3f12009 tempest-GroupsV314Test-514744745 None] Lock "cinder-quobyte-4e86ccf2-e99d-44c0-8c1f-198c3ce0993b" released by "delete_volume" :: held 0.831s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:20:33 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-9659c3a1-5422-44c7-b9db-b435c3f12009 tempest-GroupsV314Test-514744745 None] Created reservations ['2f39117b-69af-4441-8be7-c00935c0e546'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:20:33 devstack cinder-volume[87038]: WARNING cinder.quota [None req-9659c3a1-5422-44c7-b9db-b435c3f12009 tempest-GroupsV314Test-514744745 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-450004769 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-450004769, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:20:33 devstack cinder-volume[87038]: WARNING cinder.quota [None req-9659c3a1-5422-44c7-b9db-b435c3f12009 tempest-GroupsV314Test-514744745 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-450004769 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-450004769, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:20:33 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-9659c3a1-5422-44c7-b9db-b435c3f12009 tempest-GroupsV314Test-514744745 None] Created reservations ['c876565d-0eda-447b-b62c-ca3fe524d4c0', 'b148b3f3-23ba-4c50-9da3-6a95556d4eca', '463640f3-8b84-4cde-be10-0493e99c4189', '74a43a0e-6845-47ad-9068-5ae030957f77'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:20:33 devstack sudo[96656]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2d311a2f-d0a7-4f76-b40e-a9ccc15790d0" returned: 0 in 0.323s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:33 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] <== create_volume: return (931ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:20:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:20:33 devstack cinder-volume[87038]: DEBUG cinder.volume.volume_utils [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Attempting download of 711a3bc6-f4d3-44e1-9e3c-303c3f2804ae ((None, [{'url': 'file:///opt/stack/data/glance/images/711a3bc6-f4d3-44e1-9e3c-303c3f2804ae', 'metadata': {}}])) to volume 2d311a2f-d0a7-4f76-b40e-a9ccc15790d0. {{(pid=87038) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 11:20:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9659c3a1-5422-44c7-b9db-b435c3f12009 tempest-GroupsV314Test-514744745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:20:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9659c3a1-5422-44c7-b9db-b435c3f12009 tempest-GroupsV314Test-514744745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:20:33 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-9659c3a1-5422-44c7-b9db-b435c3f12009 tempest-GroupsV314Test-514744745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:20:33 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-9659c3a1-5422-44c7-b9db-b435c3f12009 tempest-GroupsV314Test-514744745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:20:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9659c3a1-5422-44c7-b9db-b435c3f12009 tempest-GroupsV314Test-514744745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:20:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9659c3a1-5422-44c7-b9db-b435c3f12009 tempest-GroupsV314Test-514744745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:33 devstack sudo[96660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:20:33 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:34 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[a011f022-b374-42fb-99cc-6000337e1e84]: (4, 'raw') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:20:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_711a3bc6-f4d3-44e1-9e3c-303c3f2804ae_mq7dsfnm {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:34 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9659c3a1-5422-44c7-b9db-b435c3f12009 tempest-GroupsV314Test-514744745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.375s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:34 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-9659c3a1-5422-44c7-b9db-b435c3f12009 tempest-GroupsV314Test-514744745 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:20:34 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-9659c3a1-5422-44c7-b9db-b435c3f12009 tempest-GroupsV314Test-514744745 None] Delete group completed successfully. Sep 03 11:20:34 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-90a4abf6-aea1-4194-8cd4-4fd2a79d9e20 tempest-VolumesTransfersV355Test-1757391290 None] Transfer volume completed successfully. Sep 03 11:20:34 devstack sudo[96665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_711a3bc6-f4d3-44e1-9e3c-303c3f2804ae_mq7dsfnm Sep 03 11:20:34 devstack sudo[96665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:34 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-9db67764-cef2-4bcf-a353-7fc2f7fb3c5c tempest-GroupsV314Test-514744745 None] Acquiring lock "cinder-quobyte-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:20:34 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-9db67764-cef2-4bcf-a353-7fc2f7fb3c5c tempest-GroupsV314Test-514744745 None] Lock "cinder-quobyte-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0" acquired by "delete_volume" :: waited 0.033s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:20:34 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[099081c0-b39a-4c50-8e96-f71d1cba9cb3]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:20:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9db67764-cef2-4bcf-a353-7fc2f7fb3c5c tempest-GroupsV314Test-514744745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:34 devstack sudo[96665]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_711a3bc6-f4d3-44e1-9e3c-303c3f2804ae_mq7dsfnm" returned: 0 in 0.636s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_711a3bc6-f4d3-44e1-9e3c-303c3f2804ae_mq7dsfnm {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:34 devstack sudo[96667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0 Sep 03 11:20:34 devstack sudo[96667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:34 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-37345670-df02-4573-b0cf-fdeeb426a24c tempest-VolumesTransfersV355Test-423595047 None] Acquiring lock "cinder-b6d70311-61fc-4dc8-be9d-1d6fbc4af992-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:20:34 devstack sudo[96670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_711a3bc6-f4d3-44e1-9e3c-303c3f2804ae_mq7dsfnm Sep 03 11:20:34 devstack sudo[96670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:34 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-37345670-df02-4573-b0cf-fdeeb426a24c tempest-VolumesTransfersV355Test-423595047 None] Lock "cinder-b6d70311-61fc-4dc8-be9d-1d6fbc4af992-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:20:34 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-37345670-df02-4573-b0cf-fdeeb426a24c tempest-VolumesTransfersV355Test-423595047 None] Acquiring lock "cinder-quobyte-b6d70311-61fc-4dc8-be9d-1d6fbc4af992" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:20:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-37345670-df02-4573-b0cf-fdeeb426a24c tempest-VolumesTransfersV355Test-423595047 None] Lock "cinder-quobyte-b6d70311-61fc-4dc8-be9d-1d6fbc4af992" acquired by "delete_volume" :: waited 0.037s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:20:35 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[8afd5066-dda5-48ae-8e6a-715261343fa5]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:20:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-37345670-df02-4573-b0cf-fdeeb426a24c tempest-VolumesTransfersV355Test-423595047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b6d70311-61fc-4dc8-be9d-1d6fbc4af992 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:35 devstack sudo[96667]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9db67764-cef2-4bcf-a353-7fc2f7fb3c5c tempest-GroupsV314Test-514744745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0" returned: 0 in 0.539s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9db67764-cef2-4bcf-a353-7fc2f7fb3c5c tempest-GroupsV314Test-514744745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:35 devstack sudo[96684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0 Sep 03 11:20:35 devstack sudo[96684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:35 devstack sudo[96670]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:35 devstack sudo[96680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b6d70311-61fc-4dc8-be9d-1d6fbc4af992 Sep 03 11:20:35 devstack sudo[96680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_711a3bc6-f4d3-44e1-9e3c-303c3f2804ae_mq7dsfnm" returned: 1 in 0.462s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_711a3bc6-f4d3-44e1-9e3c-303c3f2804ae_mq7dsfnm' failed. Not Retrying. {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:20:35 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed11fb8-d919-4fc2-ac85-21a3b642ad82]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:20:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_711a3bc6-f4d3-44e1-9e3c-303c3f2804ae_yi3e3kwfdevstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:35 devstack sudo[96689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_711a3bc6-f4d3-44e1-9e3c-303c3f2804ae_yi3e3kwfdevstack@QuobyteHD Sep 03 11:20:35 devstack sudo[96689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:35 devstack sudo[96680]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-37345670-df02-4573-b0cf-fdeeb426a24c tempest-VolumesTransfersV355Test-423595047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b6d70311-61fc-4dc8-be9d-1d6fbc4af992" returned: 0 in 0.416s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-37345670-df02-4573-b0cf-fdeeb426a24c tempest-VolumesTransfersV355Test-423595047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b6d70311-61fc-4dc8-be9d-1d6fbc4af992 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:35 devstack sudo[96684]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:35 devstack sudo[96696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b6d70311-61fc-4dc8-be9d-1d6fbc4af992 Sep 03 11:20:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9db67764-cef2-4bcf-a353-7fc2f7fb3c5c tempest-GroupsV314Test-514744745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0" returned: 0 in 0.355s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:35 devstack sudo[96696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-9db67764-cef2-4bcf-a353-7fc2f7fb3c5c tempest-GroupsV314Test-514744745 None] Lock "cinder-quobyte-1d4c6b85-e58a-4b5b-8d40-97bc59eb8ab0" released by "delete_volume" :: held 0.999s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:20:35 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-9db67764-cef2-4bcf-a353-7fc2f7fb3c5c tempest-GroupsV314Test-514744745 None] Created reservations ['33dea8e4-75a0-4b5f-92f2-b75568eef453'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:20:35 devstack sudo[96689]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_711a3bc6-f4d3-44e1-9e3c-303c3f2804ae_yi3e3kwfdevstack@QuobyteHD" returned: 0 in 0.411s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:35 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] 711a3bc6-f4d3-44e1-9e3c-303c3f2804ae was qcow2, converting to qcow2 {{(pid=87038) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 11:20:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_711a3bc6-f4d3-44e1-9e3c-303c3f2804ae_yi3e3kwfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2d311a2f-d0a7-4f76-b40e-a9ccc15790d0 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:35 devstack sudo[96702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_711a3bc6-f4d3-44e1-9e3c-303c3f2804ae_yi3e3kwfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2d311a2f-d0a7-4f76-b40e-a9ccc15790d0 Sep 03 11:20:35 devstack sudo[96702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:35 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-9db67764-cef2-4bcf-a353-7fc2f7fb3c5c tempest-GroupsV314Test-514744745 None] Created reservations ['d9454cba-82a5-47f9-a72a-3aa88eaf35cc', 'db52f372-bbb8-45b0-ab0a-4fddcc9c8b10', '10217ece-bde4-4b04-8f56-53f1cac4658d', '39653838-6e6d-41d2-86d0-dd880026e30d'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:20:35 devstack sudo[96696]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-37345670-df02-4573-b0cf-fdeeb426a24c tempest-VolumesTransfersV355Test-423595047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b6d70311-61fc-4dc8-be9d-1d6fbc4af992" returned: 0 in 0.367s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-37345670-df02-4573-b0cf-fdeeb426a24c tempest-VolumesTransfersV355Test-423595047 None] Lock "cinder-quobyte-b6d70311-61fc-4dc8-be9d-1d6fbc4af992" released by "delete_volume" :: held 0.850s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:20:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9db67764-cef2-4bcf-a353-7fc2f7fb3c5c tempest-GroupsV314Test-514744745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:20:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9db67764-cef2-4bcf-a353-7fc2f7fb3c5c tempest-GroupsV314Test-514744745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:20:35 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-9db67764-cef2-4bcf-a353-7fc2f7fb3c5c tempest-GroupsV314Test-514744745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:20:35 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-9db67764-cef2-4bcf-a353-7fc2f7fb3c5c tempest-GroupsV314Test-514744745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:20:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9db67764-cef2-4bcf-a353-7fc2f7fb3c5c tempest-GroupsV314Test-514744745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:20:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9db67764-cef2-4bcf-a353-7fc2f7fb3c5c tempest-GroupsV314Test-514744745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:35 devstack sudo[96705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:20:35 devstack sudo[96705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:35 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-37345670-df02-4573-b0cf-fdeeb426a24c tempest-VolumesTransfersV355Test-423595047 None] Created reservations ['8181bcf5-b2c3-4488-8a55-4a9b98b34233', 'f98f61b8-168d-401c-bd77-50eb4d0cb5ca', '56ccd971-0109-42e4-bbb3-e850dcccf1f4', '2b431d9d-2826-41b6-aa6c-c6bed067e06c'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:20:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-37345670-df02-4573-b0cf-fdeeb426a24c tempest-VolumesTransfersV355Test-423595047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:20:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-37345670-df02-4573-b0cf-fdeeb426a24c tempest-VolumesTransfersV355Test-423595047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:20:36 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-37345670-df02-4573-b0cf-fdeeb426a24c tempest-VolumesTransfersV355Test-423595047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:20:36 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-37345670-df02-4573-b0cf-fdeeb426a24c tempest-VolumesTransfersV355Test-423595047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:20:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-37345670-df02-4573-b0cf-fdeeb426a24c tempest-VolumesTransfersV355Test-423595047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:20:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-37345670-df02-4573-b0cf-fdeeb426a24c tempest-VolumesTransfersV355Test-423595047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:36 devstack sudo[96711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:20:36 devstack sudo[96711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:36 devstack sudo[96705]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9db67764-cef2-4bcf-a353-7fc2f7fb3c5c tempest-GroupsV314Test-514744745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.325s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:36 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-9db67764-cef2-4bcf-a353-7fc2f7fb3c5c tempest-GroupsV314Test-514744745 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:20:36 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-9db67764-cef2-4bcf-a353-7fc2f7fb3c5c tempest-GroupsV314Test-514744745 None] Delete group completed successfully. Sep 03 11:20:36 devstack sudo[96711]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-37345670-df02-4573-b0cf-fdeeb426a24c tempest-VolumesTransfersV355Test-423595047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.403s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:36 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-37345670-df02-4573-b0cf-fdeeb426a24c tempest-VolumesTransfersV355Test-423595047 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:20:36 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-37345670-df02-4573-b0cf-fdeeb426a24c tempest-VolumesTransfersV355Test-423595047 None] Deleted volume successfully. Sep 03 11:20:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-37345670-df02-4573-b0cf-fdeeb426a24c tempest-VolumesTransfersV355Test-423595047 None] Lock "cinder-b6d70311-61fc-4dc8-be9d-1d6fbc4af992-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:20:36 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-b88169d8-2327-4cf0-84ff-ddd3bcfebb54 tempest-VolumesTransfersV355Test-563144422 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:20:36 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-b88169d8-2327-4cf0-84ff-ddd3bcfebb54 tempest-VolumesTransfersV355Test-563144422 None] Flow 'volume_create_manager' (0329e13d-7cd8-4696-ae3d-c853616860ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:20:36 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-b88169d8-2327-4cf0-84ff-ddd3bcfebb54 tempest-VolumesTransfersV355Test-563144422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e7ffc99-337a-4c7a-bb1f-4114256fb899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:36 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-b88169d8-2327-4cf0-84ff-ddd3bcfebb54 tempest-VolumesTransfersV355Test-563144422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e7ffc99-337a-4c7a-bb1f-4114256fb899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-299216004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6580b5e-8fd4-4b1c-94e0-9d75d13c4cd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f11ac288584f6a9c703dfc6c336633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:20:37Z,use_quota=True,user_id='e11478c51a0943edb8fc213826ca3ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:36 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-b88169d8-2327-4cf0-84ff-ddd3bcfebb54 tempest-VolumesTransfersV355Test-563144422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (774f21c9-a5db-4c0b-9533-e0c7872e6726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:36 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-b88169d8-2327-4cf0-84ff-ddd3bcfebb54 tempest-VolumesTransfersV355Test-563144422 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (774f21c9-a5db-4c0b-9533-e0c7872e6726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:36 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-b88169d8-2327-4cf0-84ff-ddd3bcfebb54 tempest-VolumesTransfersV355Test-563144422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d21651cc-84fa-47a0-be26-f60d210cd523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:36 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-b88169d8-2327-4cf0-84ff-ddd3bcfebb54 tempest-VolumesTransfersV355Test-563144422 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d21651cc-84fa-47a0-be26-f60d210cd523) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6580b5e-8fd4-4b1c-94e0-9d75d13c4cd6', 'volume_name': 'volume-e6580b5e-8fd4-4b1c-94e0-9d75d13c4cd6', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:36 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-b88169d8-2327-4cf0-84ff-ddd3bcfebb54 tempest-VolumesTransfersV355Test-563144422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75b81b6c-a105-4c0b-805e-04a3223feb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:36 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-b88169d8-2327-4cf0-84ff-ddd3bcfebb54 tempest-VolumesTransfersV355Test-563144422 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75b81b6c-a105-4c0b-805e-04a3223feb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:36 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-b88169d8-2327-4cf0-84ff-ddd3bcfebb54 tempest-VolumesTransfersV355Test-563144422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a63b3baf-7eff-4ed2-a266-86127b92c4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:36 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-b88169d8-2327-4cf0-84ff-ddd3bcfebb54 tempest-VolumesTransfersV355Test-563144422 None] Volume e6580b5e-8fd4-4b1c-94e0-9d75d13c4cd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6580b5e-8fd4-4b1c-94e0-9d75d13c4cd6', 'volume_size': 1} Sep 03 11:20:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b88169d8-2327-4cf0-84ff-ddd3bcfebb54 tempest-VolumesTransfersV355Test-563144422 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:20:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b88169d8-2327-4cf0-84ff-ddd3bcfebb54 tempest-VolumesTransfersV355Test-563144422 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:20:36 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-b88169d8-2327-4cf0-84ff-ddd3bcfebb54 tempest-VolumesTransfersV355Test-563144422 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:20:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-299216004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6580b5e-8fd4-4b1c-94e0-9d75d13c4cd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78f11ac288584f6a9c703dfc6c336633',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:20:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:20:37Z,use_quota=True,user_id='e11478c51a0943edb8fc213826ca3ab5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:20:36 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-b88169d8-2327-4cf0-84ff-ddd3bcfebb54 tempest-VolumesTransfersV355Test-563144422 None] Creating volume e6580b5e-8fd4-4b1c-94e0-9d75d13c4cd6 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:20:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b88169d8-2327-4cf0-84ff-ddd3bcfebb54 tempest-VolumesTransfersV355Test-563144422 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:20:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b88169d8-2327-4cf0-84ff-ddd3bcfebb54 tempest-VolumesTransfersV355Test-563144422 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:20:36 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-b88169d8-2327-4cf0-84ff-ddd3bcfebb54 tempest-VolumesTransfersV355Test-563144422 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:20:36 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-b88169d8-2327-4cf0-84ff-ddd3bcfebb54 tempest-VolumesTransfersV355Test-563144422 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:20:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b88169d8-2327-4cf0-84ff-ddd3bcfebb54 tempest-VolumesTransfersV355Test-563144422 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:20:36 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-b88169d8-2327-4cf0-84ff-ddd3bcfebb54 tempest-VolumesTransfersV355Test-563144422 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:20:36 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-b88169d8-2327-4cf0-84ff-ddd3bcfebb54 tempest-VolumesTransfersV355Test-563144422 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:20:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b88169d8-2327-4cf0-84ff-ddd3bcfebb54 tempest-VolumesTransfersV355Test-563144422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e6580b5e-8fd4-4b1c-94e0-9d75d13c4cd6 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:37 devstack sudo[96717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e6580b5e-8fd4-4b1c-94e0-9d75d13c4cd6 1073741824 Sep 03 11:20:37 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:37 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b88169d8-2327-4cf0-84ff-ddd3bcfebb54 tempest-VolumesTransfersV355Test-563144422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e6580b5e-8fd4-4b1c-94e0-9d75d13c4cd6 1073741824" returned: 0 in 0.678s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b88169d8-2327-4cf0-84ff-ddd3bcfebb54 tempest-VolumesTransfersV355Test-563144422 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e6580b5e-8fd4-4b1c-94e0-9d75d13c4cd6 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:37 devstack sudo[96724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e6580b5e-8fd4-4b1c-94e0-9d75d13c4cd6 Sep 03 11:20:37 devstack sudo[96724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:37 devstack sudo[96702]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_711a3bc6-f4d3-44e1-9e3c-303c3f2804ae_yi3e3kwfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2d311a2f-d0a7-4f76-b40e-a9ccc15790d0" returned: 0 in 2.266s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:37 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_711a3bc6-f4d3-44e1-9e3c-303c3f2804ae_yi3e3kwfdevstack@QuobyteHD, size 112.00 MB, duration 2.27 sec, destination /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2d311a2f-d0a7-4f76-b40e-a9ccc15790d0 {{(pid=87038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:20:37 devstack cinder-volume[87038]: INFO cinder.image.image_utils [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Converted 112.00 MB image at 49.39 MB/s Sep 03 11:20:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2d311a2f-d0a7-4f76-b40e-a9ccc15790d0 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:37 devstack sudo[96727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2d311a2f-d0a7-4f76-b40e-a9ccc15790d0 1G Sep 03 11:20:37 devstack sudo[96727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:38 devstack sudo[96724]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b88169d8-2327-4cf0-84ff-ddd3bcfebb54 tempest-VolumesTransfersV355Test-563144422 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e6580b5e-8fd4-4b1c-94e0-9d75d13c4cd6" returned: 0 in 0.371s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:38 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-b88169d8-2327-4cf0-84ff-ddd3bcfebb54 tempest-VolumesTransfersV355Test-563144422 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:20:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b88169d8-2327-4cf0-84ff-ddd3bcfebb54 tempest-VolumesTransfersV355Test-563144422 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:20:38 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-b88169d8-2327-4cf0-84ff-ddd3bcfebb54 tempest-VolumesTransfersV355Test-563144422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a63b3baf-7eff-4ed2-a266-86127b92c4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6580b5e-8fd4-4b1c-94e0-9d75d13c4cd6', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:38 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-b88169d8-2327-4cf0-84ff-ddd3bcfebb54 tempest-VolumesTransfersV355Test-563144422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (230ad3c7-3a48-4972-8618-4c859d21679b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:38 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-b88169d8-2327-4cf0-84ff-ddd3bcfebb54 tempest-VolumesTransfersV355Test-563144422 None] Volume volume-e6580b5e-8fd4-4b1c-94e0-9d75d13c4cd6 (e6580b5e-8fd4-4b1c-94e0-9d75d13c4cd6): created successfully Sep 03 11:20:38 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-b88169d8-2327-4cf0-84ff-ddd3bcfebb54 tempest-VolumesTransfersV355Test-563144422 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (230ad3c7-3a48-4972-8618-4c859d21679b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:38 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-b88169d8-2327-4cf0-84ff-ddd3bcfebb54 tempest-VolumesTransfersV355Test-563144422 None] Flow 'volume_create_manager' (0329e13d-7cd8-4696-ae3d-c853616860ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:20:38 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-b88169d8-2327-4cf0-84ff-ddd3bcfebb54 tempest-VolumesTransfersV355Test-563144422 None] Created volume successfully. Sep 03 11:20:38 devstack sudo[96727]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2d311a2f-d0a7-4f76-b40e-a9ccc15790d0 1G" returned: 0 in 0.401s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:38 devstack cinder-volume[87038]: DEBUG cinder.volume.volume_utils [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Downloaded image 711a3bc6-f4d3-44e1-9e3c-303c3f2804ae ((None, [{'url': 'file:///opt/stack/data/glance/images/711a3bc6-f4d3-44e1-9e3c-303c3f2804ae', 'metadata': {}}])) to volume 2d311a2f-d0a7-4f76-b40e-a9ccc15790d0 successfully. {{(pid=87038) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 11:20:38 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Temporary image 711a3bc6-f4d3-44e1-9e3c-303c3f2804ae for user 4d37b156e6cf437099d46a395c06251a is deleted. {{(pid=87038) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 11:20:38 devstack cinder-volume[87038]: DEBUG cinder.volume.volume_utils [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Marking volume 2d311a2f-d0a7-4f76-b40e-a9ccc15790d0 as bootable. {{(pid=87038) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 11:20:38 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Copying metadata from image 711a3bc6-f4d3-44e1-9e3c-303c3f2804ae to 2d311a2f-d0a7-4f76-b40e-a9ccc15790d0. {{(pid=87038) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 11:20:38 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Creating volume glance metadata for volume 2d311a2f-d0a7-4f76-b40e-a9ccc15790d0 backed by image 711a3bc6-f4d3-44e1-9e3c-303c3f2804ae with: {'image_id': '711a3bc6-f4d3-44e1-9e3c-303c3f2804ae', 'image_name': 'tempest-scenario-img--577507297', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87038) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 11:20:38 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f5f211e-451e-48d8-aa6f-ffcb6782a8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d311a2f-d0a7-4f76-b40e-a9ccc15790d0', 'volume_size': 1, 'image_id': '711a3bc6-f4d3-44e1-9e3c-303c3f2804ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/711a3bc6-f4d3-44e1-9e3c-303c3f2804ae', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--577507297', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '30cbe8eb4d0742e3942dc942aa7e4ea0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '711a3bc6-f4d3-44e1-9e3c-303c3f2804ae', 'created_at': datetime.datetime(2026, 9, 3, 9, 20, 11, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 20, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/711a3bc6-f4d3-44e1-9e3c-303c3f2804ae/file', 'properties': {}}, 'image_service': }' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:38 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5207237-43f6-4f88-8571-28ac20422340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:38 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Volume volume-2d311a2f-d0a7-4f76-b40e-a9ccc15790d0 (2d311a2f-d0a7-4f76-b40e-a9ccc15790d0): created successfully Sep 03 11:20:38 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5207237-43f6-4f88-8571-28ac20422340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:38 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Flow 'volume_create_manager' (af380d75-1d54-469c-bbef-ae823c6e91bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:20:38 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-8fd52c36-c3c6-401b-bbec-808dce5e4eea tempest-TestInstancesWithCinderVolumes-2123003308 None] Created volume successfully. Sep 03 11:20:39 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-589d28c6-63dc-4ad2-ad09-a72ef8bf233e tempest-VolumesTransfersV355Test-423595047 None] Acquiring lock "cinder-e6580b5e-8fd4-4b1c-94e0-9d75d13c4cd6-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:20:39 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-589d28c6-63dc-4ad2-ad09-a72ef8bf233e tempest-VolumesTransfersV355Test-423595047 None] Lock "cinder-e6580b5e-8fd4-4b1c-94e0-9d75d13c4cd6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:20:39 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-589d28c6-63dc-4ad2-ad09-a72ef8bf233e tempest-VolumesTransfersV355Test-423595047 None] Acquiring lock "cinder-quobyte-e6580b5e-8fd4-4b1c-94e0-9d75d13c4cd6" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:20:39 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-589d28c6-63dc-4ad2-ad09-a72ef8bf233e tempest-VolumesTransfersV355Test-423595047 None] Lock "cinder-quobyte-e6580b5e-8fd4-4b1c-94e0-9d75d13c4cd6" acquired by "delete_volume" :: waited 0.020s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:20:39 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa757e0-f28c-418c-9fe7-5604e591aec3]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:20:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-589d28c6-63dc-4ad2-ad09-a72ef8bf233e tempest-VolumesTransfersV355Test-423595047 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e6580b5e-8fd4-4b1c-94e0-9d75d13c4cd6 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:39 devstack sudo[96747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e6580b5e-8fd4-4b1c-94e0-9d75d13c4cd6 Sep 03 11:20:39 devstack sudo[96747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:40 devstack sudo[96747]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-589d28c6-63dc-4ad2-ad09-a72ef8bf233e tempest-VolumesTransfersV355Test-423595047 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e6580b5e-8fd4-4b1c-94e0-9d75d13c4cd6" returned: 0 in 0.507s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-589d28c6-63dc-4ad2-ad09-a72ef8bf233e tempest-VolumesTransfersV355Test-423595047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e6580b5e-8fd4-4b1c-94e0-9d75d13c4cd6 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:40 devstack sudo[96754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e6580b5e-8fd4-4b1c-94e0-9d75d13c4cd6 Sep 03 11:20:40 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:40 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-589d28c6-63dc-4ad2-ad09-a72ef8bf233e tempest-VolumesTransfersV355Test-423595047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e6580b5e-8fd4-4b1c-94e0-9d75d13c4cd6" returned: 0 in 0.405s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:40 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-589d28c6-63dc-4ad2-ad09-a72ef8bf233e tempest-VolumesTransfersV355Test-423595047 None] Lock "cinder-quobyte-e6580b5e-8fd4-4b1c-94e0-9d75d13c4cd6" released by "delete_volume" :: held 1.001s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:20:40 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-589d28c6-63dc-4ad2-ad09-a72ef8bf233e tempest-VolumesTransfersV355Test-423595047 None] Created reservations ['36e836ad-d527-40be-90fa-610a5d54c717', '6d7ca99f-1ad7-449a-9a57-2d6a0618a85f', '8d4ae9c3-9e4f-48fb-96b2-6e652781db88', '485233c3-93b1-4166-9c9d-92828900abfb'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:20:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-589d28c6-63dc-4ad2-ad09-a72ef8bf233e tempest-VolumesTransfersV355Test-423595047 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:20:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-589d28c6-63dc-4ad2-ad09-a72ef8bf233e tempest-VolumesTransfersV355Test-423595047 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:20:40 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-589d28c6-63dc-4ad2-ad09-a72ef8bf233e tempest-VolumesTransfersV355Test-423595047 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:20:40 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-589d28c6-63dc-4ad2-ad09-a72ef8bf233e tempest-VolumesTransfersV355Test-423595047 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:20:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-589d28c6-63dc-4ad2-ad09-a72ef8bf233e tempest-VolumesTransfersV355Test-423595047 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:20:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-589d28c6-63dc-4ad2-ad09-a72ef8bf233e tempest-VolumesTransfersV355Test-423595047 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:40 devstack sudo[96759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:20:40 devstack sudo[96759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:41 devstack sudo[96759]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-589d28c6-63dc-4ad2-ad09-a72ef8bf233e tempest-VolumesTransfersV355Test-423595047 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.288s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:41 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-589d28c6-63dc-4ad2-ad09-a72ef8bf233e tempest-VolumesTransfersV355Test-423595047 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:20:41 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-589d28c6-63dc-4ad2-ad09-a72ef8bf233e tempest-VolumesTransfersV355Test-423595047 None] Deleted volume successfully. Sep 03 11:20:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-589d28c6-63dc-4ad2-ad09-a72ef8bf233e tempest-VolumesTransfersV355Test-423595047 None] Lock "cinder-e6580b5e-8fd4-4b1c-94e0-9d75d13c4cd6-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:20:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-f34c929b-1c63-4cb5-90cc-d15b79fabaa1 req-eab33f75-7f8b-4711-811d-16137a0b5cc0 tempest-TestInstancesWithCinderVolumes-2123003308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:20:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-f34c929b-1c63-4cb5-90cc-d15b79fabaa1 req-eab33f75-7f8b-4711-811d-16137a0b5cc0 tempest-TestInstancesWithCinderVolumes-2123003308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:20:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-f34c929b-1c63-4cb5-90cc-d15b79fabaa1 req-eab33f75-7f8b-4711-811d-16137a0b5cc0 tempest-TestInstancesWithCinderVolumes-2123003308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:20:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-f34c929b-1c63-4cb5-90cc-d15b79fabaa1 req-eab33f75-7f8b-4711-811d-16137a0b5cc0 tempest-TestInstancesWithCinderVolumes-2123003308 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912', 'name': 'volume-2d311a2f-d0a7-4f76-b40e-a9ccc15790d0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bf69d668-ad37-4660-8bbf-036045dee68f', 'enforce_multipath': True} {{(pid=87038) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:20:42 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-f34c929b-1c63-4cb5-90cc-d15b79fabaa1 req-eab33f75-7f8b-4711-811d-16137a0b5cc0 tempest-TestInstancesWithCinderVolumes-2123003308 None] attachment_update completed successfully. Sep 03 11:20:51 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6b38950-90dd-4145-b065-34c71381a98a tempest-AttachVolumeNegativeTest-1135519864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:20:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a6b38950-90dd-4145-b065-34c71381a98a tempest-AttachVolumeNegativeTest-1135519864 None] Flow 'volume_create_manager' (6086b0b5-68f5-4aea-b1d3-15b0a5adee86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:20:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a6b38950-90dd-4145-b065-34c71381a98a tempest-AttachVolumeNegativeTest-1135519864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b4f29e9-9c40-48dc-bb89-04fabd899462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a6b38950-90dd-4145-b065-34c71381a98a tempest-AttachVolumeNegativeTest-1135519864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b4f29e9-9c40-48dc-bb89-04fabd899462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1299414822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bb3431e-6358-495d-91dd-a7c2de72c898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d61409d09184c5993bb335ccbb39155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:20:52Z,use_quota=True,user_id='b17a20289dae429a8682705ff233e9b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a6b38950-90dd-4145-b065-34c71381a98a tempest-AttachVolumeNegativeTest-1135519864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b147bad-4c17-47d9-8f73-fee042caa062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a6b38950-90dd-4145-b065-34c71381a98a tempest-AttachVolumeNegativeTest-1135519864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b147bad-4c17-47d9-8f73-fee042caa062) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a6b38950-90dd-4145-b065-34c71381a98a tempest-AttachVolumeNegativeTest-1135519864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98f260c8-a8c5-4a80-af20-4b7ec0115c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:52 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a6b38950-90dd-4145-b065-34c71381a98a tempest-AttachVolumeNegativeTest-1135519864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98f260c8-a8c5-4a80-af20-4b7ec0115c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bb3431e-6358-495d-91dd-a7c2de72c898', 'volume_name': 'volume-7bb3431e-6358-495d-91dd-a7c2de72c898', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:52 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a6b38950-90dd-4145-b065-34c71381a98a tempest-AttachVolumeNegativeTest-1135519864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5af369a9-730b-4f01-9e63-0b096bc38d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:52 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a6b38950-90dd-4145-b065-34c71381a98a tempest-AttachVolumeNegativeTest-1135519864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5af369a9-730b-4f01-9e63-0b096bc38d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:52 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a6b38950-90dd-4145-b065-34c71381a98a tempest-AttachVolumeNegativeTest-1135519864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (407c481e-23c3-4a9c-97f8-b3dcf473992f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:52 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-a6b38950-90dd-4145-b065-34c71381a98a tempest-AttachVolumeNegativeTest-1135519864 None] Volume 7bb3431e-6358-495d-91dd-a7c2de72c898: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bb3431e-6358-495d-91dd-a7c2de72c898', 'volume_size': 1} Sep 03 11:20:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a6b38950-90dd-4145-b065-34c71381a98a tempest-AttachVolumeNegativeTest-1135519864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:20:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a6b38950-90dd-4145-b065-34c71381a98a tempest-AttachVolumeNegativeTest-1135519864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:20:52 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a6b38950-90dd-4145-b065-34c71381a98a tempest-AttachVolumeNegativeTest-1135519864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:20:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1299414822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bb3431e-6358-495d-91dd-a7c2de72c898,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d61409d09184c5993bb335ccbb39155',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:20:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:20:52Z,use_quota=True,user_id='b17a20289dae429a8682705ff233e9b8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:20:52 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-a6b38950-90dd-4145-b065-34c71381a98a tempest-AttachVolumeNegativeTest-1135519864 None] Creating volume 7bb3431e-6358-495d-91dd-a7c2de72c898 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:20:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a6b38950-90dd-4145-b065-34c71381a98a tempest-AttachVolumeNegativeTest-1135519864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:20:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a6b38950-90dd-4145-b065-34c71381a98a tempest-AttachVolumeNegativeTest-1135519864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:20:52 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a6b38950-90dd-4145-b065-34c71381a98a tempest-AttachVolumeNegativeTest-1135519864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:20:52 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a6b38950-90dd-4145-b065-34c71381a98a tempest-AttachVolumeNegativeTest-1135519864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:20:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a6b38950-90dd-4145-b065-34c71381a98a tempest-AttachVolumeNegativeTest-1135519864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:20:52 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a6b38950-90dd-4145-b065-34c71381a98a tempest-AttachVolumeNegativeTest-1135519864 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:20:52 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-a6b38950-90dd-4145-b065-34c71381a98a tempest-AttachVolumeNegativeTest-1135519864 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:20:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a6b38950-90dd-4145-b065-34c71381a98a tempest-AttachVolumeNegativeTest-1135519864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7bb3431e-6358-495d-91dd-a7c2de72c898 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:52 devstack sudo[97228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7bb3431e-6358-495d-91dd-a7c2de72c898 1073741824 Sep 03 11:20:52 devstack sudo[97228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:52 devstack sudo[97228]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a6b38950-90dd-4145-b065-34c71381a98a tempest-AttachVolumeNegativeTest-1135519864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7bb3431e-6358-495d-91dd-a7c2de72c898 1073741824" returned: 0 in 0.727s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a6b38950-90dd-4145-b065-34c71381a98a tempest-AttachVolumeNegativeTest-1135519864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7bb3431e-6358-495d-91dd-a7c2de72c898 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:52 devstack sudo[97234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7bb3431e-6358-495d-91dd-a7c2de72c898 Sep 03 11:20:52 devstack sudo[97234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:53 devstack sudo[97234]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a6b38950-90dd-4145-b065-34c71381a98a tempest-AttachVolumeNegativeTest-1135519864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7bb3431e-6358-495d-91dd-a7c2de72c898" returned: 0 in 0.555s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:53 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a6b38950-90dd-4145-b065-34c71381a98a tempest-AttachVolumeNegativeTest-1135519864 None] <== create_volume: return (1374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:20:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a6b38950-90dd-4145-b065-34c71381a98a tempest-AttachVolumeNegativeTest-1135519864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.380s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:20:53 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a6b38950-90dd-4145-b065-34c71381a98a tempest-AttachVolumeNegativeTest-1135519864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (407c481e-23c3-4a9c-97f8-b3dcf473992f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bb3431e-6358-495d-91dd-a7c2de72c898', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:53 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a6b38950-90dd-4145-b065-34c71381a98a tempest-AttachVolumeNegativeTest-1135519864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b1f8de8-9a38-41ec-817f-6ca55a7ed5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:53 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-a6b38950-90dd-4145-b065-34c71381a98a tempest-AttachVolumeNegativeTest-1135519864 None] Volume volume-7bb3431e-6358-495d-91dd-a7c2de72c898 (7bb3431e-6358-495d-91dd-a7c2de72c898): created successfully Sep 03 11:20:53 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a6b38950-90dd-4145-b065-34c71381a98a tempest-AttachVolumeNegativeTest-1135519864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b1f8de8-9a38-41ec-817f-6ca55a7ed5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:53 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a6b38950-90dd-4145-b065-34c71381a98a tempest-AttachVolumeNegativeTest-1135519864 None] Flow 'volume_create_manager' (6086b0b5-68f5-4aea-b1d3-15b0a5adee86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:20:53 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-a6b38950-90dd-4145-b065-34c71381a98a tempest-AttachVolumeNegativeTest-1135519864 None] Created volume successfully. Sep 03 11:20:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-d9d3d31c-5c57-48e0-a4a0-ed7c7bbc16b6 req-1ebe871b-884d-4a7a-b201-3158846ebbf7 tempest-AttachVolumeNegativeTest-1135519864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:20:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-d9d3d31c-5c57-48e0-a4a0-ed7c7bbc16b6 req-1ebe871b-884d-4a7a-b201-3158846ebbf7 tempest-AttachVolumeNegativeTest-1135519864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:20:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-d9d3d31c-5c57-48e0-a4a0-ed7c7bbc16b6 req-1ebe871b-884d-4a7a-b201-3158846ebbf7 tempest-AttachVolumeNegativeTest-1135519864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:20:55 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-d9d3d31c-5c57-48e0-a4a0-ed7c7bbc16b6 req-1ebe871b-884d-4a7a-b201-3158846ebbf7 tempest-AttachVolumeNegativeTest-1135519864 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912', 'name': 'volume-7bb3431e-6358-495d-91dd-a7c2de72c898', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0d960890-39aa-4cf6-a569-a0e9c2abc706', 'enforce_multipath': True} {{(pid=87038) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:20:55 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-d9d3d31c-5c57-48e0-a4a0-ed7c7bbc16b6 req-1ebe871b-884d-4a7a-b201-3158846ebbf7 tempest-AttachVolumeNegativeTest-1135519864 None] attachment_update completed successfully. Sep 03 11:20:56 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-90e896b8-2ca8-47d7-a522-aae372358c33 tempest-VolumeTypesAccessTest-998643964 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:20:56 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-90e896b8-2ca8-47d7-a522-aae372358c33 tempest-VolumeTypesAccessTest-998643964 None] Flow 'volume_create_manager' (f1b35afd-3b3c-487f-ad1a-b3b850eaec4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:20:56 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-90e896b8-2ca8-47d7-a522-aae372358c33 tempest-VolumeTypesAccessTest-998643964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb8d82f2-e3a0-4ff6-9e67-fddbfff212a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:56 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-90e896b8-2ca8-47d7-a522-aae372358c33 tempest-VolumeTypesAccessTest-998643964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb8d82f2-e3a0-4ff6-9e67-fddbfff212a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-903951414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ea3a4dd-70ac-4e37-b072-b19686bd95ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7dce4fdd3474a48aa40c719b5b24ace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:20:56Z,use_quota=True,user_id='505cb70e8d4341e28078489017fd0856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2cfb0810-42b9-4a6e-9036-247ee1f1e8c9),volume_type_id=2cfb0810-42b9-4a6e-9036-247ee1f1e8c9)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:56 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-90e896b8-2ca8-47d7-a522-aae372358c33 tempest-VolumeTypesAccessTest-998643964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (611fa283-1c2b-41ce-b4a0-a677a0875bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:56 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-90e896b8-2ca8-47d7-a522-aae372358c33 tempest-VolumeTypesAccessTest-998643964 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (611fa283-1c2b-41ce-b4a0-a677a0875bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:56 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-90e896b8-2ca8-47d7-a522-aae372358c33 tempest-VolumeTypesAccessTest-998643964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2206f414-635e-43de-b2b4-40e901cf53f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:56 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-90e896b8-2ca8-47d7-a522-aae372358c33 tempest-VolumeTypesAccessTest-998643964 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2206f414-635e-43de-b2b4-40e901cf53f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ea3a4dd-70ac-4e37-b072-b19686bd95ee', 'volume_name': 'volume-7ea3a4dd-70ac-4e37-b072-b19686bd95ee', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:56 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-90e896b8-2ca8-47d7-a522-aae372358c33 tempest-VolumeTypesAccessTest-998643964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ead0fa4b-a2d1-4099-b561-af50e158cbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:56 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-90e896b8-2ca8-47d7-a522-aae372358c33 tempest-VolumeTypesAccessTest-998643964 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ead0fa4b-a2d1-4099-b561-af50e158cbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:56 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-90e896b8-2ca8-47d7-a522-aae372358c33 tempest-VolumeTypesAccessTest-998643964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef970b51-0c51-4b1e-b799-e4aac4997d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:56 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-90e896b8-2ca8-47d7-a522-aae372358c33 tempest-VolumeTypesAccessTest-998643964 None] Volume 7ea3a4dd-70ac-4e37-b072-b19686bd95ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ea3a4dd-70ac-4e37-b072-b19686bd95ee', 'volume_size': 1} Sep 03 11:20:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-90e896b8-2ca8-47d7-a522-aae372358c33 tempest-VolumeTypesAccessTest-998643964 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:20:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-90e896b8-2ca8-47d7-a522-aae372358c33 tempest-VolumeTypesAccessTest-998643964 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:20:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-90e896b8-2ca8-47d7-a522-aae372358c33 tempest-VolumeTypesAccessTest-998643964 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:20:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-903951414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ea3a4dd-70ac-4e37-b072-b19686bd95ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7dce4fdd3474a48aa40c719b5b24ace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:20:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:20:56Z,use_quota=True,user_id='505cb70e8d4341e28078489017fd0856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2cfb0810-42b9-4a6e-9036-247ee1f1e8c9),volume_type_id=2cfb0810-42b9-4a6e-9036-247ee1f1e8c9)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:20:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-90e896b8-2ca8-47d7-a522-aae372358c33 tempest-VolumeTypesAccessTest-998643964 None] Creating volume 7ea3a4dd-70ac-4e37-b072-b19686bd95ee {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:20:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-90e896b8-2ca8-47d7-a522-aae372358c33 tempest-VolumeTypesAccessTest-998643964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:20:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-90e896b8-2ca8-47d7-a522-aae372358c33 tempest-VolumeTypesAccessTest-998643964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:20:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-90e896b8-2ca8-47d7-a522-aae372358c33 tempest-VolumeTypesAccessTest-998643964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:20:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-90e896b8-2ca8-47d7-a522-aae372358c33 tempest-VolumeTypesAccessTest-998643964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:20:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-90e896b8-2ca8-47d7-a522-aae372358c33 tempest-VolumeTypesAccessTest-998643964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:20:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-90e896b8-2ca8-47d7-a522-aae372358c33 tempest-VolumeTypesAccessTest-998643964 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:20:56 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-90e896b8-2ca8-47d7-a522-aae372358c33 tempest-VolumeTypesAccessTest-998643964 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:20:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90e896b8-2ca8-47d7-a522-aae372358c33 tempest-VolumeTypesAccessTest-998643964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7ea3a4dd-70ac-4e37-b072-b19686bd95ee 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:56 devstack sudo[97253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7ea3a4dd-70ac-4e37-b072-b19686bd95ee 1073741824 Sep 03 11:20:56 devstack sudo[97253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:57 devstack sudo[97253]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90e896b8-2ca8-47d7-a522-aae372358c33 tempest-VolumeTypesAccessTest-998643964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7ea3a4dd-70ac-4e37-b072-b19686bd95ee 1073741824" returned: 0 in 0.643s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90e896b8-2ca8-47d7-a522-aae372358c33 tempest-VolumeTypesAccessTest-998643964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7ea3a4dd-70ac-4e37-b072-b19686bd95ee {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:57 devstack sudo[97258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7ea3a4dd-70ac-4e37-b072-b19686bd95ee Sep 03 11:20:57 devstack sudo[97258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:20:57 devstack sudo[97258]: pam_unix(sudo:session): session closed for user root Sep 03 11:20:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90e896b8-2ca8-47d7-a522-aae372358c33 tempest-VolumeTypesAccessTest-998643964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7ea3a4dd-70ac-4e37-b072-b19686bd95ee" returned: 0 in 0.454s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:20:57 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-90e896b8-2ca8-47d7-a522-aae372358c33 tempest-VolumeTypesAccessTest-998643964 None] <== create_volume: return (1254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:20:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-90e896b8-2ca8-47d7-a522-aae372358c33 tempest-VolumeTypesAccessTest-998643964 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.261s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:20:58 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-90e896b8-2ca8-47d7-a522-aae372358c33 tempest-VolumeTypesAccessTest-998643964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef970b51-0c51-4b1e-b799-e4aac4997d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ea3a4dd-70ac-4e37-b072-b19686bd95ee', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:58 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-90e896b8-2ca8-47d7-a522-aae372358c33 tempest-VolumeTypesAccessTest-998643964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6746a7ec-7c02-49c3-bcf3-ffe4437884bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:20:58 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-90e896b8-2ca8-47d7-a522-aae372358c33 tempest-VolumeTypesAccessTest-998643964 None] Volume volume-7ea3a4dd-70ac-4e37-b072-b19686bd95ee (7ea3a4dd-70ac-4e37-b072-b19686bd95ee): created successfully Sep 03 11:20:58 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-90e896b8-2ca8-47d7-a522-aae372358c33 tempest-VolumeTypesAccessTest-998643964 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6746a7ec-7c02-49c3-bcf3-ffe4437884bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:20:58 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-90e896b8-2ca8-47d7-a522-aae372358c33 tempest-VolumeTypesAccessTest-998643964 None] Flow 'volume_create_manager' (f1b35afd-3b3c-487f-ad1a-b3b850eaec4f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:20:58 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-90e896b8-2ca8-47d7-a522-aae372358c33 tempest-VolumeTypesAccessTest-998643964 None] Created volume successfully. Sep 03 11:20:59 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-307deb1a-3fbe-437d-996b-91c481d365ef tempest-VolumeTypesAccessTest-998643964 None] Acquiring lock "cinder-7ea3a4dd-70ac-4e37-b072-b19686bd95ee-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:20:59 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-2b9a41e4-c269-4a63-8397-a0a53e5cfaf2 req-b76e395f-6cea-4927-bc38-838be1718dcf tempest-AttachVolumeNegativeTest-1135519864 None] Terminate volume connection completed successfully. Sep 03 11:20:59 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-2b9a41e4-c269-4a63-8397-a0a53e5cfaf2 req-b76e395f-6cea-4927-bc38-838be1718dcf tempest-AttachVolumeNegativeTest-1135519864 None] Deleting attachment 0d960890-39aa-4cf6-a569-a0e9c2abc706. {{(pid=87038) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:20:59 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-307deb1a-3fbe-437d-996b-91c481d365ef tempest-VolumeTypesAccessTest-998643964 None] Lock "cinder-7ea3a4dd-70ac-4e37-b072-b19686bd95ee-delete_volume" acquired by "delete_volume" :: waited 0.079s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:20:59 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-307deb1a-3fbe-437d-996b-91c481d365ef tempest-VolumeTypesAccessTest-998643964 None] Acquiring lock "cinder-quobyte-7ea3a4dd-70ac-4e37-b072-b19686bd95ee" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:20:59 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-307deb1a-3fbe-437d-996b-91c481d365ef tempest-VolumeTypesAccessTest-998643964 None] Lock "cinder-quobyte-7ea3a4dd-70ac-4e37-b072-b19686bd95ee" acquired by "delete_volume" :: waited 0.030s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:20:59 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[52095533-bc8d-44ce-b916-b55ab56e4f24]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:20:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-307deb1a-3fbe-437d-996b-91c481d365ef tempest-VolumeTypesAccessTest-998643964 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7ea3a4dd-70ac-4e37-b072-b19686bd95ee {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:20:59 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7ea3a4dd-70ac-4e37-b072-b19686bd95ee Sep 03 11:20:59 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:00 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-307deb1a-3fbe-437d-996b-91c481d365ef tempest-VolumeTypesAccessTest-998643964 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7ea3a4dd-70ac-4e37-b072-b19686bd95ee" returned: 0 in 0.833s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-307deb1a-3fbe-437d-996b-91c481d365ef tempest-VolumeTypesAccessTest-998643964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7ea3a4dd-70ac-4e37-b072-b19686bd95ee {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:00 devstack sudo[97270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7ea3a4dd-70ac-4e37-b072-b19686bd95ee Sep 03 11:21:00 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:00 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-307deb1a-3fbe-437d-996b-91c481d365ef tempest-VolumeTypesAccessTest-998643964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7ea3a4dd-70ac-4e37-b072-b19686bd95ee" returned: 0 in 0.388s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:00 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-307deb1a-3fbe-437d-996b-91c481d365ef tempest-VolumeTypesAccessTest-998643964 None] Lock "cinder-quobyte-7ea3a4dd-70ac-4e37-b072-b19686bd95ee" released by "delete_volume" :: held 1.347s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:21:00 devstack cinder-volume[87038]: WARNING cinder.quota [None req-307deb1a-3fbe-437d-996b-91c481d365ef tempest-VolumeTypesAccessTest-998643964 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1165029413 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1165029413, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:21:00 devstack cinder-volume[87038]: WARNING cinder.quota [None req-307deb1a-3fbe-437d-996b-91c481d365ef tempest-VolumeTypesAccessTest-998643964 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1165029413 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1165029413, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:21:00 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-307deb1a-3fbe-437d-996b-91c481d365ef tempest-VolumeTypesAccessTest-998643964 None] Created reservations ['19bb1563-f3b3-4f0f-9c70-04ea57d762ea', 'fd774cfa-f521-490d-bc53-139ff4786a50', '1c31c452-3306-4f27-b567-83d23e7edafd', '158c481e-9b6b-45b4-9f14-b34271c09129'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:21:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-307deb1a-3fbe-437d-996b-91c481d365ef tempest-VolumeTypesAccessTest-998643964 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:21:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-307deb1a-3fbe-437d-996b-91c481d365ef tempest-VolumeTypesAccessTest-998643964 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:21:00 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-307deb1a-3fbe-437d-996b-91c481d365ef tempest-VolumeTypesAccessTest-998643964 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:21:00 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-307deb1a-3fbe-437d-996b-91c481d365ef tempest-VolumeTypesAccessTest-998643964 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:21:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-307deb1a-3fbe-437d-996b-91c481d365ef tempest-VolumeTypesAccessTest-998643964 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:21:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-307deb1a-3fbe-437d-996b-91c481d365ef tempest-VolumeTypesAccessTest-998643964 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:01 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:21:01 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:01 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:01 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-307deb1a-3fbe-437d-996b-91c481d365ef tempest-VolumeTypesAccessTest-998643964 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.411s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:01 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-307deb1a-3fbe-437d-996b-91c481d365ef tempest-VolumeTypesAccessTest-998643964 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:21:01 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-307deb1a-3fbe-437d-996b-91c481d365ef tempest-VolumeTypesAccessTest-998643964 None] Deleted volume successfully. Sep 03 11:21:01 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-307deb1a-3fbe-437d-996b-91c481d365ef tempest-VolumeTypesAccessTest-998643964 None] Lock "cinder-7ea3a4dd-70ac-4e37-b072-b19686bd95ee-delete_volume" released by "delete_volume" :: held 2.284s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:21:06 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-022701c6-9bd0-4a3e-9445-173fb0a1701e tempest-VolumesActionsTest-1587758661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:21:06 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-022701c6-9bd0-4a3e-9445-173fb0a1701e tempest-VolumesActionsTest-1587758661 None] Flow 'volume_create_manager' (1469a6dc-4278-4c35-a4ab-91dd3ed3657f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:21:06 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-022701c6-9bd0-4a3e-9445-173fb0a1701e tempest-VolumesActionsTest-1587758661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ee53c2f-6715-44ad-a8c5-3584f8d6e444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:21:06 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-022701c6-9bd0-4a3e-9445-173fb0a1701e tempest-VolumesActionsTest-1587758661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ee53c2f-6715-44ad-a8c5-3584f8d6e444) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1144773039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d5417d8-48f2-4ac8-8a41-517f3bf6430a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6559f6f4d7cd40e19c54c29c8652bdda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:21:06Z,use_quota=True,user_id='4fed61cbb88947d7a41850ce9c552bc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:21:06 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-022701c6-9bd0-4a3e-9445-173fb0a1701e tempest-VolumesActionsTest-1587758661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (728c3faf-d4ab-4e01-8295-84f94a726b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:21:06 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-022701c6-9bd0-4a3e-9445-173fb0a1701e tempest-VolumesActionsTest-1587758661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (728c3faf-d4ab-4e01-8295-84f94a726b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:21:06 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-022701c6-9bd0-4a3e-9445-173fb0a1701e tempest-VolumesActionsTest-1587758661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc9b9ab3-85f0-43fe-aa03-0557cf117a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:21:06 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-022701c6-9bd0-4a3e-9445-173fb0a1701e tempest-VolumesActionsTest-1587758661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc9b9ab3-85f0-43fe-aa03-0557cf117a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d5417d8-48f2-4ac8-8a41-517f3bf6430a', 'volume_name': 'volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:21:06 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-022701c6-9bd0-4a3e-9445-173fb0a1701e tempest-VolumesActionsTest-1587758661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa998448-33f8-4514-83b9-9a5f090e413a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:21:06 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-022701c6-9bd0-4a3e-9445-173fb0a1701e tempest-VolumesActionsTest-1587758661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa998448-33f8-4514-83b9-9a5f090e413a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:21:06 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-022701c6-9bd0-4a3e-9445-173fb0a1701e tempest-VolumesActionsTest-1587758661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc7e3bdf-01b2-4838-977c-fa0e5e6adf91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:21:06 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-022701c6-9bd0-4a3e-9445-173fb0a1701e tempest-VolumesActionsTest-1587758661 None] Volume 6d5417d8-48f2-4ac8-8a41-517f3bf6430a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a', 'volume_size': 1} Sep 03 11:21:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-022701c6-9bd0-4a3e-9445-173fb0a1701e tempest-VolumesActionsTest-1587758661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:21:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-022701c6-9bd0-4a3e-9445-173fb0a1701e tempest-VolumesActionsTest-1587758661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:21:06 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-022701c6-9bd0-4a3e-9445-173fb0a1701e tempest-VolumesActionsTest-1587758661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:21:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1144773039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d5417d8-48f2-4ac8-8a41-517f3bf6430a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6559f6f4d7cd40e19c54c29c8652bdda',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:21:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:21:06Z,use_quota=True,user_id='4fed61cbb88947d7a41850ce9c552bc6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:21:06 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-022701c6-9bd0-4a3e-9445-173fb0a1701e tempest-VolumesActionsTest-1587758661 None] Creating volume 6d5417d8-48f2-4ac8-8a41-517f3bf6430a {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:21:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-022701c6-9bd0-4a3e-9445-173fb0a1701e tempest-VolumesActionsTest-1587758661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:21:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-022701c6-9bd0-4a3e-9445-173fb0a1701e tempest-VolumesActionsTest-1587758661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:21:06 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-022701c6-9bd0-4a3e-9445-173fb0a1701e tempest-VolumesActionsTest-1587758661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:21:06 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-022701c6-9bd0-4a3e-9445-173fb0a1701e tempest-VolumesActionsTest-1587758661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:21:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-022701c6-9bd0-4a3e-9445-173fb0a1701e tempest-VolumesActionsTest-1587758661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:21:06 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-022701c6-9bd0-4a3e-9445-173fb0a1701e tempest-VolumesActionsTest-1587758661 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:21:06 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-022701c6-9bd0-4a3e-9445-173fb0a1701e tempest-VolumesActionsTest-1587758661 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:21:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-022701c6-9bd0-4a3e-9445-173fb0a1701e tempest-VolumesActionsTest-1587758661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:06 devstack sudo[97340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a 1073741824 Sep 03 11:21:06 devstack sudo[97340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:07 devstack sudo[97340]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-022701c6-9bd0-4a3e-9445-173fb0a1701e tempest-VolumesActionsTest-1587758661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a 1073741824" returned: 0 in 0.595s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-022701c6-9bd0-4a3e-9445-173fb0a1701e tempest-VolumesActionsTest-1587758661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:07 devstack sudo[97347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a Sep 03 11:21:07 devstack sudo[97347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:07 devstack sudo[97347]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-022701c6-9bd0-4a3e-9445-173fb0a1701e tempest-VolumesActionsTest-1587758661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a" returned: 0 in 0.340s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:07 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-022701c6-9bd0-4a3e-9445-173fb0a1701e tempest-VolumesActionsTest-1587758661 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:21:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-022701c6-9bd0-4a3e-9445-173fb0a1701e tempest-VolumesActionsTest-1587758661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:21:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-022701c6-9bd0-4a3e-9445-173fb0a1701e tempest-VolumesActionsTest-1587758661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc7e3bdf-01b2-4838-977c-fa0e5e6adf91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:21:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-022701c6-9bd0-4a3e-9445-173fb0a1701e tempest-VolumesActionsTest-1587758661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a31a9dbc-2a1f-43c4-96a3-d73148a714bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:21:07 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-022701c6-9bd0-4a3e-9445-173fb0a1701e tempest-VolumesActionsTest-1587758661 None] Volume volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a (6d5417d8-48f2-4ac8-8a41-517f3bf6430a): created successfully Sep 03 11:21:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-022701c6-9bd0-4a3e-9445-173fb0a1701e tempest-VolumesActionsTest-1587758661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a31a9dbc-2a1f-43c4-96a3-d73148a714bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:21:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-022701c6-9bd0-4a3e-9445-173fb0a1701e tempest-VolumesActionsTest-1587758661 None] Flow 'volume_create_manager' (1469a6dc-4278-4c35-a4ab-91dd3ed3657f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:21:07 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-022701c6-9bd0-4a3e-9445-173fb0a1701e tempest-VolumesActionsTest-1587758661 None] Created volume successfully. Sep 03 11:21:07 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e6735da4-b11f-42cd-ad63-954f28cef7ba tempest-AttachVolumeNegativeTest-1135519864 None] Acquiring lock "cinder-7bb3431e-6358-495d-91dd-a7c2de72c898-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:21:07 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e6735da4-b11f-42cd-ad63-954f28cef7ba tempest-AttachVolumeNegativeTest-1135519864 None] Lock "cinder-7bb3431e-6358-495d-91dd-a7c2de72c898-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:21:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e6735da4-b11f-42cd-ad63-954f28cef7ba tempest-AttachVolumeNegativeTest-1135519864 None] Acquiring lock "cinder-quobyte-7bb3431e-6358-495d-91dd-a7c2de72c898" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:21:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e6735da4-b11f-42cd-ad63-954f28cef7ba tempest-AttachVolumeNegativeTest-1135519864 None] Lock "cinder-quobyte-7bb3431e-6358-495d-91dd-a7c2de72c898" acquired by "delete_volume" :: waited 0.015s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:21:08 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb23cf8-7f60-45b1-8432-9edea0a4f6ad]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:21:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e6735da4-b11f-42cd-ad63-954f28cef7ba tempest-AttachVolumeNegativeTest-1135519864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7bb3431e-6358-495d-91dd-a7c2de72c898 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:08 devstack sudo[97351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7bb3431e-6358-495d-91dd-a7c2de72c898 Sep 03 11:21:08 devstack sudo[97351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:08 devstack sudo[97351]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e6735da4-b11f-42cd-ad63-954f28cef7ba tempest-AttachVolumeNegativeTest-1135519864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7bb3431e-6358-495d-91dd-a7c2de72c898" returned: 0 in 0.416s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e6735da4-b11f-42cd-ad63-954f28cef7ba tempest-AttachVolumeNegativeTest-1135519864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7bb3431e-6358-495d-91dd-a7c2de72c898 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:08 devstack sudo[97356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7bb3431e-6358-495d-91dd-a7c2de72c898 Sep 03 11:21:08 devstack sudo[97356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:08 devstack sudo[97356]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e6735da4-b11f-42cd-ad63-954f28cef7ba tempest-AttachVolumeNegativeTest-1135519864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7bb3431e-6358-495d-91dd-a7c2de72c898" returned: 0 in 0.293s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e6735da4-b11f-42cd-ad63-954f28cef7ba tempest-AttachVolumeNegativeTest-1135519864 None] Lock "cinder-quobyte-7bb3431e-6358-495d-91dd-a7c2de72c898" released by "delete_volume" :: held 0.756s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:21:08 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-e6735da4-b11f-42cd-ad63-954f28cef7ba tempest-AttachVolumeNegativeTest-1135519864 None] Created reservations ['33af9ee9-143c-4dbd-a146-f548f6517e89', 'adc72a12-9cfe-416e-9493-bed9731d3674', '28d2c1b9-345a-48a8-af46-89133d66b5ee', '4f490990-cb08-426b-b362-c66a7ca59a15'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:21:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e6735da4-b11f-42cd-ad63-954f28cef7ba tempest-AttachVolumeNegativeTest-1135519864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:21:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e6735da4-b11f-42cd-ad63-954f28cef7ba tempest-AttachVolumeNegativeTest-1135519864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:21:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e6735da4-b11f-42cd-ad63-954f28cef7ba tempest-AttachVolumeNegativeTest-1135519864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:21:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e6735da4-b11f-42cd-ad63-954f28cef7ba tempest-AttachVolumeNegativeTest-1135519864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:21:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e6735da4-b11f-42cd-ad63-954f28cef7ba tempest-AttachVolumeNegativeTest-1135519864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:21:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e6735da4-b11f-42cd-ad63-954f28cef7ba tempest-AttachVolumeNegativeTest-1135519864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:08 devstack sudo[97359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:21:08 devstack sudo[97359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:09 devstack sudo[97359]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:09 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a9c35b37-6271-4363-baff-334cec36a82b tempest-AttachVolumeNegativeTest-1135519864 None] Acquiring lock "cinder-d5c0aace-4cad-420a-9acc-65f02c9cfdcc-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:21:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e6735da4-b11f-42cd-ad63-954f28cef7ba tempest-AttachVolumeNegativeTest-1135519864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.346s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:09 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-e6735da4-b11f-42cd-ad63-954f28cef7ba tempest-AttachVolumeNegativeTest-1135519864 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:21:09 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-e6735da4-b11f-42cd-ad63-954f28cef7ba tempest-AttachVolumeNegativeTest-1135519864 None] Deleted volume successfully. Sep 03 11:21:09 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a9c35b37-6271-4363-baff-334cec36a82b tempest-AttachVolumeNegativeTest-1135519864 None] Lock "cinder-d5c0aace-4cad-420a-9acc-65f02c9cfdcc-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:21:09 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e6735da4-b11f-42cd-ad63-954f28cef7ba tempest-AttachVolumeNegativeTest-1135519864 None] Lock "cinder-7bb3431e-6358-495d-91dd-a7c2de72c898-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:21:09 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a9c35b37-6271-4363-baff-334cec36a82b tempest-AttachVolumeNegativeTest-1135519864 None] Acquiring lock "cinder-quobyte-d5c0aace-4cad-420a-9acc-65f02c9cfdcc" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:21:09 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a9c35b37-6271-4363-baff-334cec36a82b tempest-AttachVolumeNegativeTest-1135519864 None] Lock "cinder-quobyte-d5c0aace-4cad-420a-9acc-65f02c9cfdcc" acquired by "delete_volume" :: waited 0.017s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:21:09 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c786421-fd49-4bb4-9fdf-68f3e0399aee]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:21:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a9c35b37-6271-4363-baff-334cec36a82b tempest-AttachVolumeNegativeTest-1135519864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d5c0aace-4cad-420a-9acc-65f02c9cfdcc {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:09 devstack sudo[97363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d5c0aace-4cad-420a-9acc-65f02c9cfdcc Sep 03 11:21:09 devstack sudo[97363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:09 devstack sudo[97363]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a9c35b37-6271-4363-baff-334cec36a82b tempest-AttachVolumeNegativeTest-1135519864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d5c0aace-4cad-420a-9acc-65f02c9cfdcc" returned: 0 in 0.443s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a9c35b37-6271-4363-baff-334cec36a82b tempest-AttachVolumeNegativeTest-1135519864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d5c0aace-4cad-420a-9acc-65f02c9cfdcc {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:09 devstack sudo[97371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d5c0aace-4cad-420a-9acc-65f02c9cfdcc Sep 03 11:21:09 devstack sudo[97371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:10 devstack sudo[97371]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a9c35b37-6271-4363-baff-334cec36a82b tempest-AttachVolumeNegativeTest-1135519864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d5c0aace-4cad-420a-9acc-65f02c9cfdcc" returned: 0 in 0.312s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a9c35b37-6271-4363-baff-334cec36a82b tempest-AttachVolumeNegativeTest-1135519864 None] Lock "cinder-quobyte-d5c0aace-4cad-420a-9acc-65f02c9cfdcc" released by "delete_volume" :: held 0.805s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:21:10 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-a9c35b37-6271-4363-baff-334cec36a82b tempest-AttachVolumeNegativeTest-1135519864 None] Created reservations ['f092e647-f8a2-4f1d-89ae-5df7f8ba399c', 'fbb9627a-c8fb-4380-b301-771044072680', '56448509-4462-404c-b998-6b68f561f619', 'a8b204f8-cdd7-4527-a4d1-4679b90e7c50'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:21:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a9c35b37-6271-4363-baff-334cec36a82b tempest-AttachVolumeNegativeTest-1135519864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:21:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a9c35b37-6271-4363-baff-334cec36a82b tempest-AttachVolumeNegativeTest-1135519864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:21:10 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a9c35b37-6271-4363-baff-334cec36a82b tempest-AttachVolumeNegativeTest-1135519864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:21:10 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a9c35b37-6271-4363-baff-334cec36a82b tempest-AttachVolumeNegativeTest-1135519864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:21:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a9c35b37-6271-4363-baff-334cec36a82b tempest-AttachVolumeNegativeTest-1135519864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:21:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a9c35b37-6271-4363-baff-334cec36a82b tempest-AttachVolumeNegativeTest-1135519864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:10 devstack sudo[97374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:21:10 devstack sudo[97374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:10 devstack sudo[97374]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a9c35b37-6271-4363-baff-334cec36a82b tempest-AttachVolumeNegativeTest-1135519864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.357s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:10 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-a9c35b37-6271-4363-baff-334cec36a82b tempest-AttachVolumeNegativeTest-1135519864 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:21:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5ae786a1-a181-4286-a57f-97a49eb8ecd1 tempest-AttachVolumeNegativeTest-1135519864 None] Acquiring lock "cinder-c80e6766-3893-4574-80e9-3c693c910c52-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:21:10 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-a9c35b37-6271-4363-baff-334cec36a82b tempest-AttachVolumeNegativeTest-1135519864 None] Deleted volume successfully. Sep 03 11:21:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5ae786a1-a181-4286-a57f-97a49eb8ecd1 tempest-AttachVolumeNegativeTest-1135519864 None] Lock "cinder-c80e6766-3893-4574-80e9-3c693c910c52-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:21:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a9c35b37-6271-4363-baff-334cec36a82b tempest-AttachVolumeNegativeTest-1135519864 None] Lock "cinder-d5c0aace-4cad-420a-9acc-65f02c9cfdcc-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:21:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5ae786a1-a181-4286-a57f-97a49eb8ecd1 tempest-AttachVolumeNegativeTest-1135519864 None] Acquiring lock "cinder-quobyte-c80e6766-3893-4574-80e9-3c693c910c52" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:21:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5ae786a1-a181-4286-a57f-97a49eb8ecd1 tempest-AttachVolumeNegativeTest-1135519864 None] Lock "cinder-quobyte-c80e6766-3893-4574-80e9-3c693c910c52" acquired by "delete_volume" :: waited 0.024s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:21:10 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[af01a6ea-d6ef-4420-a829-cb57a352ec61]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:21:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5ae786a1-a181-4286-a57f-97a49eb8ecd1 tempest-AttachVolumeNegativeTest-1135519864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c80e6766-3893-4574-80e9-3c693c910c52 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:11 devstack sudo[97377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c80e6766-3893-4574-80e9-3c693c910c52 Sep 03 11:21:11 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:11 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5ae786a1-a181-4286-a57f-97a49eb8ecd1 tempest-AttachVolumeNegativeTest-1135519864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c80e6766-3893-4574-80e9-3c693c910c52" returned: 0 in 0.680s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5ae786a1-a181-4286-a57f-97a49eb8ecd1 tempest-AttachVolumeNegativeTest-1135519864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c80e6766-3893-4574-80e9-3c693c910c52 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:11 devstack sudo[97389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c80e6766-3893-4574-80e9-3c693c910c52 Sep 03 11:21:11 devstack sudo[97389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:12 devstack sudo[97389]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5ae786a1-a181-4286-a57f-97a49eb8ecd1 tempest-AttachVolumeNegativeTest-1135519864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c80e6766-3893-4574-80e9-3c693c910c52" returned: 0 in 0.410s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:12 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5ae786a1-a181-4286-a57f-97a49eb8ecd1 tempest-AttachVolumeNegativeTest-1135519864 None] Lock "cinder-quobyte-c80e6766-3893-4574-80e9-3c693c910c52" released by "delete_volume" :: held 1.193s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:21:12 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-5ae786a1-a181-4286-a57f-97a49eb8ecd1 tempest-AttachVolumeNegativeTest-1135519864 None] Created reservations ['195d0261-bbb8-4a3e-be58-305581ada392', 'e821b36a-c747-45d2-864e-5ebc30459f5f', '0cd3ad5b-07f4-43ad-b82e-579ee21d69c9', 'f51ab450-5133-4b86-b121-85ba5b827a7d'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:21:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5ae786a1-a181-4286-a57f-97a49eb8ecd1 tempest-AttachVolumeNegativeTest-1135519864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:21:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5ae786a1-a181-4286-a57f-97a49eb8ecd1 tempest-AttachVolumeNegativeTest-1135519864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:21:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5ae786a1-a181-4286-a57f-97a49eb8ecd1 tempest-AttachVolumeNegativeTest-1135519864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:21:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5ae786a1-a181-4286-a57f-97a49eb8ecd1 tempest-AttachVolumeNegativeTest-1135519864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:21:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5ae786a1-a181-4286-a57f-97a49eb8ecd1 tempest-AttachVolumeNegativeTest-1135519864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:21:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5ae786a1-a181-4286-a57f-97a49eb8ecd1 tempest-AttachVolumeNegativeTest-1135519864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:12 devstack sudo[97404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:21:12 devstack sudo[97404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:12 devstack sudo[97404]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5ae786a1-a181-4286-a57f-97a49eb8ecd1 tempest-AttachVolumeNegativeTest-1135519864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.428s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:12 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-5ae786a1-a181-4286-a57f-97a49eb8ecd1 tempest-AttachVolumeNegativeTest-1135519864 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:21:12 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-5ae786a1-a181-4286-a57f-97a49eb8ecd1 tempest-AttachVolumeNegativeTest-1135519864 None] Deleted volume successfully. Sep 03 11:21:12 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5ae786a1-a181-4286-a57f-97a49eb8ecd1 tempest-AttachVolumeNegativeTest-1135519864 None] Lock "cinder-c80e6766-3893-4574-80e9-3c693c910c52-delete_volume" released by "delete_volume" :: held 1.995s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:21:15 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=88,cinder:UPDATE=98,cinder:DELETE=11,cinder:INSERT=29 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:21:15 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:INSERT=25,cinder:SELECT=96,cinder:UPDATE=110,cinder:DELETE=4 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:21:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-4a19729f-44e5-4d4f-ae4f-e0f3f2e03e5d req-7897944f-7d4c-42ac-9920-2c7bbe964382 tempest-TestInstancesWithCinderVolumes-2123003308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:21:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-4a19729f-44e5-4d4f-ae4f-e0f3f2e03e5d req-7897944f-7d4c-42ac-9920-2c7bbe964382 tempest-TestInstancesWithCinderVolumes-2123003308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:21:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-4a19729f-44e5-4d4f-ae4f-e0f3f2e03e5d req-7897944f-7d4c-42ac-9920-2c7bbe964382 tempest-TestInstancesWithCinderVolumes-2123003308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:21:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-4a19729f-44e5-4d4f-ae4f-e0f3f2e03e5d req-7897944f-7d4c-42ac-9920-2c7bbe964382 tempest-TestInstancesWithCinderVolumes-2123003308 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912', 'name': 'volume-4d6464e4-d026-42c7-b5d1-7d8912ddfe90', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '194ac6f4-ac3c-49d7-a3cf-742fd5a202fe', 'enforce_multipath': True} {{(pid=87038) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:21:15 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-4a19729f-44e5-4d4f-ae4f-e0f3f2e03e5d req-7897944f-7d4c-42ac-9920-2c7bbe964382 tempest-TestInstancesWithCinderVolumes-2123003308 None] attachment_update completed successfully. Sep 03 11:21:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-3dc4f23e-08ba-4964-84e8-5320a78e8b2c req-525a6984-3154-4b19-86ca-0e39dd5f26b2 tempest-TestInstancesWithCinderVolumes-2123003308 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:21:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-3dc4f23e-08ba-4964-84e8-5320a78e8b2c req-525a6984-3154-4b19-86ca-0e39dd5f26b2 tempest-TestInstancesWithCinderVolumes-2123003308 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:21:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-3dc4f23e-08ba-4964-84e8-5320a78e8b2c req-525a6984-3154-4b19-86ca-0e39dd5f26b2 tempest-TestInstancesWithCinderVolumes-2123003308 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:21:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-3dc4f23e-08ba-4964-84e8-5320a78e8b2c req-525a6984-3154-4b19-86ca-0e39dd5f26b2 tempest-TestInstancesWithCinderVolumes-2123003308 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912', 'name': 'volume-13cc9434-8a78-4fc4-be4d-23d90583ee96', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '692dcc37-4701-47e4-b00c-74bf427ea3d8', 'enforce_multipath': True} {{(pid=87038) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:21:17 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-3dc4f23e-08ba-4964-84e8-5320a78e8b2c req-525a6984-3154-4b19-86ca-0e39dd5f26b2 tempest-TestInstancesWithCinderVolumes-2123003308 None] attachment_update completed successfully. Sep 03 11:21:17 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:21:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:21:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:21:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:21:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:21:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:21:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:18 devstack sudo[97553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:21:18 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:18 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.576s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:18 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:21:18 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:21:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread count: 28 {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:21:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread info: [<_MainThread(MainThread, started 139554943000704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:21:20 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-0963fe9c-efc6-4010-a0bf-e4dc4ae66e94 tempest-VolumesActionsTest-1587758661 None] Acquiring lock "cinder-6d5417d8-48f2-4ac8-8a41-517f3bf6430a" by "attach_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:21:20 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-0963fe9c-efc6-4010-a0bf-e4dc4ae66e94 tempest-VolumesActionsTest-1587758661 None] Lock "cinder-6d5417d8-48f2-4ac8-8a41-517f3bf6430a" acquired by "attach_volume" :: waited 0.037s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:21:20 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-0963fe9c-efc6-4010-a0bf-e4dc4ae66e94 tempest-VolumesActionsTest-1587758661 None] Attaching volume 6d5417d8-48f2-4ac8-8a41-517f3bf6430a to instance 7b581b0b-570d-4f32-890e-f4f9354100f0 at mountpoint /dev/vdb on host None. Sep 03 11:21:20 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-0963fe9c-efc6-4010-a0bf-e4dc4ae66e94 tempest-VolumesActionsTest-1587758661 None] Attach volume completed successfully. Sep 03 11:21:20 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-0963fe9c-efc6-4010-a0bf-e4dc4ae66e94 tempest-VolumesActionsTest-1587758661 None] Lock "cinder-6d5417d8-48f2-4ac8-8a41-517f3bf6430a" released by "attach_volume" :: held 0.166s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:21:21 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-911c8d50-9b03-4db0-a6df-0cd1443d1d59 tempest-VolumesActionsTest-1587758661 None] Acquiring lock "cinder-6d5417d8-48f2-4ac8-8a41-517f3bf6430a-detach_volume" by "detach_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:21:21 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-911c8d50-9b03-4db0-a6df-0cd1443d1d59 tempest-VolumesActionsTest-1587758661 None] Lock "cinder-6d5417d8-48f2-4ac8-8a41-517f3bf6430a-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:21:21 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-911c8d50-9b03-4db0-a6df-0cd1443d1d59 tempest-VolumesActionsTest-1587758661 None] Detaching volume 6d5417d8-48f2-4ac8-8a41-517f3bf6430a from instance 7b581b0b-570d-4f32-890e-f4f9354100f0. Sep 03 11:21:21 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-911c8d50-9b03-4db0-a6df-0cd1443d1d59 tempest-VolumesActionsTest-1587758661 None] Detach volume completed successfully. Sep 03 11:21:21 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-911c8d50-9b03-4db0-a6df-0cd1443d1d59 tempest-VolumesActionsTest-1587758661 None] Lock "cinder-6d5417d8-48f2-4ac8-8a41-517f3bf6430a-detach_volume" released by "detach_volume" :: held 0.110s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:21:25 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-430bb20f-562c-48fa-9a2a-c5327d7ddef7 req-97dec733-fe3e-4a10-9b6b-6ea1e71411da tempest-TestInstancesWithCinderVolumes-2123003308 None] Terminate volume connection completed successfully. Sep 03 11:21:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-430bb20f-562c-48fa-9a2a-c5327d7ddef7 req-97dec733-fe3e-4a10-9b6b-6ea1e71411da tempest-TestInstancesWithCinderVolumes-2123003308 None] Deleting attachment 194ac6f4-ac3c-49d7-a3cf-742fd5a202fe. {{(pid=87038) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:21:25 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-369e4c11-50eb-43d6-897a-873cbf6439ba tempest-TestInstancesWithCinderVolumes-2123003308 None] Acquiring lock "cinder-4d6464e4-d026-42c7-b5d1-7d8912ddfe90-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:21:25 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-369e4c11-50eb-43d6-897a-873cbf6439ba tempest-TestInstancesWithCinderVolumes-2123003308 None] Lock "cinder-4d6464e4-d026-42c7-b5d1-7d8912ddfe90-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:21:26 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-369e4c11-50eb-43d6-897a-873cbf6439ba tempest-TestInstancesWithCinderVolumes-2123003308 None] Acquiring lock "cinder-quobyte-4d6464e4-d026-42c7-b5d1-7d8912ddfe90" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:21:26 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-369e4c11-50eb-43d6-897a-873cbf6439ba tempest-TestInstancesWithCinderVolumes-2123003308 None] Lock "cinder-quobyte-4d6464e4-d026-42c7-b5d1-7d8912ddfe90" acquired by "delete_volume" :: waited 0.028s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:21:26 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd9c3e2-6135-4e08-b8d5-63682b2d2ea0]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:21:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-369e4c11-50eb-43d6-897a-873cbf6439ba tempest-TestInstancesWithCinderVolumes-2123003308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4d6464e4-d026-42c7-b5d1-7d8912ddfe90 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:26 devstack sudo[97622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4d6464e4-d026-42c7-b5d1-7d8912ddfe90 Sep 03 11:21:26 devstack sudo[97622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:26 devstack sudo[97622]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-369e4c11-50eb-43d6-897a-873cbf6439ba tempest-TestInstancesWithCinderVolumes-2123003308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4d6464e4-d026-42c7-b5d1-7d8912ddfe90" returned: 0 in 0.635s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-369e4c11-50eb-43d6-897a-873cbf6439ba tempest-TestInstancesWithCinderVolumes-2123003308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4d6464e4-d026-42c7-b5d1-7d8912ddfe90 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:26 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4d6464e4-d026-42c7-b5d1-7d8912ddfe90 Sep 03 11:21:26 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:26 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [req-3c3910a7-1e1c-44ba-8454-d5d4d12a8bf1 req-01e9693d-7b08-47e6-8975-ee5cbcc423ab tempest-VolumesGetTestJSON-538573219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:21:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-3c3910a7-1e1c-44ba-8454-d5d4d12a8bf1 req-01e9693d-7b08-47e6-8975-ee5cbcc423ab tempest-VolumesGetTestJSON-538573219 None] Flow 'volume_create_manager' (8d9c8c8c-5d49-4fae-97d4-321c17e82a6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:21:27 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-3c3910a7-1e1c-44ba-8454-d5d4d12a8bf1 req-01e9693d-7b08-47e6-8975-ee5cbcc423ab tempest-VolumesGetTestJSON-538573219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d50a7df6-673c-4970-a1bb-bc1ca023ce3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:21:27 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-3c3910a7-1e1c-44ba-8454-d5d4d12a8bf1 req-01e9693d-7b08-47e6-8975-ee5cbcc423ab tempest-VolumesGetTestJSON-538573219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d50a7df6-673c-4970-a1bb-bc1ca023ce3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-624665494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35dc6511-cae7-4001-ab5b-88a4193d887e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fbc30c37b31140cca15024a1d845d1da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:21:27Z,use_quota=True,user_id='2174081eef6042fea8c85b8ffdbe1237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:21:27 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-3c3910a7-1e1c-44ba-8454-d5d4d12a8bf1 req-01e9693d-7b08-47e6-8975-ee5cbcc423ab tempest-VolumesGetTestJSON-538573219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c349277e-9213-4f25-bdeb-a239c9553699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:21:27 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-3c3910a7-1e1c-44ba-8454-d5d4d12a8bf1 req-01e9693d-7b08-47e6-8975-ee5cbcc423ab tempest-VolumesGetTestJSON-538573219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c349277e-9213-4f25-bdeb-a239c9553699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:21:27 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-3c3910a7-1e1c-44ba-8454-d5d4d12a8bf1 req-01e9693d-7b08-47e6-8975-ee5cbcc423ab tempest-VolumesGetTestJSON-538573219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01bd0e51-4e44-4b1b-83a9-b70a5c54ce10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:21:27 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-3c3910a7-1e1c-44ba-8454-d5d4d12a8bf1 req-01e9693d-7b08-47e6-8975-ee5cbcc423ab tempest-VolumesGetTestJSON-538573219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01bd0e51-4e44-4b1b-83a9-b70a5c54ce10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35dc6511-cae7-4001-ab5b-88a4193d887e', 'volume_name': 'volume-35dc6511-cae7-4001-ab5b-88a4193d887e', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:21:27 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-3c3910a7-1e1c-44ba-8454-d5d4d12a8bf1 req-01e9693d-7b08-47e6-8975-ee5cbcc423ab tempest-VolumesGetTestJSON-538573219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a6fa19a-670a-4b77-888a-4399258d201e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:21:27 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-3c3910a7-1e1c-44ba-8454-d5d4d12a8bf1 req-01e9693d-7b08-47e6-8975-ee5cbcc423ab tempest-VolumesGetTestJSON-538573219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a6fa19a-670a-4b77-888a-4399258d201e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:21:27 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-3c3910a7-1e1c-44ba-8454-d5d4d12a8bf1 req-01e9693d-7b08-47e6-8975-ee5cbcc423ab tempest-VolumesGetTestJSON-538573219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c668f563-3642-4df0-8cbe-4496f730c44f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:21:27 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [req-3c3910a7-1e1c-44ba-8454-d5d4d12a8bf1 req-01e9693d-7b08-47e6-8975-ee5cbcc423ab tempest-VolumesGetTestJSON-538573219 None] Volume 35dc6511-cae7-4001-ab5b-88a4193d887e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35dc6511-cae7-4001-ab5b-88a4193d887e', 'volume_size': 1} Sep 03 11:21:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-3c3910a7-1e1c-44ba-8454-d5d4d12a8bf1 req-01e9693d-7b08-47e6-8975-ee5cbcc423ab tempest-VolumesGetTestJSON-538573219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:21:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-3c3910a7-1e1c-44ba-8454-d5d4d12a8bf1 req-01e9693d-7b08-47e6-8975-ee5cbcc423ab tempest-VolumesGetTestJSON-538573219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:21:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [req-3c3910a7-1e1c-44ba-8454-d5d4d12a8bf1 req-01e9693d-7b08-47e6-8975-ee5cbcc423ab tempest-VolumesGetTestJSON-538573219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:21:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-624665494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35dc6511-cae7-4001-ab5b-88a4193d887e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fbc30c37b31140cca15024a1d845d1da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:21:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:21:27Z,use_quota=True,user_id='2174081eef6042fea8c85b8ffdbe1237',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:21:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [req-3c3910a7-1e1c-44ba-8454-d5d4d12a8bf1 req-01e9693d-7b08-47e6-8975-ee5cbcc423ab tempest-VolumesGetTestJSON-538573219 None] Creating volume 35dc6511-cae7-4001-ab5b-88a4193d887e {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:21:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-3c3910a7-1e1c-44ba-8454-d5d4d12a8bf1 req-01e9693d-7b08-47e6-8975-ee5cbcc423ab tempest-VolumesGetTestJSON-538573219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:21:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-3c3910a7-1e1c-44ba-8454-d5d4d12a8bf1 req-01e9693d-7b08-47e6-8975-ee5cbcc423ab tempest-VolumesGetTestJSON-538573219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:21:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [req-3c3910a7-1e1c-44ba-8454-d5d4d12a8bf1 req-01e9693d-7b08-47e6-8975-ee5cbcc423ab tempest-VolumesGetTestJSON-538573219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:21:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [req-3c3910a7-1e1c-44ba-8454-d5d4d12a8bf1 req-01e9693d-7b08-47e6-8975-ee5cbcc423ab tempest-VolumesGetTestJSON-538573219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:21:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-3c3910a7-1e1c-44ba-8454-d5d4d12a8bf1 req-01e9693d-7b08-47e6-8975-ee5cbcc423ab tempest-VolumesGetTestJSON-538573219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:21:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [req-3c3910a7-1e1c-44ba-8454-d5d4d12a8bf1 req-01e9693d-7b08-47e6-8975-ee5cbcc423ab tempest-VolumesGetTestJSON-538573219 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:21:27 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [req-3c3910a7-1e1c-44ba-8454-d5d4d12a8bf1 req-01e9693d-7b08-47e6-8975-ee5cbcc423ab tempest-VolumesGetTestJSON-538573219 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:21:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-3c3910a7-1e1c-44ba-8454-d5d4d12a8bf1 req-01e9693d-7b08-47e6-8975-ee5cbcc423ab tempest-VolumesGetTestJSON-538573219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-35dc6511-cae7-4001-ab5b-88a4193d887e 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:27 devstack sudo[97629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-35dc6511-cae7-4001-ab5b-88a4193d887e 1073741824 Sep 03 11:21:27 devstack sudo[97629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:27 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-369e4c11-50eb-43d6-897a-873cbf6439ba tempest-TestInstancesWithCinderVolumes-2123003308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4d6464e4-d026-42c7-b5d1-7d8912ddfe90" returned: 0 in 0.496s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:27 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-369e4c11-50eb-43d6-897a-873cbf6439ba tempest-TestInstancesWithCinderVolumes-2123003308 None] Lock "cinder-quobyte-4d6464e4-d026-42c7-b5d1-7d8912ddfe90" released by "delete_volume" :: held 1.202s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:21:27 devstack cinder-volume[87038]: WARNING cinder.quota [None req-369e4c11-50eb-43d6-897a-873cbf6439ba tempest-TestInstancesWithCinderVolumes-2123003308 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-18230336-2108700286 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-18230336-2108700286, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:21:27 devstack cinder-volume[87038]: WARNING cinder.quota [None req-369e4c11-50eb-43d6-897a-873cbf6439ba tempest-TestInstancesWithCinderVolumes-2123003308 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-18230336-2108700286 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-18230336-2108700286, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:21:27 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-369e4c11-50eb-43d6-897a-873cbf6439ba tempest-TestInstancesWithCinderVolumes-2123003308 None] Created reservations ['f71b0b01-5226-4185-adbe-5e39e3d66dd7', '46acab56-0691-4d59-bc68-81a2ade5f3bc', '2ecae7b3-3286-4760-bdf0-27625d613671', 'ecf26b3d-54ca-496d-bf91-bee39a8730a3'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:21:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-369e4c11-50eb-43d6-897a-873cbf6439ba tempest-TestInstancesWithCinderVolumes-2123003308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:21:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-369e4c11-50eb-43d6-897a-873cbf6439ba tempest-TestInstancesWithCinderVolumes-2123003308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:21:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-369e4c11-50eb-43d6-897a-873cbf6439ba tempest-TestInstancesWithCinderVolumes-2123003308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:21:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-369e4c11-50eb-43d6-897a-873cbf6439ba tempest-TestInstancesWithCinderVolumes-2123003308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:21:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-369e4c11-50eb-43d6-897a-873cbf6439ba tempest-TestInstancesWithCinderVolumes-2123003308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:21:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-369e4c11-50eb-43d6-897a-873cbf6439ba tempest-TestInstancesWithCinderVolumes-2123003308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:27 devstack sudo[97632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:21:27 devstack sudo[97632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:27 devstack sudo[97632]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-369e4c11-50eb-43d6-897a-873cbf6439ba tempest-TestInstancesWithCinderVolumes-2123003308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.483s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:27 devstack sudo[97629]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:27 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-369e4c11-50eb-43d6-897a-873cbf6439ba tempest-TestInstancesWithCinderVolumes-2123003308 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:21:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-3c3910a7-1e1c-44ba-8454-d5d4d12a8bf1 req-01e9693d-7b08-47e6-8975-ee5cbcc423ab tempest-VolumesGetTestJSON-538573219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-35dc6511-cae7-4001-ab5b-88a4193d887e 1073741824" returned: 0 in 0.846s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:28 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-369e4c11-50eb-43d6-897a-873cbf6439ba tempest-TestInstancesWithCinderVolumes-2123003308 None] Deleted volume successfully. Sep 03 11:21:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-3c3910a7-1e1c-44ba-8454-d5d4d12a8bf1 req-01e9693d-7b08-47e6-8975-ee5cbcc423ab tempest-VolumesGetTestJSON-538573219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-35dc6511-cae7-4001-ab5b-88a4193d887e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:28 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-369e4c11-50eb-43d6-897a-873cbf6439ba tempest-TestInstancesWithCinderVolumes-2123003308 None] Lock "cinder-4d6464e4-d026-42c7-b5d1-7d8912ddfe90-delete_volume" released by "delete_volume" :: held 2.109s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:21:28 devstack sudo[97643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-35dc6511-cae7-4001-ab5b-88a4193d887e Sep 03 11:21:28 devstack sudo[97643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:28 devstack sudo[97643]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-3c3910a7-1e1c-44ba-8454-d5d4d12a8bf1 req-01e9693d-7b08-47e6-8975-ee5cbcc423ab tempest-VolumesGetTestJSON-538573219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-35dc6511-cae7-4001-ab5b-88a4193d887e" returned: 0 in 0.414s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:28 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [req-3c3910a7-1e1c-44ba-8454-d5d4d12a8bf1 req-01e9693d-7b08-47e6-8975-ee5cbcc423ab tempest-VolumesGetTestJSON-538573219 None] <== create_volume: return (1378ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:21:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-3c3910a7-1e1c-44ba-8454-d5d4d12a8bf1 req-01e9693d-7b08-47e6-8975-ee5cbcc423ab tempest-VolumesGetTestJSON-538573219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.381s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:21:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-3c3910a7-1e1c-44ba-8454-d5d4d12a8bf1 req-01e9693d-7b08-47e6-8975-ee5cbcc423ab tempest-VolumesGetTestJSON-538573219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c668f563-3642-4df0-8cbe-4496f730c44f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35dc6511-cae7-4001-ab5b-88a4193d887e', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:21:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-3c3910a7-1e1c-44ba-8454-d5d4d12a8bf1 req-01e9693d-7b08-47e6-8975-ee5cbcc423ab tempest-VolumesGetTestJSON-538573219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5d19abf-97e8-468d-b9ec-62fd2032f08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:21:28 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [req-3c3910a7-1e1c-44ba-8454-d5d4d12a8bf1 req-01e9693d-7b08-47e6-8975-ee5cbcc423ab tempest-VolumesGetTestJSON-538573219 None] Volume volume-35dc6511-cae7-4001-ab5b-88a4193d887e (35dc6511-cae7-4001-ab5b-88a4193d887e): created successfully Sep 03 11:21:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-3c3910a7-1e1c-44ba-8454-d5d4d12a8bf1 req-01e9693d-7b08-47e6-8975-ee5cbcc423ab tempest-VolumesGetTestJSON-538573219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5d19abf-97e8-468d-b9ec-62fd2032f08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:21:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-3c3910a7-1e1c-44ba-8454-d5d4d12a8bf1 req-01e9693d-7b08-47e6-8975-ee5cbcc423ab tempest-VolumesGetTestJSON-538573219 None] Flow 'volume_create_manager' (8d9c8c8c-5d49-4fae-97d4-321c17e82a6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:21:28 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-3c3910a7-1e1c-44ba-8454-d5d4d12a8bf1 req-01e9693d-7b08-47e6-8975-ee5cbcc423ab tempest-VolumesGetTestJSON-538573219 None] Created volume successfully. Sep 03 11:21:29 devstack cinder-volume[87038]: DEBUG cinder.coordination [req-a8da3ece-a6bb-4b0a-b66d-3f34e5a55465 req-2d15ac7f-ae00-458c-b226-836fc779ba7d tempest-VolumesGetTestJSON-538573219 None] Acquiring lock "cinder-35dc6511-cae7-4001-ab5b-88a4193d887e-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:21:29 devstack cinder-volume[87038]: DEBUG cinder.coordination [req-a8da3ece-a6bb-4b0a-b66d-3f34e5a55465 req-2d15ac7f-ae00-458c-b226-836fc779ba7d tempest-VolumesGetTestJSON-538573219 None] Lock "cinder-35dc6511-cae7-4001-ab5b-88a4193d887e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:21:29 devstack cinder-volume[87038]: DEBUG cinder.coordination [req-a8da3ece-a6bb-4b0a-b66d-3f34e5a55465 req-2d15ac7f-ae00-458c-b226-836fc779ba7d tempest-VolumesGetTestJSON-538573219 None] Acquiring lock "cinder-quobyte-35dc6511-cae7-4001-ab5b-88a4193d887e" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:21:29 devstack cinder-volume[87038]: DEBUG cinder.coordination [req-a8da3ece-a6bb-4b0a-b66d-3f34e5a55465 req-2d15ac7f-ae00-458c-b226-836fc779ba7d tempest-VolumesGetTestJSON-538573219 None] Lock "cinder-quobyte-35dc6511-cae7-4001-ab5b-88a4193d887e" acquired by "delete_volume" :: waited 0.023s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:21:29 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2a9487-9e5e-43f9-8410-986ec6e6566b]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:21:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-a8da3ece-a6bb-4b0a-b66d-3f34e5a55465 req-2d15ac7f-ae00-458c-b226-836fc779ba7d tempest-VolumesGetTestJSON-538573219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-35dc6511-cae7-4001-ab5b-88a4193d887e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:29 devstack sudo[97679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-35dc6511-cae7-4001-ab5b-88a4193d887e Sep 03 11:21:29 devstack sudo[97679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:30 devstack sudo[97679]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-a8da3ece-a6bb-4b0a-b66d-3f34e5a55465 req-2d15ac7f-ae00-458c-b226-836fc779ba7d tempest-VolumesGetTestJSON-538573219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-35dc6511-cae7-4001-ab5b-88a4193d887e" returned: 0 in 0.525s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-a8da3ece-a6bb-4b0a-b66d-3f34e5a55465 req-2d15ac7f-ae00-458c-b226-836fc779ba7d tempest-VolumesGetTestJSON-538573219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-35dc6511-cae7-4001-ab5b-88a4193d887e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:30 devstack sudo[97684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-35dc6511-cae7-4001-ab5b-88a4193d887e Sep 03 11:21:30 devstack sudo[97684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:30 devstack sudo[97684]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-a8da3ece-a6bb-4b0a-b66d-3f34e5a55465 req-2d15ac7f-ae00-458c-b226-836fc779ba7d tempest-VolumesGetTestJSON-538573219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-35dc6511-cae7-4001-ab5b-88a4193d887e" returned: 0 in 0.380s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [req-a8da3ece-a6bb-4b0a-b66d-3f34e5a55465 req-2d15ac7f-ae00-458c-b226-836fc779ba7d tempest-VolumesGetTestJSON-538573219 None] Lock "cinder-quobyte-35dc6511-cae7-4001-ab5b-88a4193d887e" released by "delete_volume" :: held 0.975s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:21:30 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-1d7c8910-18c2-488d-9248-0c17f9f3b12c tempest-VolumesDeleteCascade-1068918560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:21:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1d7c8910-18c2-488d-9248-0c17f9f3b12c tempest-VolumesDeleteCascade-1068918560 None] Flow 'volume_create_manager' (a151c7b2-ec0f-4f73-bd12-6082afeb5d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:21:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1d7c8910-18c2-488d-9248-0c17f9f3b12c tempest-VolumesDeleteCascade-1068918560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf2e1ddd-978e-4b76-b5d9-eb64dc479193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:21:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1d7c8910-18c2-488d-9248-0c17f9f3b12c tempest-VolumesDeleteCascade-1068918560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf2e1ddd-978e-4b76-b5d9-eb64dc479193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1474741078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c05e443d-3d50-419b-b881-e397259b13ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc7ebe2c0ae8454a84774166c65e32ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:21:31Z,use_quota=True,user_id='60f8e7604e244d23a6a36e22d9a9ff23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:21:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1d7c8910-18c2-488d-9248-0c17f9f3b12c tempest-VolumesDeleteCascade-1068918560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d4f9ab8-a0eb-4131-8cba-12501a055254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:21:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1d7c8910-18c2-488d-9248-0c17f9f3b12c tempest-VolumesDeleteCascade-1068918560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d4f9ab8-a0eb-4131-8cba-12501a055254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:21:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1d7c8910-18c2-488d-9248-0c17f9f3b12c tempest-VolumesDeleteCascade-1068918560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a47d3e56-c339-4d31-b9a8-6890961a4059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:21:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1d7c8910-18c2-488d-9248-0c17f9f3b12c tempest-VolumesDeleteCascade-1068918560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a47d3e56-c339-4d31-b9a8-6890961a4059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c05e443d-3d50-419b-b881-e397259b13ba', 'volume_name': 'volume-c05e443d-3d50-419b-b881-e397259b13ba', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:21:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1d7c8910-18c2-488d-9248-0c17f9f3b12c tempest-VolumesDeleteCascade-1068918560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a5cd2f8-ca24-41d3-838f-a8925d19a507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:21:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1d7c8910-18c2-488d-9248-0c17f9f3b12c tempest-VolumesDeleteCascade-1068918560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a5cd2f8-ca24-41d3-838f-a8925d19a507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:21:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1d7c8910-18c2-488d-9248-0c17f9f3b12c tempest-VolumesDeleteCascade-1068918560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8486f64-d229-4467-b914-33be97d081e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:21:30 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-1d7c8910-18c2-488d-9248-0c17f9f3b12c tempest-VolumesDeleteCascade-1068918560 None] Volume c05e443d-3d50-419b-b881-e397259b13ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c05e443d-3d50-419b-b881-e397259b13ba', 'volume_size': 1} Sep 03 11:21:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1d7c8910-18c2-488d-9248-0c17f9f3b12c tempest-VolumesDeleteCascade-1068918560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:21:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1d7c8910-18c2-488d-9248-0c17f9f3b12c tempest-VolumesDeleteCascade-1068918560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:21:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1d7c8910-18c2-488d-9248-0c17f9f3b12c tempest-VolumesDeleteCascade-1068918560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1474741078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c05e443d-3d50-419b-b881-e397259b13ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc7ebe2c0ae8454a84774166c65e32ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:21:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:21:31Z,use_quota=True,user_id='60f8e7604e244d23a6a36e22d9a9ff23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:21:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-1d7c8910-18c2-488d-9248-0c17f9f3b12c tempest-VolumesDeleteCascade-1068918560 None] Creating volume c05e443d-3d50-419b-b881-e397259b13ba {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:21:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1d7c8910-18c2-488d-9248-0c17f9f3b12c tempest-VolumesDeleteCascade-1068918560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:21:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1d7c8910-18c2-488d-9248-0c17f9f3b12c tempest-VolumesDeleteCascade-1068918560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:21:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1d7c8910-18c2-488d-9248-0c17f9f3b12c tempest-VolumesDeleteCascade-1068918560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:21:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1d7c8910-18c2-488d-9248-0c17f9f3b12c tempest-VolumesDeleteCascade-1068918560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:21:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1d7c8910-18c2-488d-9248-0c17f9f3b12c tempest-VolumesDeleteCascade-1068918560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:21:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1d7c8910-18c2-488d-9248-0c17f9f3b12c tempest-VolumesDeleteCascade-1068918560 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:21:30 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-1d7c8910-18c2-488d-9248-0c17f9f3b12c tempest-VolumesDeleteCascade-1068918560 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:21:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1d7c8910-18c2-488d-9248-0c17f9f3b12c tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:30 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba 1073741824 Sep 03 11:21:30 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:30 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-2eb1d99e-35ec-490d-9eba-462f4e1ea970 req-aab52476-de08-4972-94b9-cb65122d4a2c tempest-TestInstancesWithCinderVolumes-2123003308 None] Terminate volume connection completed successfully. Sep 03 11:21:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-2eb1d99e-35ec-490d-9eba-462f4e1ea970 req-aab52476-de08-4972-94b9-cb65122d4a2c tempest-TestInstancesWithCinderVolumes-2123003308 None] Deleting attachment 692dcc37-4701-47e4-b00c-74bf427ea3d8. {{(pid=87038) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:21:30 devstack cinder-volume[87038]: DEBUG cinder.quota [req-a8da3ece-a6bb-4b0a-b66d-3f34e5a55465 req-2d15ac7f-ae00-458c-b226-836fc779ba7d tempest-VolumesGetTestJSON-538573219 None] Created reservations ['01ba07b4-8902-47ea-a125-9a8c238dc631', '336d2b51-6d7b-484b-9ad7-8b8ad4dc4b8f', 'b2cfe91b-2fa0-4194-9de8-096e8d79b2b0', '47d871a4-2056-4826-940c-724f0a8db641'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:21:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-a8da3ece-a6bb-4b0a-b66d-3f34e5a55465 req-2d15ac7f-ae00-458c-b226-836fc779ba7d tempest-VolumesGetTestJSON-538573219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:21:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-a8da3ece-a6bb-4b0a-b66d-3f34e5a55465 req-2d15ac7f-ae00-458c-b226-836fc779ba7d tempest-VolumesGetTestJSON-538573219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:21:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [req-a8da3ece-a6bb-4b0a-b66d-3f34e5a55465 req-2d15ac7f-ae00-458c-b226-836fc779ba7d tempest-VolumesGetTestJSON-538573219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:21:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [req-a8da3ece-a6bb-4b0a-b66d-3f34e5a55465 req-2d15ac7f-ae00-458c-b226-836fc779ba7d tempest-VolumesGetTestJSON-538573219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:21:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-a8da3ece-a6bb-4b0a-b66d-3f34e5a55465 req-2d15ac7f-ae00-458c-b226-836fc779ba7d tempest-VolumesGetTestJSON-538573219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:21:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-a8da3ece-a6bb-4b0a-b66d-3f34e5a55465 req-2d15ac7f-ae00-458c-b226-836fc779ba7d tempest-VolumesGetTestJSON-538573219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:31 devstack sudo[97692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:21:31 devstack sudo[97692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:31 devstack sudo[97692]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-a8da3ece-a6bb-4b0a-b66d-3f34e5a55465 req-2d15ac7f-ae00-458c-b226-836fc779ba7d tempest-VolumesGetTestJSON-538573219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.473s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:31 devstack cinder-volume[87038]: DEBUG cinder.manager [req-a8da3ece-a6bb-4b0a-b66d-3f34e5a55465 req-2d15ac7f-ae00-458c-b226-836fc779ba7d tempest-VolumesGetTestJSON-538573219 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:21:31 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-a8da3ece-a6bb-4b0a-b66d-3f34e5a55465 req-2d15ac7f-ae00-458c-b226-836fc779ba7d tempest-VolumesGetTestJSON-538573219 None] Deleted volume successfully. Sep 03 11:21:31 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:31 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-94399100-effc-45c6-be1b-7c9acd9713bf tempest-TestInstancesWithCinderVolumes-2123003308 None] Acquiring lock "cinder-13cc9434-8a78-4fc4-be4d-23d90583ee96-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:21:31 devstack cinder-volume[87038]: DEBUG cinder.coordination [req-a8da3ece-a6bb-4b0a-b66d-3f34e5a55465 req-2d15ac7f-ae00-458c-b226-836fc779ba7d tempest-VolumesGetTestJSON-538573219 None] Lock "cinder-35dc6511-cae7-4001-ab5b-88a4193d887e-delete_volume" released by "delete_volume" :: held 1.988s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:21:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1d7c8910-18c2-488d-9248-0c17f9f3b12c tempest-VolumesDeleteCascade-1068918560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba 1073741824" returned: 0 in 0.708s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:31 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-94399100-effc-45c6-be1b-7c9acd9713bf tempest-TestInstancesWithCinderVolumes-2123003308 None] Lock "cinder-13cc9434-8a78-4fc4-be4d-23d90583ee96-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:21:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1d7c8910-18c2-488d-9248-0c17f9f3b12c tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:31 devstack sudo[97722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba Sep 03 11:21:31 devstack sudo[97722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:31 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-94399100-effc-45c6-be1b-7c9acd9713bf tempest-TestInstancesWithCinderVolumes-2123003308 None] Acquiring lock "cinder-quobyte-13cc9434-8a78-4fc4-be4d-23d90583ee96" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:21:31 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-94399100-effc-45c6-be1b-7c9acd9713bf tempest-TestInstancesWithCinderVolumes-2123003308 None] Lock "cinder-quobyte-13cc9434-8a78-4fc4-be4d-23d90583ee96" acquired by "delete_volume" :: waited 0.023s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:21:31 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[089f71db-a7b2-4902-8c2d-2dafcfe89e51]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:21:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-94399100-effc-45c6-be1b-7c9acd9713bf tempest-TestInstancesWithCinderVolumes-2123003308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-13cc9434-8a78-4fc4-be4d-23d90583ee96 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:32 devstack sudo[97741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-13cc9434-8a78-4fc4-be4d-23d90583ee96 Sep 03 11:21:32 devstack sudo[97741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:32 devstack sudo[97722]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1d7c8910-18c2-488d-9248-0c17f9f3b12c tempest-VolumesDeleteCascade-1068918560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba" returned: 0 in 0.747s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1d7c8910-18c2-488d-9248-0c17f9f3b12c tempest-VolumesDeleteCascade-1068918560 None] <== create_volume: return (1563ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:21:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1d7c8910-18c2-488d-9248-0c17f9f3b12c tempest-VolumesDeleteCascade-1068918560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:21:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1d7c8910-18c2-488d-9248-0c17f9f3b12c tempest-VolumesDeleteCascade-1068918560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8486f64-d229-4467-b914-33be97d081e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c05e443d-3d50-419b-b881-e397259b13ba', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:21:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1d7c8910-18c2-488d-9248-0c17f9f3b12c tempest-VolumesDeleteCascade-1068918560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5159f22e-9ab8-42d4-bc12-bc2c75a5c32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:21:32 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-1d7c8910-18c2-488d-9248-0c17f9f3b12c tempest-VolumesDeleteCascade-1068918560 None] Volume volume-c05e443d-3d50-419b-b881-e397259b13ba (c05e443d-3d50-419b-b881-e397259b13ba): created successfully Sep 03 11:21:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1d7c8910-18c2-488d-9248-0c17f9f3b12c tempest-VolumesDeleteCascade-1068918560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5159f22e-9ab8-42d4-bc12-bc2c75a5c32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:21:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1d7c8910-18c2-488d-9248-0c17f9f3b12c tempest-VolumesDeleteCascade-1068918560 None] Flow 'volume_create_manager' (a151c7b2-ec0f-4f73-bd12-6082afeb5d6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:21:32 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-1d7c8910-18c2-488d-9248-0c17f9f3b12c tempest-VolumesDeleteCascade-1068918560 None] Created volume successfully. Sep 03 11:21:32 devstack sudo[97741]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-94399100-effc-45c6-be1b-7c9acd9713bf tempest-TestInstancesWithCinderVolumes-2123003308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-13cc9434-8a78-4fc4-be4d-23d90583ee96" returned: 0 in 0.962s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-94399100-effc-45c6-be1b-7c9acd9713bf tempest-TestInstancesWithCinderVolumes-2123003308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-13cc9434-8a78-4fc4-be4d-23d90583ee96 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:32 devstack sudo[97774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-13cc9434-8a78-4fc4-be4d-23d90583ee96 Sep 03 11:21:32 devstack sudo[97774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:33 devstack sudo[97774]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-94399100-effc-45c6-be1b-7c9acd9713bf tempest-TestInstancesWithCinderVolumes-2123003308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-13cc9434-8a78-4fc4-be4d-23d90583ee96" returned: 0 in 0.621s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d2a79690-45ab-4e3e-858f-417f53b83b66 tempest-VolumesDeleteCascade-1068918560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:21:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d2a79690-45ab-4e3e-858f-417f53b83b66 tempest-VolumesDeleteCascade-1068918560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:21:33 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-94399100-effc-45c6-be1b-7c9acd9713bf tempest-TestInstancesWithCinderVolumes-2123003308 None] Lock "cinder-quobyte-13cc9434-8a78-4fc4-be4d-23d90583ee96" released by "delete_volume" :: held 1.699s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:21:33 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-d2a79690-45ab-4e3e-858f-417f53b83b66 tempest-VolumesDeleteCascade-1068918560 None] Creating offline snapshot d8858c1d-ebf6-4731-a752-c5b33ea3e11d of volume c05e443d-3d50-419b-b881-e397259b13ba {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:21:33 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3f6eb4-3372-4b6d-8f21-3cbcdea9ac42]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:21:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d2a79690-45ab-4e3e-858f-417f53b83b66 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:33 devstack cinder-volume[87038]: WARNING cinder.quota [None req-94399100-effc-45c6-be1b-7c9acd9713bf tempest-TestInstancesWithCinderVolumes-2123003308 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-490577183-1989188563 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-490577183-1989188563, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:21:33 devstack cinder-volume[87038]: WARNING cinder.quota [None req-94399100-effc-45c6-be1b-7c9acd9713bf tempest-TestInstancesWithCinderVolumes-2123003308 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-490577183-1989188563 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-490577183-1989188563, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:21:33 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-94399100-effc-45c6-be1b-7c9acd9713bf tempest-TestInstancesWithCinderVolumes-2123003308 None] Created reservations ['2f9d6b7f-449d-405a-9e8e-3e6ee19a161d', '88684d8e-4047-4d3b-9569-2fa6561eccf4', '7f67421f-ee06-4835-a5d1-c5176e696a8a', '5afd5b07-ad01-49eb-a55a-d002b2820e12'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:21:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-94399100-effc-45c6-be1b-7c9acd9713bf tempest-TestInstancesWithCinderVolumes-2123003308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:21:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-94399100-effc-45c6-be1b-7c9acd9713bf tempest-TestInstancesWithCinderVolumes-2123003308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:21:33 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-94399100-effc-45c6-be1b-7c9acd9713bf tempest-TestInstancesWithCinderVolumes-2123003308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:21:33 devstack sudo[97780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba Sep 03 11:21:33 devstack sudo[97780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:33 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-94399100-effc-45c6-be1b-7c9acd9713bf tempest-TestInstancesWithCinderVolumes-2123003308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:21:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-94399100-effc-45c6-be1b-7c9acd9713bf tempest-TestInstancesWithCinderVolumes-2123003308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:21:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-94399100-effc-45c6-be1b-7c9acd9713bf tempest-TestInstancesWithCinderVolumes-2123003308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:33 devstack sudo[97784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:21:33 devstack sudo[97784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:34 devstack sudo[97780]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d2a79690-45ab-4e3e-858f-417f53b83b66 tempest-VolumesDeleteCascade-1068918560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba" returned: 0 in 0.767s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d2a79690-45ab-4e3e-858f-417f53b83b66 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.d8858c1d-ebf6-4731-a752-c5b33ea3e11d 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:34 devstack sudo[97784]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-94399100-effc-45c6-be1b-7c9acd9713bf tempest-TestInstancesWithCinderVolumes-2123003308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.457s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:34 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-94399100-effc-45c6-be1b-7c9acd9713bf tempest-TestInstancesWithCinderVolumes-2123003308 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:21:34 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-94399100-effc-45c6-be1b-7c9acd9713bf tempest-TestInstancesWithCinderVolumes-2123003308 None] Deleted volume successfully. Sep 03 11:21:34 devstack sudo[97791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.d8858c1d-ebf6-4731-a752-c5b33ea3e11d 1G Sep 03 11:21:34 devstack sudo[97791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:34 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-94399100-effc-45c6-be1b-7c9acd9713bf tempest-TestInstancesWithCinderVolumes-2123003308 None] Lock "cinder-13cc9434-8a78-4fc4-be4d-23d90583ee96-delete_volume" released by "delete_volume" :: held 2.842s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:21:35 devstack sudo[97791]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d2a79690-45ab-4e3e-858f-417f53b83b66 tempest-VolumesDeleteCascade-1068918560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.d8858c1d-ebf6-4731-a752-c5b33ea3e11d 1G" returned: 0 in 0.738s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d2a79690-45ab-4e3e-858f-417f53b83b66 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c05e443d-3d50-419b-b881-e397259b13ba -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.d8858c1d-ebf6-4731-a752-c5b33ea3e11d {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:35 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c05e443d-3d50-419b-b881-e397259b13ba -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.d8858c1d-ebf6-4731-a752-c5b33ea3e11d Sep 03 11:21:35 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:35 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d2a79690-45ab-4e3e-858f-417f53b83b66 tempest-VolumesDeleteCascade-1068918560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c05e443d-3d50-419b-b881-e397259b13ba -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.d8858c1d-ebf6-4731-a752-c5b33ea3e11d" returned: 0 in 0.408s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:35 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-d2a79690-45ab-4e3e-858f-417f53b83b66 tempest-VolumesDeleteCascade-1068918560 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.d8858c1d-ebf6-4731-a752-c5b33ea3e11d is being set with open permissions: ugo+rw Sep 03 11:21:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d2a79690-45ab-4e3e-858f-417f53b83b66 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.d8858c1d-ebf6-4731-a752-c5b33ea3e11d {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:35 devstack sudo[97809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.d8858c1d-ebf6-4731-a752-c5b33ea3e11d Sep 03 11:21:35 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:35 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d2a79690-45ab-4e3e-858f-417f53b83b66 tempest-VolumesDeleteCascade-1068918560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.d8858c1d-ebf6-4731-a752-c5b33ea3e11d" returned: 0 in 0.291s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d2a79690-45ab-4e3e-858f-417f53b83b66 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:35 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.info Sep 03 11:21:35 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:36 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d2a79690-45ab-4e3e-858f-417f53b83b66 tempest-VolumesDeleteCascade-1068918560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.info" returned: 0 in 0.705s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:36 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-d2a79690-45ab-4e3e-858f-417f53b83b66 tempest-VolumesDeleteCascade-1068918560 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.info is being set with open permissions: ugo+rw Sep 03 11:21:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d2a79690-45ab-4e3e-858f-417f53b83b66 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:36 devstack sudo[97817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.info Sep 03 11:21:36 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e83b3c77-0ed7-450a-934e-5d31fc11e822 tempest-VolumesActionsTest-1587758661 None] Acquiring lock "cinder-6d5417d8-48f2-4ac8-8a41-517f3bf6430a" by "attach_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:21:37 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e83b3c77-0ed7-450a-934e-5d31fc11e822 tempest-VolumesActionsTest-1587758661 None] Lock "cinder-6d5417d8-48f2-4ac8-8a41-517f3bf6430a" acquired by "attach_volume" :: waited 0.031s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:21:37 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-e83b3c77-0ed7-450a-934e-5d31fc11e822 tempest-VolumesActionsTest-1587758661 None] Attaching volume 6d5417d8-48f2-4ac8-8a41-517f3bf6430a to instance e44035c5-56db-4b57-86cb-efedeeb825f1 at mountpoint /dev/vdb on host None. Sep 03 11:21:37 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d2a79690-45ab-4e3e-858f-417f53b83b66 tempest-VolumesDeleteCascade-1068918560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.info" returned: 0 in 0.629s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d2a79690-45ab-4e3e-858f-417f53b83b66 tempest-VolumesDeleteCascade-1068918560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.769s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:21:37 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-e83b3c77-0ed7-450a-934e-5d31fc11e822 tempest-VolumesActionsTest-1587758661 None] Attach volume completed successfully. Sep 03 11:21:37 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e83b3c77-0ed7-450a-934e-5d31fc11e822 tempest-VolumesActionsTest-1587758661 None] Lock "cinder-6d5417d8-48f2-4ac8-8a41-517f3bf6430a" released by "attach_volume" :: held 0.250s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:21:37 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-d2a79690-45ab-4e3e-858f-417f53b83b66 tempest-VolumesDeleteCascade-1068918560 None] Create snapshot completed successfully Sep 03 11:21:37 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3bfbd066-0378-414c-99a0-a5257d258000 tempest-VolumesActionsTest-1587758661 None] Acquiring lock "cinder-6d5417d8-48f2-4ac8-8a41-517f3bf6430a-detach_volume" by "detach_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:21:37 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3bfbd066-0378-414c-99a0-a5257d258000 tempest-VolumesActionsTest-1587758661 None] Lock "cinder-6d5417d8-48f2-4ac8-8a41-517f3bf6430a-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:21:37 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-3bfbd066-0378-414c-99a0-a5257d258000 tempest-VolumesActionsTest-1587758661 None] Detaching volume 6d5417d8-48f2-4ac8-8a41-517f3bf6430a from instance e44035c5-56db-4b57-86cb-efedeeb825f1. Sep 03 11:21:38 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-3bfbd066-0378-414c-99a0-a5257d258000 tempest-VolumesActionsTest-1587758661 None] Detach volume completed successfully. Sep 03 11:21:38 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3bfbd066-0378-414c-99a0-a5257d258000 tempest-VolumesActionsTest-1587758661 None] Lock "cinder-6d5417d8-48f2-4ac8-8a41-517f3bf6430a-detach_volume" released by "detach_volume" :: held 0.126s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:21:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4f92b722-7dac-4f9f-9b26-eaa32b9ff6ca tempest-VolumesDeleteCascade-1068918560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:21:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4f92b722-7dac-4f9f-9b26-eaa32b9ff6ca tempest-VolumesDeleteCascade-1068918560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:21:38 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-4f92b722-7dac-4f9f-9b26-eaa32b9ff6ca tempest-VolumesDeleteCascade-1068918560 None] Creating offline snapshot 6551c1ae-98ef-4493-ae88-fc61053dde55 of volume c05e443d-3d50-419b-b881-e397259b13ba {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:21:38 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[275a40d7-6764-4f79-bb57-1982149483b3]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:21:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4f92b722-7dac-4f9f-9b26-eaa32b9ff6ca tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.d8858c1d-ebf6-4731-a752-c5b33ea3e11d {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:38 devstack sudo[97845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.d8858c1d-ebf6-4731-a752-c5b33ea3e11d Sep 03 11:21:38 devstack sudo[97845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:39 devstack sudo[97845]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4f92b722-7dac-4f9f-9b26-eaa32b9ff6ca tempest-VolumesDeleteCascade-1068918560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.d8858c1d-ebf6-4731-a752-c5b33ea3e11d" returned: 0 in 0.924s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-4f92b722-7dac-4f9f-9b26-eaa32b9ff6ca tempest-VolumesDeleteCascade-1068918560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c05e443d-3d50-419b-b881-e397259b13ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:21:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4f92b722-7dac-4f9f-9b26-eaa32b9ff6ca tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.d8858c1d-ebf6-4731-a752-c5b33ea3e11d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.6551c1ae-98ef-4493-ae88-fc61053dde55 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:39 devstack sudo[97866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.d8858c1d-ebf6-4731-a752-c5b33ea3e11d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.6551c1ae-98ef-4493-ae88-fc61053dde55 1G Sep 03 11:21:39 devstack sudo[97866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:39 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-d15bcb64-2bb3-4b39-89f2-2d27624b5cbb req-896792fb-1fa8-405c-97ac-6f5e1234ae90 tempest-TestInstancesWithCinderVolumes-2123003308 None] Terminate volume connection completed successfully. Sep 03 11:21:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-d15bcb64-2bb3-4b39-89f2-2d27624b5cbb req-896792fb-1fa8-405c-97ac-6f5e1234ae90 tempest-TestInstancesWithCinderVolumes-2123003308 None] Deleting attachment bf69d668-ad37-4660-8bbf-036045dee68f. {{(pid=87038) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:21:40 devstack sudo[97866]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4f92b722-7dac-4f9f-9b26-eaa32b9ff6ca tempest-VolumesDeleteCascade-1068918560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.d8858c1d-ebf6-4731-a752-c5b33ea3e11d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.6551c1ae-98ef-4493-ae88-fc61053dde55 1G" returned: 0 in 0.609s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4f92b722-7dac-4f9f-9b26-eaa32b9ff6ca tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c05e443d-3d50-419b-b881-e397259b13ba.d8858c1d-ebf6-4731-a752-c5b33ea3e11d -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.6551c1ae-98ef-4493-ae88-fc61053dde55 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:40 devstack sudo[97877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c05e443d-3d50-419b-b881-e397259b13ba.d8858c1d-ebf6-4731-a752-c5b33ea3e11d -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.6551c1ae-98ef-4493-ae88-fc61053dde55 Sep 03 11:21:40 devstack sudo[97877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:40 devstack sudo[97877]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4f92b722-7dac-4f9f-9b26-eaa32b9ff6ca tempest-VolumesDeleteCascade-1068918560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c05e443d-3d50-419b-b881-e397259b13ba.d8858c1d-ebf6-4731-a752-c5b33ea3e11d -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.6551c1ae-98ef-4493-ae88-fc61053dde55" returned: 0 in 0.670s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:40 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-4f92b722-7dac-4f9f-9b26-eaa32b9ff6ca tempest-VolumesDeleteCascade-1068918560 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.6551c1ae-98ef-4493-ae88-fc61053dde55 is being set with open permissions: ugo+rw Sep 03 11:21:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4f92b722-7dac-4f9f-9b26-eaa32b9ff6ca tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.6551c1ae-98ef-4493-ae88-fc61053dde55 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:40 devstack sudo[97884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.6551c1ae-98ef-4493-ae88-fc61053dde55 Sep 03 11:21:40 devstack sudo[97884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:41 devstack sudo[97884]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4f92b722-7dac-4f9f-9b26-eaa32b9ff6ca tempest-VolumesDeleteCascade-1068918560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.6551c1ae-98ef-4493-ae88-fc61053dde55" returned: 0 in 0.280s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4f92b722-7dac-4f9f-9b26-eaa32b9ff6ca tempest-VolumesDeleteCascade-1068918560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.678s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:21:41 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-4f92b722-7dac-4f9f-9b26-eaa32b9ff6ca tempest-VolumesDeleteCascade-1068918560 None] Create snapshot completed successfully Sep 03 11:21:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a15b24e7-35e4-4f3a-a86b-b750c61f5aac tempest-TestInstancesWithCinderVolumes-2123003308 None] Acquiring lock "cinder-2d311a2f-d0a7-4f76-b40e-a9ccc15790d0-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:21:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a15b24e7-35e4-4f3a-a86b-b750c61f5aac tempest-TestInstancesWithCinderVolumes-2123003308 None] Lock "cinder-2d311a2f-d0a7-4f76-b40e-a9ccc15790d0-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:21:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Acquiring lock "cinder-c05e443d-3d50-419b-b881-e397259b13ba-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:21:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a15b24e7-35e4-4f3a-a86b-b750c61f5aac tempest-TestInstancesWithCinderVolumes-2123003308 None] Acquiring lock "cinder-quobyte-2d311a2f-d0a7-4f76-b40e-a9ccc15790d0" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:21:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Lock "cinder-c05e443d-3d50-419b-b881-e397259b13ba-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:21:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a15b24e7-35e4-4f3a-a86b-b750c61f5aac tempest-TestInstancesWithCinderVolumes-2123003308 None] Lock "cinder-quobyte-2d311a2f-d0a7-4f76-b40e-a9ccc15790d0" acquired by "delete_volume" :: waited 0.034s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:21:41 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[4696487a-5743-4555-9e3a-38cd793f7e60]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:21:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a15b24e7-35e4-4f3a-a86b-b750c61f5aac tempest-TestInstancesWithCinderVolumes-2123003308 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2d311a2f-d0a7-4f76-b40e-a9ccc15790d0 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Performing cascade delete. {{(pid=87038) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 03 11:21:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Acquiring lock "cinder-6551c1ae-98ef-4493-ae88-fc61053dde55-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:21:42 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Lock "cinder-6551c1ae-98ef-4493-ae88-fc61053dde55-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:21:42 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Acquiring lock "cinder-quobyte-c05e443d-3d50-419b-b881-e397259b13ba" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:21:42 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Lock "cinder-quobyte-c05e443d-3d50-419b-b881-e397259b13ba" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:21:42 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Acquiring lock "cinder-quobyte-6551c1ae-98ef-4493-ae88-fc61053dde55" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:21:42 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Lock "cinder-quobyte-6551c1ae-98ef-4493-ae88-fc61053dde55" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:21:42 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Deleting offline snapshot 6551c1ae-98ef-4493-ae88-fc61053dde55 of volume c05e443d-3d50-419b-b881-e397259b13ba {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:21:42 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] snapshot_file for this snap is: volume-c05e443d-3d50-419b-b881-e397259b13ba.6551c1ae-98ef-4493-ae88-fc61053dde55 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:21:42 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2d311a2f-d0a7-4f76-b40e-a9ccc15790d0 Sep 03 11:21:42 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:42 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16ab6bf-3fe6-47d1-b5f3-0b2173123071]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:21:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.6551c1ae-98ef-4493-ae88-fc61053dde55 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:42 devstack sudo[97889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.6551c1ae-98ef-4493-ae88-fc61053dde55 Sep 03 11:21:42 devstack sudo[97889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:42 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a15b24e7-35e4-4f3a-a86b-b750c61f5aac tempest-TestInstancesWithCinderVolumes-2123003308 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2d311a2f-d0a7-4f76-b40e-a9ccc15790d0" returned: 0 in 0.512s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a15b24e7-35e4-4f3a-a86b-b750c61f5aac tempest-TestInstancesWithCinderVolumes-2123003308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2d311a2f-d0a7-4f76-b40e-a9ccc15790d0 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:42 devstack sudo[97894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2d311a2f-d0a7-4f76-b40e-a9ccc15790d0 Sep 03 11:21:42 devstack sudo[97894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:42 devstack sudo[97889]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.6551c1ae-98ef-4493-ae88-fc61053dde55" returned: 0 in 0.511s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:42 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c05e443d-3d50-419b-b881-e397259b13ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:21:42 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[af8f7a59-bad4-4508-93a7-0590ff7e7a9d]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:21:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.d8858c1d-ebf6-4731-a752-c5b33ea3e11d {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:42 devstack sudo[97894]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a15b24e7-35e4-4f3a-a86b-b750c61f5aac tempest-TestInstancesWithCinderVolumes-2123003308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2d311a2f-d0a7-4f76-b40e-a9ccc15790d0" returned: 0 in 0.360s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:42 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.d8858c1d-ebf6-4731-a752-c5b33ea3e11d Sep 03 11:21:42 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:42 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a15b24e7-35e4-4f3a-a86b-b750c61f5aac tempest-TestInstancesWithCinderVolumes-2123003308 None] Lock "cinder-quobyte-2d311a2f-d0a7-4f76-b40e-a9ccc15790d0" released by "delete_volume" :: held 0.962s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:21:42 devstack cinder-volume[87038]: WARNING cinder.quota [None req-a15b24e7-35e4-4f3a-a86b-b750c61f5aac tempest-TestInstancesWithCinderVolumes-2123003308 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-556198211-1858442982 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-556198211-1858442982, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:21:42 devstack cinder-volume[87038]: WARNING cinder.quota [None req-a15b24e7-35e4-4f3a-a86b-b750c61f5aac tempest-TestInstancesWithCinderVolumes-2123003308 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-556198211-1858442982 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-556198211-1858442982, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:21:42 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-a15b24e7-35e4-4f3a-a86b-b750c61f5aac tempest-TestInstancesWithCinderVolumes-2123003308 None] Created reservations ['2a8c4a01-03b1-4caa-87ac-58a84e3a73e9', '6da48702-c67b-4fdf-87ab-f491ead5eec7', '903998d9-25f0-4708-bee7-f10cbbd95926', 'e196ceeb-f66d-42f2-a5c1-b5b60fc50f23'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:21:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a15b24e7-35e4-4f3a-a86b-b750c61f5aac tempest-TestInstancesWithCinderVolumes-2123003308 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:21:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a15b24e7-35e4-4f3a-a86b-b750c61f5aac tempest-TestInstancesWithCinderVolumes-2123003308 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:21:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a15b24e7-35e4-4f3a-a86b-b750c61f5aac tempest-TestInstancesWithCinderVolumes-2123003308 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:21:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a15b24e7-35e4-4f3a-a86b-b750c61f5aac tempest-TestInstancesWithCinderVolumes-2123003308 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:21:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a15b24e7-35e4-4f3a-a86b-b750c61f5aac tempest-TestInstancesWithCinderVolumes-2123003308 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:21:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a15b24e7-35e4-4f3a-a86b-b750c61f5aac tempest-TestInstancesWithCinderVolumes-2123003308 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:43 devstack sudo[97902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:21:43 devstack sudo[97902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:43 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.d8858c1d-ebf6-4731-a752-c5b33ea3e11d" returned: 0 in 0.531s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c05e443d-3d50-419b-b881-e397259b13ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:21:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.6551c1ae-98ef-4493-ae88-fc61053dde55 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:43 devstack sudo[97907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.6551c1ae-98ef-4493-ae88-fc61053dde55 Sep 03 11:21:43 devstack sudo[97907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:43 devstack sudo[97902]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a15b24e7-35e4-4f3a-a86b-b750c61f5aac tempest-TestInstancesWithCinderVolumes-2123003308 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.346s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:43 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-a15b24e7-35e4-4f3a-a86b-b750c61f5aac tempest-TestInstancesWithCinderVolumes-2123003308 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:21:43 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-a15b24e7-35e4-4f3a-a86b-b750c61f5aac tempest-TestInstancesWithCinderVolumes-2123003308 None] Deleted volume successfully. Sep 03 11:21:43 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a15b24e7-35e4-4f3a-a86b-b750c61f5aac tempest-TestInstancesWithCinderVolumes-2123003308 None] Lock "cinder-2d311a2f-d0a7-4f76-b40e-a9ccc15790d0-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:21:43 devstack sudo[97907]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.6551c1ae-98ef-4493-ae88-fc61053dde55" returned: 0 in 0.547s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.6551c1ae-98ef-4493-ae88-fc61053dde55 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:43 devstack sudo[97913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.6551c1ae-98ef-4493-ae88-fc61053dde55 Sep 03 11:21:43 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:44 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.6551c1ae-98ef-4493-ae88-fc61053dde55" returned: 0 in 0.297s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:44 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Lock "cinder-quobyte-6551c1ae-98ef-4493-ae88-fc61053dde55" released by "_delete_snapshot" :: held 2.055s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:21:44 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Lock "cinder-quobyte-c05e443d-3d50-419b-b881-e397259b13ba" released by "delete_snapshot" :: held 2.088s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:21:44 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Created reservations ['042a5fe2-fdb2-4582-959f-d76b7f46cb6a', '82f60f24-ad39-4edb-8b74-5047ce2a90b4', '6803b8cc-1774-4bda-8033-f35fb2ccc1e4', 'faf98b35-41a8-4387-bdad-afb40484567b'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:21:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d0d64ac8-0a91-4b0b-9ae6-0cd08d21328b tempest-VolumesActionsTest-1587758661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:21:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d0d64ac8-0a91-4b0b-9ae6-0cd08d21328b tempest-VolumesActionsTest-1587758661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:21:44 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Delete snapshot completed successfully. Sep 03 11:21:44 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Lock "cinder-6551c1ae-98ef-4493-ae88-fc61053dde55-delete_snapshot" released by "delete_snapshot" :: held 2.358s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:21:44 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Acquiring lock "cinder-d8858c1d-ebf6-4731-a752-c5b33ea3e11d-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:21:44 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c327e0f-34a2-48e9-9dcc-745f766cd898]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:21:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d0d64ac8-0a91-4b0b-9ae6-0cd08d21328b tempest-VolumesActionsTest-1587758661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:44 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Lock "cinder-d8858c1d-ebf6-4731-a752-c5b33ea3e11d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:21:44 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Acquiring lock "cinder-quobyte-c05e443d-3d50-419b-b881-e397259b13ba" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:21:44 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Lock "cinder-quobyte-c05e443d-3d50-419b-b881-e397259b13ba" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:21:44 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Acquiring lock "cinder-quobyte-d8858c1d-ebf6-4731-a752-c5b33ea3e11d" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:21:44 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Lock "cinder-quobyte-d8858c1d-ebf6-4731-a752-c5b33ea3e11d" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:21:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Deleting offline snapshot d8858c1d-ebf6-4731-a752-c5b33ea3e11d of volume c05e443d-3d50-419b-b881-e397259b13ba {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:21:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] snapshot_file for this snap is: volume-c05e443d-3d50-419b-b881-e397259b13ba.d8858c1d-ebf6-4731-a752-c5b33ea3e11d {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:21:44 devstack sudo[97916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a Sep 03 11:21:44 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:44 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[0340e84b-2261-44cb-84f9-700a18ea6b02]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:21:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.d8858c1d-ebf6-4731-a752-c5b33ea3e11d {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:44 devstack sudo[97918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.d8858c1d-ebf6-4731-a752-c5b33ea3e11d Sep 03 11:21:44 devstack sudo[97918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:44 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d0d64ac8-0a91-4b0b-9ae6-0cd08d21328b tempest-VolumesActionsTest-1587758661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a" returned: 0 in 0.458s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:44 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[dccfe806-9be0-445f-ac2e-c58c769b8dd2]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:21:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d0d64ac8-0a91-4b0b-9ae6-0cd08d21328b tempest-VolumesActionsTest-1587758661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:44 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a Sep 03 11:21:44 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:45 devstack sudo[97918]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.d8858c1d-ebf6-4731-a752-c5b33ea3e11d" returned: 0 in 0.491s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:45 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c05e443d-3d50-419b-b881-e397259b13ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:21:45 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dafced5-7b86-4ef7-b8ae-edf472d7c418]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:21:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:45 devstack sudo[97930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba Sep 03 11:21:45 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:45 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d0d64ac8-0a91-4b0b-9ae6-0cd08d21328b tempest-VolumesActionsTest-1587758661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a" returned: 0 in 0.513s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d0d64ac8-0a91-4b0b-9ae6-0cd08d21328b tempest-VolumesActionsTest-1587758661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a /opt/stack/data/cinder/conversion/6d5417d8-48f2-4ac8-8a41-517f3bf6430a.temp_image.6296bf14-d5cb-4656-a7fa-44bba2b0130531wnf68k.img {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:45 devstack sudo[97935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a /opt/stack/data/cinder/conversion/6d5417d8-48f2-4ac8-8a41-517f3bf6430a.temp_image.6296bf14-d5cb-4656-a7fa-44bba2b0130531wnf68k.img Sep 03 11:21:45 devstack sudo[97935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:45 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba" returned: 0 in 0.446s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.d8858c1d-ebf6-4731-a752-c5b33ea3e11d {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:45 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.d8858c1d-ebf6-4731-a752-c5b33ea3e11d Sep 03 11:21:45 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:45 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-7f4c6f21-ddf4-4cad-9e5f-cc6a06f54441 tempest-GroupSnapshotsTest-1799889754 None] Group tempest-GroupSnapshotsTest-Group-1320759068: creating Sep 03 11:21:45 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-7f4c6f21-ddf4-4cad-9e5f-cc6a06f54441 tempest-GroupSnapshotsTest-1799889754 None] Group tempest-GroupSnapshotsTest-Group-1320759068: created successfully Sep 03 11:21:45 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-7f4c6f21-ddf4-4cad-9e5f-cc6a06f54441 tempest-GroupSnapshotsTest-1799889754 None] Create group completed successfully. Sep 03 11:21:46 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.d8858c1d-ebf6-4731-a752-c5b33ea3e11d" returned: 0 in 0.726s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.d8858c1d-ebf6-4731-a752-c5b33ea3e11d {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:46 devstack sudo[97955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.d8858c1d-ebf6-4731-a752-c5b33ea3e11d Sep 03 11:21:46 devstack sudo[97955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:46 devstack sudo[97955]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba.d8858c1d-ebf6-4731-a752-c5b33ea3e11d" returned: 0 in 0.485s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:46 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Lock "cinder-quobyte-d8858c1d-ebf6-4731-a752-c5b33ea3e11d" released by "_delete_snapshot" :: held 2.375s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:21:46 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Lock "cinder-quobyte-c05e443d-3d50-419b-b881-e397259b13ba" released by "delete_snapshot" :: held 2.427s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:21:47 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Created reservations ['e2863ced-1f5c-4ad1-a05a-a77ca77b23a3', '2f6b02ea-6f24-4e3e-a309-f3aaf1c0821a', 'c5496e85-48ed-499f-9238-21975c0c4073', '0cdd04ba-bae0-4ca5-a08f-f89034bf75af'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:21:47 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Delete snapshot completed successfully. Sep 03 11:21:47 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Lock "cinder-d8858c1d-ebf6-4731-a752-c5b33ea3e11d-delete_snapshot" released by "delete_snapshot" :: held 3.003s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:21:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Snapshots deleted, issuing volume delete {{(pid=87038) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 03 11:21:47 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Acquiring lock "cinder-quobyte-c05e443d-3d50-419b-b881-e397259b13ba" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:21:47 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Lock "cinder-quobyte-c05e443d-3d50-419b-b881-e397259b13ba" acquired by "delete_volume" :: waited 0.036s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:21:47 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[eccc04fb-c921-4dff-81e7-2036a6862482]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:21:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:47 devstack sudo[97960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba Sep 03 11:21:47 devstack sudo[97960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:48 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-12ac6873-cbbe-4298-aa4d-48fd33a5d604 tempest-GroupSnapshotsTest-1799889754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:21:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12ac6873-cbbe-4298-aa4d-48fd33a5d604 tempest-GroupSnapshotsTest-1799889754 None] Flow 'volume_create_manager' (dd919519-39c0-4ee6-84c2-c67c28fddfa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:21:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12ac6873-cbbe-4298-aa4d-48fd33a5d604 tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ffac4e-dbe9-4d2a-8e72-22704ff64448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:21:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12ac6873-cbbe-4298-aa4d-48fd33a5d604 tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0ffac4e-dbe9-4d2a-8e72-22704ff64448) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-974094288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5c1a65ce-103d-459b-84c6-0f78c7382511,host='devstack@QuobyteHD#QuobyteHD',id=8750a676-aa9f-4b32-a7cc-593c35b52edf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8caa1cbb957e461cbedbeeb17177dcd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:21:48Z,use_quota=True,user_id='34720c2ae5d34ba49f535dcddb1aa2f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02f91922-43ac-46e9-9b0f-9c0302e3eabd),volume_type_id=02f91922-43ac-46e9-9b0f-9c0302e3eabd)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:21:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12ac6873-cbbe-4298-aa4d-48fd33a5d604 tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbd019da-7bb8-4c95-a620-43fc595a5564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:21:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12ac6873-cbbe-4298-aa4d-48fd33a5d604 tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbd019da-7bb8-4c95-a620-43fc595a5564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:21:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12ac6873-cbbe-4298-aa4d-48fd33a5d604 tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1ee67de-2744-4dff-96b3-1acb10716061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:21:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12ac6873-cbbe-4298-aa4d-48fd33a5d604 tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1ee67de-2744-4dff-96b3-1acb10716061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8750a676-aa9f-4b32-a7cc-593c35b52edf', 'volume_name': 'volume-8750a676-aa9f-4b32-a7cc-593c35b52edf', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:21:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12ac6873-cbbe-4298-aa4d-48fd33a5d604 tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d05e826-aba8-43a6-8eec-9e1c5b0b711b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:21:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12ac6873-cbbe-4298-aa4d-48fd33a5d604 tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d05e826-aba8-43a6-8eec-9e1c5b0b711b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:21:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12ac6873-cbbe-4298-aa4d-48fd33a5d604 tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abfa559f-4dc1-4882-8573-5e25465a792e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:21:48 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-12ac6873-cbbe-4298-aa4d-48fd33a5d604 tempest-GroupSnapshotsTest-1799889754 None] Volume 8750a676-aa9f-4b32-a7cc-593c35b52edf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8750a676-aa9f-4b32-a7cc-593c35b52edf', 'volume_size': 1} Sep 03 11:21:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-12ac6873-cbbe-4298-aa4d-48fd33a5d604 tempest-GroupSnapshotsTest-1799889754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:21:48 devstack sudo[97960]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba" returned: 0 in 1.200s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:48 devstack sudo[97967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba Sep 03 11:21:48 devstack sudo[97967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:49 devstack sudo[97967]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c05e443d-3d50-419b-b881-e397259b13ba" returned: 0 in 0.598s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:49 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Lock "cinder-quobyte-c05e443d-3d50-419b-b881-e397259b13ba" released by "delete_volume" :: held 2.032s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:21:49 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Created reservations ['dc8d806f-8e47-482b-b911-85e3dc3af504', 'd7102cce-2690-404a-91ea-d1d611a33205', 'dc30eb7e-05b9-4f42-9b74-3235400880d8', '23af3f89-144b-4712-9832-10b8c79fa4fd'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:21:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:21:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:21:49 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:21:49 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:21:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:21:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:49 devstack sudo[97971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:21:49 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:50 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.809s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:50 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:21:50 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Deleted volume successfully. Sep 03 11:21:50 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-bf43cafa-a80b-4e95-8d22-983284b10d33 tempest-VolumesDeleteCascade-1068918560 None] Lock "cinder-c05e443d-3d50-419b-b881-e397259b13ba-delete_volume" released by "delete_volume" :: held 8.883s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:21:51 devstack sudo[97935]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d0d64ac8-0a91-4b0b-9ae6-0cd08d21328b tempest-VolumesActionsTest-1587758661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a /opt/stack/data/cinder/conversion/6d5417d8-48f2-4ac8-8a41-517f3bf6430a.temp_image.6296bf14-d5cb-4656-a7fa-44bba2b0130531wnf68k.img" returned: 0 in 5.943s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:51 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[0527d350-132b-475a-a3e5-e80e2babd532]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:21:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d0d64ac8-0a91-4b0b-9ae6-0cd08d21328b tempest-VolumesActionsTest-1587758661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:21:51 devstack sudo[97974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a Sep 03 11:21:51 devstack sudo[97974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:21:51 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-caaa5088-9f20-4e4c-ae3d-609968c549a5 tempest-VolumesDeleteCascade-1068918560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:21:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-caaa5088-9f20-4e4c-ae3d-609968c549a5 tempest-VolumesDeleteCascade-1068918560 None] Flow 'volume_create_manager' (ae1147a9-f5b5-487d-9583-2e2603545d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:21:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-caaa5088-9f20-4e4c-ae3d-609968c549a5 tempest-VolumesDeleteCascade-1068918560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85899443-9669-4e4c-b196-d647c761388e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:21:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-caaa5088-9f20-4e4c-ae3d-609968c549a5 tempest-VolumesDeleteCascade-1068918560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85899443-9669-4e4c-b196-d647c761388e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-756310526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99fa59e2-93b3-4e6d-98e9-5ab4acd43c57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc7ebe2c0ae8454a84774166c65e32ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:21:51Z,use_quota=True,user_id='60f8e7604e244d23a6a36e22d9a9ff23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:21:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-caaa5088-9f20-4e4c-ae3d-609968c549a5 tempest-VolumesDeleteCascade-1068918560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb2fd76-524f-4588-b842-ecdea6ca3b50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:21:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-caaa5088-9f20-4e4c-ae3d-609968c549a5 tempest-VolumesDeleteCascade-1068918560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eb2fd76-524f-4588-b842-ecdea6ca3b50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:21:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-caaa5088-9f20-4e4c-ae3d-609968c549a5 tempest-VolumesDeleteCascade-1068918560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce569043-3d07-4b09-8be7-4d96f7a56d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:21:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-caaa5088-9f20-4e4c-ae3d-609968c549a5 tempest-VolumesDeleteCascade-1068918560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce569043-3d07-4b09-8be7-4d96f7a56d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99fa59e2-93b3-4e6d-98e9-5ab4acd43c57', 'volume_name': 'volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:21:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-caaa5088-9f20-4e4c-ae3d-609968c549a5 tempest-VolumesDeleteCascade-1068918560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (629f76b5-ff49-46c1-92d1-ee6d255ba275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:21:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-caaa5088-9f20-4e4c-ae3d-609968c549a5 tempest-VolumesDeleteCascade-1068918560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (629f76b5-ff49-46c1-92d1-ee6d255ba275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:21:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-caaa5088-9f20-4e4c-ae3d-609968c549a5 tempest-VolumesDeleteCascade-1068918560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12429ad6-b986-4324-82f5-3a7100f720fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:21:51 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-caaa5088-9f20-4e4c-ae3d-609968c549a5 tempest-VolumesDeleteCascade-1068918560 None] Volume 99fa59e2-93b3-4e6d-98e9-5ab4acd43c57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57', 'volume_size': 1} Sep 03 11:21:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-caaa5088-9f20-4e4c-ae3d-609968c549a5 tempest-VolumesDeleteCascade-1068918560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:21:51 devstack sudo[97974]: pam_unix(sudo:session): session closed for user root Sep 03 11:21:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d0d64ac8-0a91-4b0b-9ae6-0cd08d21328b tempest-VolumesActionsTest-1587758661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a" returned: 0 in 0.554s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:21:51 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-d0d64ac8-0a91-4b0b-9ae6-0cd08d21328b tempest-VolumesActionsTest-1587758661 None] Image conversion details: src /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a, size 1024.00 MB, duration 5.94 sec, destination /opt/stack/data/cinder/conversion/6d5417d8-48f2-4ac8-8a41-517f3bf6430a.temp_image.6296bf14-d5cb-4656-a7fa-44bba2b0130531wnf68k.img {{(pid=87038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:21:51 devstack cinder-volume[87038]: INFO cinder.image.image_utils [None req-d0d64ac8-0a91-4b0b-9ae6-0cd08d21328b tempest-VolumesActionsTest-1587758661 None] Converted 1024.00 MB image at 172.25 MB/s Sep 03 11:21:51 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-d0d64ac8-0a91-4b0b-9ae6-0cd08d21328b tempest-VolumesActionsTest-1587758661 None] 6296bf14-d5cb-4656-a7fa-44bba2b01305 was raw, no need to convert to raw {{(pid=87038) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 03 11:22:01 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=82,cinder:UPDATE=70,cinder:INSERT=16,cinder:DELETE=5 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:22:01 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=76,cinder:UPDATE=72,cinder:INSERT=19,cinder:DELETE=4 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:22:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d0d64ac8-0a91-4b0b-9ae6-0cd08d21328b tempest-VolumesActionsTest-1587758661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.378s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:22:13 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d0d64ac8-0a91-4b0b-9ae6-0cd08d21328b tempest-VolumesActionsTest-1587758661 None] Uploaded volume to glance image-id: 6296bf14-d5cb-4656-a7fa-44bba2b01305. {{(pid=87038) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 03 11:22:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-12ac6873-cbbe-4298-aa4d-48fd33a5d604 tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.883s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:22:13 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-12ac6873-cbbe-4298-aa4d-48fd33a5d604 tempest-GroupSnapshotsTest-1799889754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5c1a65ce-103d-459b-84c6-0f78c7382511,created_at=2026-09-03T09:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-974094288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5c1a65ce-103d-459b-84c6-0f78c7382511,host='devstack@QuobyteHD#QuobyteHD',id=8750a676-aa9f-4b32-a7cc-593c35b52edf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8caa1cbb957e461cbedbeeb17177dcd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:21:48Z,use_quota=True,user_id='34720c2ae5d34ba49f535dcddb1aa2f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(02f91922-43ac-46e9-9b0f-9c0302e3eabd),volume_type_id=02f91922-43ac-46e9-9b0f-9c0302e3eabd)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:22:13 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-12ac6873-cbbe-4298-aa4d-48fd33a5d604 tempest-GroupSnapshotsTest-1799889754 None] Creating volume 8750a676-aa9f-4b32-a7cc-593c35b52edf {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:22:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-12ac6873-cbbe-4298-aa4d-48fd33a5d604 tempest-GroupSnapshotsTest-1799889754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:22:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-12ac6873-cbbe-4298-aa4d-48fd33a5d604 tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:22:13 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-12ac6873-cbbe-4298-aa4d-48fd33a5d604 tempest-GroupSnapshotsTest-1799889754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:22:13 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-12ac6873-cbbe-4298-aa4d-48fd33a5d604 tempest-GroupSnapshotsTest-1799889754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:22:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-12ac6873-cbbe-4298-aa4d-48fd33a5d604 tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:22:13 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-12ac6873-cbbe-4298-aa4d-48fd33a5d604 tempest-GroupSnapshotsTest-1799889754 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:22:13 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-12ac6873-cbbe-4298-aa4d-48fd33a5d604 tempest-GroupSnapshotsTest-1799889754 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:22:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-12ac6873-cbbe-4298-aa4d-48fd33a5d604 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:13 devstack sudo[97986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf 1073741824 Sep 03 11:22:13 devstack sudo[97986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:13 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-d0d64ac8-0a91-4b0b-9ae6-0cd08d21328b tempest-VolumesActionsTest-1587758661 None] Copy volume to image completed successfully. Sep 03 11:22:14 devstack sudo[97986]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-12ac6873-cbbe-4298-aa4d-48fd33a5d604 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf 1073741824" returned: 0 in 0.524s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-12ac6873-cbbe-4298-aa4d-48fd33a5d604 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:14 devstack sudo[97992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf Sep 03 11:22:14 devstack sudo[97992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:14 devstack sudo[97992]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-12ac6873-cbbe-4298-aa4d-48fd33a5d604 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf" returned: 0 in 0.239s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:14 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-12ac6873-cbbe-4298-aa4d-48fd33a5d604 tempest-GroupSnapshotsTest-1799889754 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:22:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-12ac6873-cbbe-4298-aa4d-48fd33a5d604 tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:22:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-caaa5088-9f20-4e4c-ae3d-609968c549a5 tempest-VolumesDeleteCascade-1068918560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 22.964s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:22:14 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-caaa5088-9f20-4e4c-ae3d-609968c549a5 tempest-VolumesDeleteCascade-1068918560 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-756310526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99fa59e2-93b3-4e6d-98e9-5ab4acd43c57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc7ebe2c0ae8454a84774166c65e32ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:21:51Z,use_quota=True,user_id='60f8e7604e244d23a6a36e22d9a9ff23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:22:14 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-caaa5088-9f20-4e4c-ae3d-609968c549a5 tempest-VolumesDeleteCascade-1068918560 None] Creating volume 99fa59e2-93b3-4e6d-98e9-5ab4acd43c57 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:22:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-caaa5088-9f20-4e4c-ae3d-609968c549a5 tempest-VolumesDeleteCascade-1068918560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:22:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-caaa5088-9f20-4e4c-ae3d-609968c549a5 tempest-VolumesDeleteCascade-1068918560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:22:14 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-caaa5088-9f20-4e4c-ae3d-609968c549a5 tempest-VolumesDeleteCascade-1068918560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:22:14 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-caaa5088-9f20-4e4c-ae3d-609968c549a5 tempest-VolumesDeleteCascade-1068918560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:22:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-caaa5088-9f20-4e4c-ae3d-609968c549a5 tempest-VolumesDeleteCascade-1068918560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:22:14 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-caaa5088-9f20-4e4c-ae3d-609968c549a5 tempest-VolumesDeleteCascade-1068918560 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:22:14 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-caaa5088-9f20-4e4c-ae3d-609968c549a5 tempest-VolumesDeleteCascade-1068918560 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:22:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-caaa5088-9f20-4e4c-ae3d-609968c549a5 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:14 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57 1073741824 Sep 03 11:22:14 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:14 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12ac6873-cbbe-4298-aa4d-48fd33a5d604 tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abfa559f-4dc1-4882-8573-5e25465a792e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8750a676-aa9f-4b32-a7cc-593c35b52edf', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:22:14 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12ac6873-cbbe-4298-aa4d-48fd33a5d604 tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (015a3d8b-97a8-4858-8872-424efa613e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:22:14 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-12ac6873-cbbe-4298-aa4d-48fd33a5d604 tempest-GroupSnapshotsTest-1799889754 None] Volume volume-8750a676-aa9f-4b32-a7cc-593c35b52edf (8750a676-aa9f-4b32-a7cc-593c35b52edf): created successfully Sep 03 11:22:14 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12ac6873-cbbe-4298-aa4d-48fd33a5d604 tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (015a3d8b-97a8-4858-8872-424efa613e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:22:14 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12ac6873-cbbe-4298-aa4d-48fd33a5d604 tempest-GroupSnapshotsTest-1799889754 None] Flow 'volume_create_manager' (dd919519-39c0-4ee6-84c2-c67c28fddfa3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:22:14 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-12ac6873-cbbe-4298-aa4d-48fd33a5d604 tempest-GroupSnapshotsTest-1799889754 None] Created volume successfully. Sep 03 11:22:15 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-caaa5088-9f20-4e4c-ae3d-609968c549a5 tempest-VolumesDeleteCascade-1068918560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57 1073741824" returned: 0 in 0.551s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-caaa5088-9f20-4e4c-ae3d-609968c549a5 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:15 devstack sudo[98035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57 Sep 03 11:22:15 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:15 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-caaa5088-9f20-4e4c-ae3d-609968c549a5 tempest-VolumesDeleteCascade-1068918560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57" returned: 0 in 0.363s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:15 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-caaa5088-9f20-4e4c-ae3d-609968c549a5 tempest-VolumesDeleteCascade-1068918560 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:22:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-caaa5088-9f20-4e4c-ae3d-609968c549a5 tempest-VolumesDeleteCascade-1068918560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:22:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-caaa5088-9f20-4e4c-ae3d-609968c549a5 tempest-VolumesDeleteCascade-1068918560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12429ad6-b986-4324-82f5-3a7100f720fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:22:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-caaa5088-9f20-4e4c-ae3d-609968c549a5 tempest-VolumesDeleteCascade-1068918560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd9f7e9-4317-420f-9103-b6ef85747ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:22:15 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-caaa5088-9f20-4e4c-ae3d-609968c549a5 tempest-VolumesDeleteCascade-1068918560 None] Volume volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57 (99fa59e2-93b3-4e6d-98e9-5ab4acd43c57): created successfully Sep 03 11:22:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-caaa5088-9f20-4e4c-ae3d-609968c549a5 tempest-VolumesDeleteCascade-1068918560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bd9f7e9-4317-420f-9103-b6ef85747ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:22:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-caaa5088-9f20-4e4c-ae3d-609968c549a5 tempest-VolumesDeleteCascade-1068918560 None] Flow 'volume_create_manager' (ae1147a9-f5b5-487d-9583-2e2603545d5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:22:15 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-caaa5088-9f20-4e4c-ae3d-609968c549a5 tempest-VolumesDeleteCascade-1068918560 None] Created volume successfully. Sep 03 11:22:15 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-4adb7af7-c92b-4129-bbe5-f52852aa4e08 tempest-GroupSnapshotsTest-1799889754 None] GroupSnapshot 846428b6-3f5a-4174-9279-74666c8b6052: creating. Sep 03 11:22:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4adb7af7-c92b-4129-bbe5-f52852aa4e08 tempest-GroupSnapshotsTest-1799889754 None] Group snapshot 846428b6-3f5a-4174-9279-74666c8b6052: creating. {{(pid=87038) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 03 11:22:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4adb7af7-c92b-4129-bbe5-f52852aa4e08 tempest-GroupSnapshotsTest-1799889754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:22:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4adb7af7-c92b-4129-bbe5-f52852aa4e08 tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:22:15 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-4adb7af7-c92b-4129-bbe5-f52852aa4e08 tempest-GroupSnapshotsTest-1799889754 None] Creating offline snapshot ca3b0e57-9cac-4293-8224-1b20d0cde9d9 of volume 8750a676-aa9f-4b32-a7cc-593c35b52edf {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:22:15 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[de867424-18ab-4b52-adbc-fb2d4e2ce72c]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:22:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4adb7af7-c92b-4129-bbe5-f52852aa4e08 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:15 devstack sudo[98040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf Sep 03 11:22:15 devstack sudo[98040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4bf87f70-59f7-4fbd-a91e-845500fd80ea tempest-VolumesActionsTest-1587758661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:22:16 devstack sudo[98040]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4adb7af7-c92b-4129-bbe5-f52852aa4e08 tempest-GroupSnapshotsTest-1799889754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf" returned: 0 in 0.396s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4adb7af7-c92b-4129-bbe5-f52852aa4e08 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf.ca3b0e57-9cac-4293-8224-1b20d0cde9d9 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:16 devstack sudo[98045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf.ca3b0e57-9cac-4293-8224-1b20d0cde9d9 1G Sep 03 11:22:16 devstack sudo[98045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:16 devstack sudo[98045]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4adb7af7-c92b-4129-bbe5-f52852aa4e08 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf.ca3b0e57-9cac-4293-8224-1b20d0cde9d9 1G" returned: 0 in 0.419s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4adb7af7-c92b-4129-bbe5-f52852aa4e08 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8750a676-aa9f-4b32-a7cc-593c35b52edf -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf.ca3b0e57-9cac-4293-8224-1b20d0cde9d9 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:16 devstack sudo[98051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8750a676-aa9f-4b32-a7cc-593c35b52edf -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf.ca3b0e57-9cac-4293-8224-1b20d0cde9d9 Sep 03 11:22:16 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f3527823-1664-4fe4-9a5c-ccc5715e8341 tempest-VolumesDeleteCascade-1068918560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:22:16 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4adb7af7-c92b-4129-bbe5-f52852aa4e08 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8750a676-aa9f-4b32-a7cc-593c35b52edf -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf.ca3b0e57-9cac-4293-8224-1b20d0cde9d9" returned: 0 in 0.413s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:16 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-4adb7af7-c92b-4129-bbe5-f52852aa4e08 tempest-GroupSnapshotsTest-1799889754 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf.ca3b0e57-9cac-4293-8224-1b20d0cde9d9 is being set with open permissions: ugo+rw: NotImplementedError Sep 03 11:22:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4adb7af7-c92b-4129-bbe5-f52852aa4e08 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf.ca3b0e57-9cac-4293-8224-1b20d0cde9d9 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:16 devstack sudo[98057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf.ca3b0e57-9cac-4293-8224-1b20d0cde9d9 Sep 03 11:22:16 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:17 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4adb7af7-c92b-4129-bbe5-f52852aa4e08 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf.ca3b0e57-9cac-4293-8224-1b20d0cde9d9" returned: 0 in 0.305s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4adb7af7-c92b-4129-bbe5-f52852aa4e08 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:17 devstack sudo[98060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf.info Sep 03 11:22:17 devstack sudo[98060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:17 devstack sudo[98060]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4adb7af7-c92b-4129-bbe5-f52852aa4e08 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf.info" returned: 0 in 0.244s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:17 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-4adb7af7-c92b-4129-bbe5-f52852aa4e08 tempest-GroupSnapshotsTest-1799889754 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf.info is being set with open permissions: ugo+rw: NotImplementedError Sep 03 11:22:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4adb7af7-c92b-4129-bbe5-f52852aa4e08 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:17 devstack sudo[98063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf.info Sep 03 11:22:17 devstack sudo[98063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:17 devstack sudo[98063]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4adb7af7-c92b-4129-bbe5-f52852aa4e08 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf.info" returned: 0 in 0.272s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4adb7af7-c92b-4129-bbe5-f52852aa4e08 tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.132s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:22:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4bf87f70-59f7-4fbd-a91e-845500fd80ea tempest-VolumesActionsTest-1587758661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.816s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:22:17 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[c28cef0a-94a6-4227-9c33-7bfd8b5cdb0d]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:22:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4bf87f70-59f7-4fbd-a91e-845500fd80ea tempest-VolumesActionsTest-1587758661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:17 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-4adb7af7-c92b-4129-bbe5-f52852aa4e08 tempest-GroupSnapshotsTest-1799889754 None] group_snapshot 846428b6-3f5a-4174-9279-74666c8b6052: created successfully Sep 03 11:22:17 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:22:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:22:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:22:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:22:17 devstack sudo[98066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a Sep 03 11:22:17 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:22:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:22:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:17 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:22:17 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:18 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4bf87f70-59f7-4fbd-a91e-845500fd80ea tempest-VolumesActionsTest-1587758661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a" returned: 0 in 0.385s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:18 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.281s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:18 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:22:18 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:22:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread count: 28 {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:22:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread info: [<_MainThread(MainThread, started 139554943000704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:22:18 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[9534a3e3-b93b-438c-98ad-b5c734e9257f]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:22:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4bf87f70-59f7-4fbd-a91e-845500fd80ea tempest-VolumesActionsTest-1587758661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:18 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a Sep 03 11:22:18 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:18 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4bf87f70-59f7-4fbd-a91e-845500fd80ea tempest-VolumesActionsTest-1587758661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a" returned: 0 in 0.369s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4bf87f70-59f7-4fbd-a91e-845500fd80ea tempest-VolumesActionsTest-1587758661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a /opt/stack/data/cinder/conversion/6d5417d8-48f2-4ac8-8a41-517f3bf6430a.temp_image.7a0b192d-1927-452b-b138-6751d1ce54c658d2u39r.img {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:18 devstack sudo[98080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a /opt/stack/data/cinder/conversion/6d5417d8-48f2-4ac8-8a41-517f3bf6430a.temp_image.7a0b192d-1927-452b-b138-6751d1ce54c658d2u39r.img Sep 03 11:22:18 devstack sudo[98080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:22:23 devstack sudo[98080]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4bf87f70-59f7-4fbd-a91e-845500fd80ea tempest-VolumesActionsTest-1587758661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a /opt/stack/data/cinder/conversion/6d5417d8-48f2-4ac8-8a41-517f3bf6430a.temp_image.7a0b192d-1927-452b-b138-6751d1ce54c658d2u39r.img" returned: 0 in 5.031s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:23 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ea36b3-b0b4-4d4b-a8cb-3fea454d9ea4]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:22:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4bf87f70-59f7-4fbd-a91e-845500fd80ea tempest-VolumesActionsTest-1587758661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:23 devstack sudo[98093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a Sep 03 11:22:23 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:24 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4bf87f70-59f7-4fbd-a91e-845500fd80ea tempest-VolumesActionsTest-1587758661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a" returned: 0 in 0.582s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:24 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-4bf87f70-59f7-4fbd-a91e-845500fd80ea tempest-VolumesActionsTest-1587758661 None] Image conversion details: src /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a, size 1024.00 MB, duration 5.03 sec, destination /opt/stack/data/cinder/conversion/6d5417d8-48f2-4ac8-8a41-517f3bf6430a.temp_image.7a0b192d-1927-452b-b138-6751d1ce54c658d2u39r.img {{(pid=87038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:22:24 devstack cinder-volume[87038]: INFO cinder.image.image_utils [None req-4bf87f70-59f7-4fbd-a91e-845500fd80ea tempest-VolumesActionsTest-1587758661 None] Converted 1024.00 MB image at 203.48 MB/s Sep 03 11:22:24 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-4bf87f70-59f7-4fbd-a91e-845500fd80ea tempest-VolumesActionsTest-1587758661 None] 7a0b192d-1927-452b-b138-6751d1ce54c6 was raw, converting to qcow2 {{(pid=87038) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 03 11:22:24 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff7e42a-36a7-4272-857d-525aec54d894]: (4, 'raw') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:22:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4bf87f70-59f7-4fbd-a91e-845500fd80ea tempest-VolumesActionsTest-1587758661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6d5417d8-48f2-4ac8-8a41-517f3bf6430a.temp_image.7a0b192d-1927-452b-b138-6751d1ce54c658d2u39r.img {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:24 devstack sudo[98098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6d5417d8-48f2-4ac8-8a41-517f3bf6430a.temp_image.7a0b192d-1927-452b-b138-6751d1ce54c658d2u39r.img Sep 03 11:22:24 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:24 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4bf87f70-59f7-4fbd-a91e-845500fd80ea tempest-VolumesActionsTest-1587758661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/6d5417d8-48f2-4ac8-8a41-517f3bf6430a.temp_image.7a0b192d-1927-452b-b138-6751d1ce54c658d2u39r.img" returned: 0 in 0.332s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4bf87f70-59f7-4fbd-a91e-845500fd80ea tempest-VolumesActionsTest-1587758661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6d5417d8-48f2-4ac8-8a41-517f3bf6430a.temp_image.7a0b192d-1927-452b-b138-6751d1ce54c658d2u39r.img {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:24 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6d5417d8-48f2-4ac8-8a41-517f3bf6430a.temp_image.7a0b192d-1927-452b-b138-6751d1ce54c658d2u39r.img Sep 03 11:22:24 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:24 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4bf87f70-59f7-4fbd-a91e-845500fd80ea tempest-VolumesActionsTest-1587758661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6d5417d8-48f2-4ac8-8a41-517f3bf6430a.temp_image.7a0b192d-1927-452b-b138-6751d1ce54c658d2u39r.img" returned: 1 in 0.337s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4bf87f70-59f7-4fbd-a91e-845500fd80ea tempest-VolumesActionsTest-1587758661 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/6d5417d8-48f2-4ac8-8a41-517f3bf6430a.temp_image.7a0b192d-1927-452b-b138-6751d1ce54c658d2u39r.img' failed. Not Retrying. {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:22:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4bf87f70-59f7-4fbd-a91e-845500fd80ea tempest-VolumesActionsTest-1587758661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6d5417d8-48f2-4ac8-8a41-517f3bf6430a.temp_image.7a0b192d-1927-452b-b138-6751d1ce54c658d2u39r.img /opt/stack/data/cinder/conversion/vol_upload_qrgzwbf8 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:24 devstack sudo[98107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6d5417d8-48f2-4ac8-8a41-517f3bf6430a.temp_image.7a0b192d-1927-452b-b138-6751d1ce54c658d2u39r.img /opt/stack/data/cinder/conversion/vol_upload_qrgzwbf8 Sep 03 11:22:24 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:25 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4bf87f70-59f7-4fbd-a91e-845500fd80ea tempest-VolumesActionsTest-1587758661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/6d5417d8-48f2-4ac8-8a41-517f3bf6430a.temp_image.7a0b192d-1927-452b-b138-6751d1ce54c658d2u39r.img /opt/stack/data/cinder/conversion/vol_upload_qrgzwbf8" returned: 0 in 0.256s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:25 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-4bf87f70-59f7-4fbd-a91e-845500fd80ea tempest-VolumesActionsTest-1587758661 None] Image conversion details: src /opt/stack/data/cinder/conversion/6d5417d8-48f2-4ac8-8a41-517f3bf6430a.temp_image.7a0b192d-1927-452b-b138-6751d1ce54c658d2u39r.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_qrgzwbf8 {{(pid=87038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:22:25 devstack cinder-volume[87038]: INFO cinder.image.image_utils [None req-4bf87f70-59f7-4fbd-a91e-845500fd80ea tempest-VolumesActionsTest-1587758661 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 03 11:22:25 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[03904b93-52cd-457c-874f-0611781cacea]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:22:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4bf87f70-59f7-4fbd-a91e-845500fd80ea tempest-VolumesActionsTest-1587758661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_qrgzwbf8 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:25 devstack sudo[98112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_qrgzwbf8 Sep 03 11:22:25 devstack sudo[98112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:25 devstack sudo[98112]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4bf87f70-59f7-4fbd-a91e-845500fd80ea tempest-VolumesActionsTest-1587758661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_qrgzwbf8" returned: 0 in 0.347s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:26 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f2ab7b5-9afb-4886-a5f0-203c3744c36d tempest-TestImageHashVerification-2081030438 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:22:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2f2ab7b5-9afb-4886-a5f0-203c3744c36d tempest-TestImageHashVerification-2081030438 None] Flow 'volume_create_manager' (18b1d8b4-9f19-4095-9e63-d090748c75b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:22:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2f2ab7b5-9afb-4886-a5f0-203c3744c36d tempest-TestImageHashVerification-2081030438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21ec2ade-dc2a-419f-a629-c143e0b1a456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:22:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2f2ab7b5-9afb-4886-a5f0-203c3744c36d tempest-TestImageHashVerification-2081030438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21ec2ade-dc2a-419f-a629-c143e0b1a456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-351364962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c0527e9-9b56-4836-8781-e077e5abb490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3bef4d954364e788c699f4f40febbc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:22:27Z,use_quota=True,user_id='b8dbd48965f44a7a9712cbb1e2a2d7f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:22:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2f2ab7b5-9afb-4886-a5f0-203c3744c36d tempest-TestImageHashVerification-2081030438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4370c00a-2d6a-44d9-8722-0bddc11c6377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:22:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2f2ab7b5-9afb-4886-a5f0-203c3744c36d tempest-TestImageHashVerification-2081030438 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4370c00a-2d6a-44d9-8722-0bddc11c6377) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:22:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2f2ab7b5-9afb-4886-a5f0-203c3744c36d tempest-TestImageHashVerification-2081030438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (574fd388-f600-466f-b346-b5a80b8b752d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:22:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2f2ab7b5-9afb-4886-a5f0-203c3744c36d tempest-TestImageHashVerification-2081030438 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (574fd388-f600-466f-b346-b5a80b8b752d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c0527e9-9b56-4836-8781-e077e5abb490', 'volume_name': 'volume-7c0527e9-9b56-4836-8781-e077e5abb490', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:22:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2f2ab7b5-9afb-4886-a5f0-203c3744c36d tempest-TestImageHashVerification-2081030438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27adea04-a72e-46fb-beb6-6d1c6c6fe0a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:22:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2f2ab7b5-9afb-4886-a5f0-203c3744c36d tempest-TestImageHashVerification-2081030438 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27adea04-a72e-46fb-beb6-6d1c6c6fe0a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:22:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2f2ab7b5-9afb-4886-a5f0-203c3744c36d tempest-TestImageHashVerification-2081030438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbfbe05c-5b2c-4452-9ab4-0b50fa958fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:22:26 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-2f2ab7b5-9afb-4886-a5f0-203c3744c36d tempest-TestImageHashVerification-2081030438 None] Volume 7c0527e9-9b56-4836-8781-e077e5abb490: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c0527e9-9b56-4836-8781-e077e5abb490', 'volume_size': 1} Sep 03 11:22:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2f2ab7b5-9afb-4886-a5f0-203c3744c36d tempest-TestImageHashVerification-2081030438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:22:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4bf87f70-59f7-4fbd-a91e-845500fd80ea tempest-VolumesActionsTest-1587758661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.526s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:22:27 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4bf87f70-59f7-4fbd-a91e-845500fd80ea tempest-VolumesActionsTest-1587758661 None] Uploaded volume to glance image-id: 7a0b192d-1927-452b-b138-6751d1ce54c6. {{(pid=87038) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 03 11:22:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f3527823-1664-4fe4-9a5c-ccc5715e8341 tempest-VolumesDeleteCascade-1068918560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.686s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:22:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-f3527823-1664-4fe4-9a5c-ccc5715e8341 tempest-VolumesDeleteCascade-1068918560 None] Creating offline snapshot d9ddebbc-494e-431b-8e62-c07783d2ef04 of volume 99fa59e2-93b3-4e6d-98e9-5ab4acd43c57 {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:22:27 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-4bf87f70-59f7-4fbd-a91e-845500fd80ea tempest-VolumesActionsTest-1587758661 None] Copy volume to image completed successfully. Sep 03 11:22:27 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b23dfb9-0350-4544-abc9-113212805eeb]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:22:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f3527823-1664-4fe4-9a5c-ccc5715e8341 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:27 devstack sudo[98117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57 Sep 03 11:22:27 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:27 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f3527823-1664-4fe4-9a5c-ccc5715e8341 tempest-VolumesDeleteCascade-1068918560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57" returned: 0 in 0.358s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f3527823-1664-4fe4-9a5c-ccc5715e8341 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57.d9ddebbc-494e-431b-8e62-c07783d2ef04 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:27 devstack sudo[98122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57.d9ddebbc-494e-431b-8e62-c07783d2ef04 1G Sep 03 11:22:27 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:28 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f3527823-1664-4fe4-9a5c-ccc5715e8341 tempest-VolumesDeleteCascade-1068918560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57.d9ddebbc-494e-431b-8e62-c07783d2ef04 1G" returned: 0 in 0.379s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f3527823-1664-4fe4-9a5c-ccc5715e8341 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57.d9ddebbc-494e-431b-8e62-c07783d2ef04 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:28 devstack sudo[98128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57.d9ddebbc-494e-431b-8e62-c07783d2ef04 Sep 03 11:22:28 devstack sudo[98128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:28 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fafec51e-fae9-4c76-9a12-f7d16930f41f tempest-VolumesActionsTest-1587758661 None] Acquiring lock "cinder-6d5417d8-48f2-4ac8-8a41-517f3bf6430a-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:22:28 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fafec51e-fae9-4c76-9a12-f7d16930f41f tempest-VolumesActionsTest-1587758661 None] Lock "cinder-6d5417d8-48f2-4ac8-8a41-517f3bf6430a-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:22:28 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fafec51e-fae9-4c76-9a12-f7d16930f41f tempest-VolumesActionsTest-1587758661 None] Acquiring lock "cinder-quobyte-6d5417d8-48f2-4ac8-8a41-517f3bf6430a" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:22:28 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fafec51e-fae9-4c76-9a12-f7d16930f41f tempest-VolumesActionsTest-1587758661 None] Lock "cinder-quobyte-6d5417d8-48f2-4ac8-8a41-517f3bf6430a" acquired by "delete_volume" :: waited 0.017s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:22:28 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aae9ba1-18f3-47b7-814f-7e83927a41a5]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:22:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fafec51e-fae9-4c76-9a12-f7d16930f41f tempest-VolumesActionsTest-1587758661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:28 devstack sudo[98128]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f3527823-1664-4fe4-9a5c-ccc5715e8341 tempest-VolumesDeleteCascade-1068918560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57.d9ddebbc-494e-431b-8e62-c07783d2ef04" returned: 0 in 0.353s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:28 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-f3527823-1664-4fe4-9a5c-ccc5715e8341 tempest-VolumesDeleteCascade-1068918560 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57.d9ddebbc-494e-431b-8e62-c07783d2ef04 is being set with open permissions: ugo+rw Sep 03 11:22:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f3527823-1664-4fe4-9a5c-ccc5715e8341 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57.d9ddebbc-494e-431b-8e62-c07783d2ef04 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:28 devstack sudo[98138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57.d9ddebbc-494e-431b-8e62-c07783d2ef04 Sep 03 11:22:28 devstack sudo[98138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:28 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a Sep 03 11:22:28 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:28 devstack sudo[98138]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f3527823-1664-4fe4-9a5c-ccc5715e8341 tempest-VolumesDeleteCascade-1068918560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57.d9ddebbc-494e-431b-8e62-c07783d2ef04" returned: 0 in 0.251s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f3527823-1664-4fe4-9a5c-ccc5715e8341 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:28 devstack sudo[98144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57.info Sep 03 11:22:28 devstack sudo[98144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:28 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fafec51e-fae9-4c76-9a12-f7d16930f41f tempest-VolumesActionsTest-1587758661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a" returned: 0 in 0.356s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fafec51e-fae9-4c76-9a12-f7d16930f41f tempest-VolumesActionsTest-1587758661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:28 devstack sudo[98147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a Sep 03 11:22:28 devstack sudo[98147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:29 devstack sudo[98144]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f3527823-1664-4fe4-9a5c-ccc5715e8341 tempest-VolumesDeleteCascade-1068918560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57.info" returned: 0 in 0.243s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:29 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-f3527823-1664-4fe4-9a5c-ccc5715e8341 tempest-VolumesDeleteCascade-1068918560 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57.info is being set with open permissions: ugo+rw Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f3527823-1664-4fe4-9a5c-ccc5715e8341 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:29 devstack sudo[98150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57.info Sep 03 11:22:29 devstack sudo[98150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:29 devstack sudo[98147]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fafec51e-fae9-4c76-9a12-f7d16930f41f tempest-VolumesActionsTest-1587758661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d5417d8-48f2-4ac8-8a41-517f3bf6430a" returned: 0 in 0.247s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fafec51e-fae9-4c76-9a12-f7d16930f41f tempest-VolumesActionsTest-1587758661 None] Lock "cinder-quobyte-6d5417d8-48f2-4ac8-8a41-517f3bf6430a" released by "delete_volume" :: held 0.639s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-fafec51e-fae9-4c76-9a12-f7d16930f41f tempest-VolumesActionsTest-1587758661 None] Created reservations ['0bfa9a6b-d4a5-41cc-8b57-bc292820cb86', 'c5638399-a5e3-4c51-8915-f418a04311dc', 'dfd344be-58aa-4407-803e-8888f3b0f5a5', '2431f826-c9ef-4f4f-a5b9-e89d7789c390'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-fafec51e-fae9-4c76-9a12-f7d16930f41f tempest-VolumesActionsTest-1587758661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-fafec51e-fae9-4c76-9a12-f7d16930f41f tempest-VolumesActionsTest-1587758661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-fafec51e-fae9-4c76-9a12-f7d16930f41f tempest-VolumesActionsTest-1587758661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-fafec51e-fae9-4c76-9a12-f7d16930f41f tempest-VolumesActionsTest-1587758661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-fafec51e-fae9-4c76-9a12-f7d16930f41f tempest-VolumesActionsTest-1587758661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fafec51e-fae9-4c76-9a12-f7d16930f41f tempest-VolumesActionsTest-1587758661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:29 devstack sudo[98153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:22:29 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:29 devstack sudo[98150]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f3527823-1664-4fe4-9a5c-ccc5715e8341 tempest-VolumesDeleteCascade-1068918560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57.info" returned: 0 in 0.246s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f3527823-1664-4fe4-9a5c-ccc5715e8341 tempest-VolumesDeleteCascade-1068918560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.935s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 8.676s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] Acquiring lock "cinder-quobyte-ca3b0e57-9cac-4293-8224-1b20d0cde9d9-f72011ae-5248-4e33-b7a5-0b72859f4c6b" by "_create_volume_from_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] Lock "cinder-quobyte-ca3b0e57-9cac-4293-8224-1b20d0cde9d9-f72011ae-5248-4e33-b7a5-0b72859f4c6b" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] Creating volume f72011ae-5248-4e33-b7a5-0b72859f4c6b from snapshot ca3b0e57-9cac-4293-8224-1b20d0cde9d9 {{(pid=87038) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] Acquiring lock "cinder-quobyte-f72011ae-5248-4e33-b7a5-0b72859f4c6b" by "_copy_volume_from_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:22:29 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-f3527823-1664-4fe4-9a5c-ccc5715e8341 tempest-VolumesDeleteCascade-1068918560 None] Create snapshot completed successfully Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] Lock "cinder-quobyte-f72011ae-5248-4e33-b7a5-0b72859f4c6b" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] snapshot: ca3b0e57-9cac-4293-8224-1b20d0cde9d9, volume: f72011ae-5248-4e33-b7a5-0b72859f4c6b, {{(pid=87038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[88cdb752-f231-4dc2-8d38-92acca727079]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf.ca3b0e57-9cac-4293-8224-1b20d0cde9d9 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:29 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fafec51e-fae9-4c76-9a12-f7d16930f41f tempest-VolumesActionsTest-1587758661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.277s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-fafec51e-fae9-4c76-9a12-f7d16930f41f tempest-VolumesActionsTest-1587758661 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:22:29 devstack sudo[98156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf.ca3b0e57-9cac-4293-8224-1b20d0cde9d9 Sep 03 11:22:29 devstack sudo[98156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:29 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-fafec51e-fae9-4c76-9a12-f7d16930f41f tempest-VolumesActionsTest-1587758661 None] Deleted volume successfully. Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fafec51e-fae9-4c76-9a12-f7d16930f41f tempest-VolumesActionsTest-1587758661 None] Lock "cinder-6d5417d8-48f2-4ac8-8a41-517f3bf6430a-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:22:29 devstack sudo[98156]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf.ca3b0e57-9cac-4293-8224-1b20d0cde9d9" returned: 0 in 0.390s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8750a676-aa9f-4b32-a7cc-593c35b52edf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[62aff5ef-e0c3-4d85-bfa7-e1e5a475648a]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:22:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:29 devstack sudo[98162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf Sep 03 11:22:29 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:30 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf" returned: 0 in 0.393s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf {{(pid=87038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 11:22:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] Creating direct copy from snapshot {{(pid=87038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 11:22:30 devstack cinder-volume[87038]: DEBUG cinder.utils [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] Path /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f72011ae-5248-4e33-b7a5-0b72859f4c6b not found in is_blk_device check {{(pid=87038) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 11:22:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f72011ae-5248-4e33-b7a5-0b72859f4c6b {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:30 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f72011ae-5248-4e33-b7a5-0b72859f4c6b Sep 03 11:22:30 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:31 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:22:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Flow 'volume_create_manager' (ca29ec6e-1c86-4168-824d-1a8c3f26e664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:22:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d02a10-1d25-4189-a263-9ff2dd8400f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:22:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (95d02a10-1d25-4189-a263-9ff2dd8400f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1543331573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9cb9d38-ab27-4b75-adda-579b3c8d1832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc7ebe2c0ae8454a84774166c65e32ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d9ddebbc-494e-431b-8e62-c07783d2ef04,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:22:31Z,use_quota=True,user_id='60f8e7604e244d23a6a36e22d9a9ff23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:22:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5673fea6-d90c-4dd0-a2a9-9920c907ac52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:22:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5673fea6-d90c-4dd0-a2a9-9920c907ac52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:22:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac436f28-9542-46bf-9c46-df8fdcda84f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:22:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac436f28-9542-46bf-9c46-df8fdcda84f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f9cb9d38-ab27-4b75-adda-579b3c8d1832', 'volume_name': 'volume-f9cb9d38-ab27-4b75-adda-579b3c8d1832', 'volume_size': 1, 'snapshot_id': 'd9ddebbc-494e-431b-8e62-c07783d2ef04'}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:22:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5858a18-d464-4629-9219-40db25b218da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:22:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5858a18-d464-4629-9219-40db25b218da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:22:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fa78475-0cd2-411d-a76d-6fd77c2cfb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:22:31 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Volume f9cb9d38-ab27-4b75-adda-579b3c8d1832: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f9cb9d38-ab27-4b75-adda-579b3c8d1832', 'volume_size': 1, 'snapshot_id': 'd9ddebbc-494e-431b-8e62-c07783d2ef04'} Sep 03 11:22:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:22:35 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f72011ae-5248-4e33-b7a5-0b72859f4c6b" returned: 0 in 5.085s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:35 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] Image conversion details: src /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf, size 1024.00 MB, duration 5.09 sec, destination /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f72011ae-5248-4e33-b7a5-0b72859f4c6b {{(pid=87038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:22:35 devstack cinder-volume[87038]: INFO cinder.image.image_utils [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] Converted 1024.00 MB image at 201.34 MB/s Sep 03 11:22:35 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f72011ae-5248-4e33-b7a5-0b72859f4c6b is being set with open permissions: ugo+rw: NotImplementedError Sep 03 11:22:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f72011ae-5248-4e33-b7a5-0b72859f4c6b {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:35 devstack sudo[98187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f72011ae-5248-4e33-b7a5-0b72859f4c6b Sep 03 11:22:35 devstack sudo[98187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:35 devstack sudo[98187]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f72011ae-5248-4e33-b7a5-0b72859f4c6b" returned: 0 in 0.262s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] Lock "cinder-quobyte-f72011ae-5248-4e33-b7a5-0b72859f4c6b" released by "_copy_volume_from_snapshot" :: held 6.219s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:22:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] Lock "cinder-quobyte-ca3b0e57-9cac-4293-8224-1b20d0cde9d9-f72011ae-5248-4e33-b7a5-0b72859f4c6b" released by "_create_volume_from_snapshot" :: held 6.302s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:22:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.325s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:22:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2f2ab7b5-9afb-4886-a5f0-203c3744c36d tempest-TestImageHashVerification-2081030438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.788s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:22:35 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2f2ab7b5-9afb-4886-a5f0-203c3744c36d tempest-TestImageHashVerification-2081030438 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-351364962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c0527e9-9b56-4836-8781-e077e5abb490,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3bef4d954364e788c699f4f40febbc0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:22:27Z,use_quota=True,user_id='b8dbd48965f44a7a9712cbb1e2a2d7f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:22:35 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-2f2ab7b5-9afb-4886-a5f0-203c3744c36d tempest-TestImageHashVerification-2081030438 None] Creating volume 7c0527e9-9b56-4836-8781-e077e5abb490 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:22:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2f2ab7b5-9afb-4886-a5f0-203c3744c36d tempest-TestImageHashVerification-2081030438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:22:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2f2ab7b5-9afb-4886-a5f0-203c3744c36d tempest-TestImageHashVerification-2081030438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:22:35 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2f2ab7b5-9afb-4886-a5f0-203c3744c36d tempest-TestImageHashVerification-2081030438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:22:35 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2f2ab7b5-9afb-4886-a5f0-203c3744c36d tempest-TestImageHashVerification-2081030438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:22:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2f2ab7b5-9afb-4886-a5f0-203c3744c36d tempest-TestImageHashVerification-2081030438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:22:35 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2f2ab7b5-9afb-4886-a5f0-203c3744c36d tempest-TestImageHashVerification-2081030438 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:22:35 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-2f2ab7b5-9afb-4886-a5f0-203c3744c36d tempest-TestImageHashVerification-2081030438 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:22:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2f2ab7b5-9afb-4886-a5f0-203c3744c36d tempest-TestImageHashVerification-2081030438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7c0527e9-9b56-4836-8781-e077e5abb490 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:35 devstack sudo[98193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7c0527e9-9b56-4836-8781-e077e5abb490 1073741824 Sep 03 11:22:35 devstack sudo[98193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:35 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-89351310-04de-4bc7-adf5-f0da9f78aa26 tempest-GroupSnapshotsTest-1799889754 None] Create group from source-snapshot-846428b6-3f5a-4174-9279-74666c8b6052 completed successfully. Sep 03 11:22:36 devstack sudo[98193]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2f2ab7b5-9afb-4886-a5f0-203c3744c36d tempest-TestImageHashVerification-2081030438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7c0527e9-9b56-4836-8781-e077e5abb490 1073741824" returned: 0 in 0.468s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2f2ab7b5-9afb-4886-a5f0-203c3744c36d tempest-TestImageHashVerification-2081030438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7c0527e9-9b56-4836-8781-e077e5abb490 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:36 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7c0527e9-9b56-4836-8781-e077e5abb490 Sep 03 11:22:36 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:36 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2f2ab7b5-9afb-4886-a5f0-203c3744c36d tempest-TestImageHashVerification-2081030438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7c0527e9-9b56-4836-8781-e077e5abb490" returned: 0 in 0.273s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:36 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2f2ab7b5-9afb-4886-a5f0-203c3744c36d tempest-TestImageHashVerification-2081030438 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:22:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2f2ab7b5-9afb-4886-a5f0-203c3744c36d tempest-TestImageHashVerification-2081030438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:22:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 4.961s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:22:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Acquiring lock "cinder-quobyte-d9ddebbc-494e-431b-8e62-c07783d2ef04-f9cb9d38-ab27-4b75-adda-579b3c8d1832" by "_create_volume_from_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:22:36 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2f2ab7b5-9afb-4886-a5f0-203c3744c36d tempest-TestImageHashVerification-2081030438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbfbe05c-5b2c-4452-9ab4-0b50fa958fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c0527e9-9b56-4836-8781-e077e5abb490', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:22:36 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2f2ab7b5-9afb-4886-a5f0-203c3744c36d tempest-TestImageHashVerification-2081030438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66491046-2e28-4d58-8cd1-f5cfddb7ba75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:22:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Lock "cinder-quobyte-d9ddebbc-494e-431b-8e62-c07783d2ef04-f9cb9d38-ab27-4b75-adda-579b3c8d1832" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:22:36 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Creating volume f9cb9d38-ab27-4b75-adda-579b3c8d1832 from snapshot d9ddebbc-494e-431b-8e62-c07783d2ef04 {{(pid=87038) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 11:22:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:22:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:22:36 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:22:36 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:22:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:22:36 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:22:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Acquiring lock "cinder-quobyte-f9cb9d38-ab27-4b75-adda-579b3c8d1832" by "_copy_volume_from_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:22:36 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-2f2ab7b5-9afb-4886-a5f0-203c3744c36d tempest-TestImageHashVerification-2081030438 None] Volume volume-7c0527e9-9b56-4836-8781-e077e5abb490 (7c0527e9-9b56-4836-8781-e077e5abb490): created successfully Sep 03 11:22:36 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2f2ab7b5-9afb-4886-a5f0-203c3744c36d tempest-TestImageHashVerification-2081030438 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66491046-2e28-4d58-8cd1-f5cfddb7ba75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:22:36 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2f2ab7b5-9afb-4886-a5f0-203c3744c36d tempest-TestImageHashVerification-2081030438 None] Flow 'volume_create_manager' (18b1d8b4-9f19-4095-9e63-d090748c75b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:22:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Lock "cinder-quobyte-f9cb9d38-ab27-4b75-adda-579b3c8d1832" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:22:36 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] snapshot: d9ddebbc-494e-431b-8e62-c07783d2ef04, volume: f9cb9d38-ab27-4b75-adda-579b3c8d1832, {{(pid=87038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 11:22:36 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-2f2ab7b5-9afb-4886-a5f0-203c3744c36d tempest-TestImageHashVerification-2081030438 None] Created volume successfully. Sep 03 11:22:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:22:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:22:36 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:22:36 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:22:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:22:36 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f31c47a-6d73-4664-b3d7-1c318fa35840]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:22:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57.d9ddebbc-494e-431b-8e62-c07783d2ef04 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:36 devstack sudo[98203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57.d9ddebbc-494e-431b-8e62-c07783d2ef04 Sep 03 11:22:36 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-afc195c7-d76f-4f3f-bf6c-465c3745c724 tempest-GroupSnapshotsTest-1799889754 None] Acquiring lock "cinder-quobyte-f72011ae-5248-4e33-b7a5-0b72859f4c6b" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:22:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-afc195c7-d76f-4f3f-bf6c-465c3745c724 tempest-GroupSnapshotsTest-1799889754 None] Lock "cinder-quobyte-f72011ae-5248-4e33-b7a5-0b72859f4c6b" acquired by "delete_volume" :: waited 0.032s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:22:36 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[192c260b-45f9-4ace-88ce-74c97a03fda8]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:22:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-afc195c7-d76f-4f3f-bf6c-465c3745c724 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f72011ae-5248-4e33-b7a5-0b72859f4c6b {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:37 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57.d9ddebbc-494e-431b-8e62-c07783d2ef04" returned: 0 in 0.533s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:37 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:22:37 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fd986e6-168f-4c7f-9088-c6e2c2e14bfc]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:22:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:37 devstack sudo[98207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f72011ae-5248-4e33-b7a5-0b72859f4c6b Sep 03 11:22:37 devstack sudo[98207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:37 devstack sudo[98209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57 Sep 03 11:22:37 devstack sudo[98209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:37 devstack sudo[98207]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-afc195c7-d76f-4f3f-bf6c-465c3745c724 tempest-GroupSnapshotsTest-1799889754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f72011ae-5248-4e33-b7a5-0b72859f4c6b" returned: 0 in 0.453s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-afc195c7-d76f-4f3f-bf6c-465c3745c724 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f72011ae-5248-4e33-b7a5-0b72859f4c6b {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:37 devstack sudo[98217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f72011ae-5248-4e33-b7a5-0b72859f4c6b Sep 03 11:22:37 devstack sudo[98217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:37 devstack sudo[98209]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57" returned: 0 in 0.425s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:37 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57 {{(pid=87038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 11:22:37 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Creating direct copy from snapshot {{(pid=87038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 11:22:37 devstack cinder-volume[87038]: DEBUG cinder.utils [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Path /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f9cb9d38-ab27-4b75-adda-579b3c8d1832 not found in is_blk_device check {{(pid=87038) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 11:22:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f9cb9d38-ab27-4b75-adda-579b3c8d1832 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:37 devstack sudo[98220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f9cb9d38-ab27-4b75-adda-579b3c8d1832 Sep 03 11:22:37 devstack sudo[98220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:37 devstack sudo[98217]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-afc195c7-d76f-4f3f-bf6c-465c3745c724 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f72011ae-5248-4e33-b7a5-0b72859f4c6b" returned: 0 in 0.324s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:37 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-afc195c7-d76f-4f3f-bf6c-465c3745c724 tempest-GroupSnapshotsTest-1799889754 None] Lock "cinder-quobyte-f72011ae-5248-4e33-b7a5-0b72859f4c6b" released by "delete_volume" :: held 0.836s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:22:37 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-afc195c7-d76f-4f3f-bf6c-465c3745c724 tempest-GroupSnapshotsTest-1799889754 None] Created reservations ['313ccc84-b7af-4b70-8fa3-afe521f601ce'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:22:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d0406b25-ff2a-4f46-8d6d-ac2bc16905d4 tempest-TestImageHashVerification-2081030438 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:22:37 devstack cinder-volume[87038]: WARNING cinder.quota [None req-afc195c7-d76f-4f3f-bf6c-465c3745c724 tempest-GroupSnapshotsTest-1799889754 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1190745873 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1190745873, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:22:37 devstack cinder-volume[87038]: WARNING cinder.quota [None req-afc195c7-d76f-4f3f-bf6c-465c3745c724 tempest-GroupSnapshotsTest-1799889754 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1190745873 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1190745873, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:22:37 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-afc195c7-d76f-4f3f-bf6c-465c3745c724 tempest-GroupSnapshotsTest-1799889754 None] Created reservations ['e0c2a0dc-3a87-45df-bac6-9e76f00bfa9d', '048465a9-b259-4a69-a914-1c729a0956d5', '948aec32-b107-480a-8a5d-4fff267bb695', '1304fb28-4594-4d88-8659-7fee3147bf58'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:22:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-afc195c7-d76f-4f3f-bf6c-465c3745c724 tempest-GroupSnapshotsTest-1799889754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:22:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-afc195c7-d76f-4f3f-bf6c-465c3745c724 tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:22:38 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-afc195c7-d76f-4f3f-bf6c-465c3745c724 tempest-GroupSnapshotsTest-1799889754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:22:38 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-afc195c7-d76f-4f3f-bf6c-465c3745c724 tempest-GroupSnapshotsTest-1799889754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:22:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-afc195c7-d76f-4f3f-bf6c-465c3745c724 tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:22:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-afc195c7-d76f-4f3f-bf6c-465c3745c724 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:38 devstack sudo[98228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:22:38 devstack sudo[98228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:38 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-8ef7c479-fdaf-4184-abf0-93e08fa4e63f tempest-GroupSnapshotsTest-1799889754 None] group_snapshot 846428b6-3f5a-4174-9279-74666c8b6052: deleting Sep 03 11:22:38 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8ef7c479-fdaf-4184-abf0-93e08fa4e63f tempest-GroupSnapshotsTest-1799889754 None] group_snapshot 846428b6-3f5a-4174-9279-74666c8b6052: deleting {{(pid=87038) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 03 11:22:38 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8ef7c479-fdaf-4184-abf0-93e08fa4e63f tempest-GroupSnapshotsTest-1799889754 None] Acquiring lock "cinder-quobyte-8750a676-aa9f-4b32-a7cc-593c35b52edf" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:22:38 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8ef7c479-fdaf-4184-abf0-93e08fa4e63f tempest-GroupSnapshotsTest-1799889754 None] Lock "cinder-quobyte-8750a676-aa9f-4b32-a7cc-593c35b52edf" acquired by "delete_snapshot" :: waited 0.060s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:22:38 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8ef7c479-fdaf-4184-abf0-93e08fa4e63f tempest-GroupSnapshotsTest-1799889754 None] Acquiring lock "cinder-quobyte-ca3b0e57-9cac-4293-8224-1b20d0cde9d9" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:22:38 devstack sudo[98228]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-afc195c7-d76f-4f3f-bf6c-465c3745c724 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.634s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:38 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-afc195c7-d76f-4f3f-bf6c-465c3745c724 tempest-GroupSnapshotsTest-1799889754 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:22:38 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-afc195c7-d76f-4f3f-bf6c-465c3745c724 tempest-GroupSnapshotsTest-1799889754 None] Delete group completed successfully. Sep 03 11:22:38 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8ef7c479-fdaf-4184-abf0-93e08fa4e63f tempest-GroupSnapshotsTest-1799889754 None] Lock "cinder-quobyte-ca3b0e57-9cac-4293-8224-1b20d0cde9d9" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:22:38 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-8ef7c479-fdaf-4184-abf0-93e08fa4e63f tempest-GroupSnapshotsTest-1799889754 None] Deleting offline snapshot ca3b0e57-9cac-4293-8224-1b20d0cde9d9 of volume 8750a676-aa9f-4b32-a7cc-593c35b52edf {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:22:38 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-8ef7c479-fdaf-4184-abf0-93e08fa4e63f tempest-GroupSnapshotsTest-1799889754 None] snapshot_file for this snap is: volume-8750a676-aa9f-4b32-a7cc-593c35b52edf.ca3b0e57-9cac-4293-8224-1b20d0cde9d9 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:22:38 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e40509-3adf-4c1b-ba75-17d2fab01e0e]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:22:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8ef7c479-fdaf-4184-abf0-93e08fa4e63f tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf.ca3b0e57-9cac-4293-8224-1b20d0cde9d9 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:39 devstack sudo[98237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf.ca3b0e57-9cac-4293-8224-1b20d0cde9d9 Sep 03 11:22:39 devstack sudo[98237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:39 devstack sudo[98237]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8ef7c479-fdaf-4184-abf0-93e08fa4e63f tempest-GroupSnapshotsTest-1799889754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf.ca3b0e57-9cac-4293-8224-1b20d0cde9d9" returned: 0 in 0.841s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-8ef7c479-fdaf-4184-abf0-93e08fa4e63f tempest-GroupSnapshotsTest-1799889754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8750a676-aa9f-4b32-a7cc-593c35b52edf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:22:39 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e2538c7-4cd3-4759-98ff-448c4de9655d]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:22:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8ef7c479-fdaf-4184-abf0-93e08fa4e63f tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:40 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf Sep 03 11:22:40 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:40 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-9f7d4f01-797d-4052-8012-1df2e3f4189a tempest-VolumesGetTest-1157460799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:22:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9f7d4f01-797d-4052-8012-1df2e3f4189a tempest-VolumesGetTest-1157460799 None] Flow 'volume_create_manager' (894b8541-93ad-4bd5-8307-9556c697e5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:22:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9f7d4f01-797d-4052-8012-1df2e3f4189a tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb0e1a5-37eb-4203-99f5-192edaf5d3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:22:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9f7d4f01-797d-4052-8012-1df2e3f4189a tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb0e1a5-37eb-4203-99f5-192edaf5d3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1962740532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50ce3000-bacf-4580-961f-93d16675eb3a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d7fa995d29344de194fdbabe2f065b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:22:40Z,use_quota=True,user_id='d977b948c0fd4c27bff72a5c3e2d78d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:22:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9f7d4f01-797d-4052-8012-1df2e3f4189a tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98b768db-9691-4376-84f7-ddf76000e94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:22:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9f7d4f01-797d-4052-8012-1df2e3f4189a tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98b768db-9691-4376-84f7-ddf76000e94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:22:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9f7d4f01-797d-4052-8012-1df2e3f4189a tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0e51795-c8ce-4ce2-9d88-940b63a21e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:22:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9f7d4f01-797d-4052-8012-1df2e3f4189a tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0e51795-c8ce-4ce2-9d88-940b63a21e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50ce3000-bacf-4580-961f-93d16675eb3a', 'volume_name': 'volume-50ce3000-bacf-4580-961f-93d16675eb3a', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:22:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9f7d4f01-797d-4052-8012-1df2e3f4189a tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b23da080-62f7-407b-82f0-9b3ea1f47876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:22:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9f7d4f01-797d-4052-8012-1df2e3f4189a tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b23da080-62f7-407b-82f0-9b3ea1f47876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:22:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9f7d4f01-797d-4052-8012-1df2e3f4189a tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f4dc6da-a19a-4fd9-baab-d97fa2ffd815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:22:40 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-9f7d4f01-797d-4052-8012-1df2e3f4189a tempest-VolumesGetTest-1157460799 None] Volume 50ce3000-bacf-4580-961f-93d16675eb3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50ce3000-bacf-4580-961f-93d16675eb3a', 'volume_size': 1} Sep 03 11:22:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9f7d4f01-797d-4052-8012-1df2e3f4189a tempest-VolumesGetTest-1157460799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:22:41 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8ef7c479-fdaf-4184-abf0-93e08fa4e63f tempest-GroupSnapshotsTest-1799889754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf" returned: 0 in 1.444s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8ef7c479-fdaf-4184-abf0-93e08fa4e63f tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf.ca3b0e57-9cac-4293-8224-1b20d0cde9d9 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:41 devstack sudo[98248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf.ca3b0e57-9cac-4293-8224-1b20d0cde9d9 Sep 03 11:22:41 devstack sudo[98248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:42 devstack sudo[98248]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8ef7c479-fdaf-4184-abf0-93e08fa4e63f tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf.ca3b0e57-9cac-4293-8224-1b20d0cde9d9" returned: 0 in 1.008s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8ef7c479-fdaf-4184-abf0-93e08fa4e63f tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf.ca3b0e57-9cac-4293-8224-1b20d0cde9d9 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:42 devstack sudo[98254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf.ca3b0e57-9cac-4293-8224-1b20d0cde9d9 Sep 03 11:22:42 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:42 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8ef7c479-fdaf-4184-abf0-93e08fa4e63f tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf.ca3b0e57-9cac-4293-8224-1b20d0cde9d9" returned: 0 in 0.428s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:42 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8ef7c479-fdaf-4184-abf0-93e08fa4e63f tempest-GroupSnapshotsTest-1799889754 None] Lock "cinder-quobyte-ca3b0e57-9cac-4293-8224-1b20d0cde9d9" released by "_delete_snapshot" :: held 3.942s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:22:42 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8ef7c479-fdaf-4184-abf0-93e08fa4e63f tempest-GroupSnapshotsTest-1799889754 None] Lock "cinder-quobyte-8750a676-aa9f-4b32-a7cc-593c35b52edf" released by "delete_snapshot" :: held 3.998s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:22:42 devstack sudo[98220]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f9cb9d38-ab27-4b75-adda-579b3c8d1832" returned: 0 in 5.175s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:42 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Image conversion details: src /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57, size 1024.00 MB, duration 5.18 sec, destination /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f9cb9d38-ab27-4b75-adda-579b3c8d1832 {{(pid=87038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:22:42 devstack cinder-volume[87038]: INFO cinder.image.image_utils [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Converted 1024.00 MB image at 197.83 MB/s Sep 03 11:22:42 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f9cb9d38-ab27-4b75-adda-579b3c8d1832 is being set with open permissions: ugo+rw Sep 03 11:22:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f9cb9d38-ab27-4b75-adda-579b3c8d1832 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:42 devstack sudo[98257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f9cb9d38-ab27-4b75-adda-579b3c8d1832 Sep 03 11:22:42 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:42 devstack cinder-volume[87038]: WARNING cinder.quota [None req-8ef7c479-fdaf-4184-abf0-93e08fa4e63f tempest-GroupSnapshotsTest-1799889754 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1190745873 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1190745873, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:22:42 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-8ef7c479-fdaf-4184-abf0-93e08fa4e63f tempest-GroupSnapshotsTest-1799889754 None] Created reservations ['81023115-be43-43e8-8b73-be5528eaedae', 'bc7be1a9-032e-401d-b3c2-61a99c2955d5', '4e6c2754-764c-466a-903c-967a0639a5fc', '2b1a7155-407b-48b5-9856-bdc5ccba8349'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:22:42 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-8ef7c479-fdaf-4184-abf0-93e08fa4e63f tempest-GroupSnapshotsTest-1799889754 None] group_snapshot 846428b6-3f5a-4174-9279-74666c8b6052: deleted successfully Sep 03 11:22:42 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f9cb9d38-ab27-4b75-adda-579b3c8d1832" returned: 0 in 0.243s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:42 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Lock "cinder-quobyte-f9cb9d38-ab27-4b75-adda-579b3c8d1832" released by "_copy_volume_from_snapshot" :: held 6.471s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:22:42 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Lock "cinder-quobyte-d9ddebbc-494e-431b-8e62-c07783d2ef04-f9cb9d38-ab27-4b75-adda-579b3c8d1832" released by "_create_volume_from_snapshot" :: held 6.545s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:22:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.588s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:22:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d0406b25-ff2a-4f46-8d6d-ac2bc16905d4 tempest-TestImageHashVerification-2081030438 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 5.097s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:22:43 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bcbf00f-3ec6-4b3a-8405-dcf4c8325370]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:22:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d0406b25-ff2a-4f46-8d6d-ac2bc16905d4 tempest-TestImageHashVerification-2081030438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7c0527e9-9b56-4836-8781-e077e5abb490 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fa78475-0cd2-411d-a76d-6fd77c2cfb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9cb9d38-ab27-4b75-adda-579b3c8d1832', 'volume_size': 1, 'snapshot_id': 'd9ddebbc-494e-431b-8e62-c07783d2ef04'}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:22:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b9571b5-ba82-46a1-8ce1-402c727dbfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:22:43 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Volume volume-f9cb9d38-ab27-4b75-adda-579b3c8d1832 (f9cb9d38-ab27-4b75-adda-579b3c8d1832): created successfully Sep 03 11:22:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b9571b5-ba82-46a1-8ce1-402c727dbfb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:22:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Flow 'volume_create_manager' (ca29ec6e-1c86-4168-824d-1a8c3f26e664) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:22:43 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-5611387c-cdfe-4de7-841e-717182416f16 tempest-VolumesDeleteCascade-1068918560 None] Created volume successfully. Sep 03 11:22:43 devstack sudo[98260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7c0527e9-9b56-4836-8781-e077e5abb490 Sep 03 11:22:43 devstack sudo[98260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:43 devstack sudo[98260]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d0406b25-ff2a-4f46-8d6d-ac2bc16905d4 tempest-TestImageHashVerification-2081030438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7c0527e9-9b56-4836-8781-e077e5abb490" returned: 0 in 0.354s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:43 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[28adfb67-ad3b-4271-9475-2a510049b84c]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:22:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d0406b25-ff2a-4f46-8d6d-ac2bc16905d4 tempest-TestImageHashVerification-2081030438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7c0527e9-9b56-4836-8781-e077e5abb490 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:43 devstack sudo[98265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7c0527e9-9b56-4836-8781-e077e5abb490 Sep 03 11:22:43 devstack sudo[98265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:43 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] Acquiring lock "cinder-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:22:43 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-0e58b58b-676b-4b99-a7fc-971fd8256ffd tempest-GroupSnapshotsTest-1799889754 None] Acquiring lock "cinder-quobyte-8750a676-aa9f-4b32-a7cc-593c35b52edf" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:22:43 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] Lock "cinder-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:22:43 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-0e58b58b-676b-4b99-a7fc-971fd8256ffd tempest-GroupSnapshotsTest-1799889754 None] Lock "cinder-quobyte-8750a676-aa9f-4b32-a7cc-593c35b52edf" acquired by "delete_volume" :: waited 0.023s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:22:43 devstack sudo[98265]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d0406b25-ff2a-4f46-8d6d-ac2bc16905d4 tempest-TestImageHashVerification-2081030438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7c0527e9-9b56-4836-8781-e077e5abb490" returned: 0 in 0.431s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d0406b25-ff2a-4f46-8d6d-ac2bc16905d4 tempest-TestImageHashVerification-2081030438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7c0527e9-9b56-4836-8781-e077e5abb490 /opt/stack/data/cinder/conversion/7c0527e9-9b56-4836-8781-e077e5abb490.temp_image.50c3d903-fff6-4d92-9e6c-74e517d11571vsyohx4_.img {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:43 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[818fb3ba-5831-4c4e-8fd4-62b709d54ddb]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:22:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0e58b58b-676b-4b99-a7fc-971fd8256ffd tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:43 devstack sudo[98270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7c0527e9-9b56-4836-8781-e077e5abb490 /opt/stack/data/cinder/conversion/7c0527e9-9b56-4836-8781-e077e5abb490.temp_image.50c3d903-fff6-4d92-9e6c-74e517d11571vsyohx4_.img Sep 03 11:22:43 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] Performing cascade delete. {{(pid=87038) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 03 11:22:43 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] Acquiring lock "cinder-d9ddebbc-494e-431b-8e62-c07783d2ef04-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:22:43 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] Lock "cinder-d9ddebbc-494e-431b-8e62-c07783d2ef04-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:22:43 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] Acquiring lock "cinder-quobyte-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:22:43 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] Lock "cinder-quobyte-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:22:43 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] Acquiring lock "cinder-quobyte-d9ddebbc-494e-431b-8e62-c07783d2ef04" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:22:43 devstack sudo[98271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf Sep 03 11:22:43 devstack sudo[98271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:43 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] Lock "cinder-quobyte-d9ddebbc-494e-431b-8e62-c07783d2ef04" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:22:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] Deleting offline snapshot d9ddebbc-494e-431b-8e62-c07783d2ef04 of volume 99fa59e2-93b3-4e6d-98e9-5ab4acd43c57 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:22:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] snapshot_file for this snap is: volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57.d9ddebbc-494e-431b-8e62-c07783d2ef04 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:22:43 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb601d9-5e39-4984-b4c7-fc93933ae382]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:22:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57.d9ddebbc-494e-431b-8e62-c07783d2ef04 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:44 devstack sudo[98274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57.d9ddebbc-494e-431b-8e62-c07783d2ef04 Sep 03 11:22:44 devstack sudo[98274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:44 devstack sudo[98271]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0e58b58b-676b-4b99-a7fc-971fd8256ffd tempest-GroupSnapshotsTest-1799889754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf" returned: 0 in 0.525s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0e58b58b-676b-4b99-a7fc-971fd8256ffd tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:44 devstack sudo[98290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf Sep 03 11:22:44 devstack sudo[98290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:44 devstack sudo[98274]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57.d9ddebbc-494e-431b-8e62-c07783d2ef04" returned: 0 in 0.669s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:22:44 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c0f93f-2b67-4a03-8585-dba61ccc2bbe]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:22:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:44 devstack sudo[98290]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0e58b58b-676b-4b99-a7fc-971fd8256ffd tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8750a676-aa9f-4b32-a7cc-593c35b52edf" returned: 0 in 0.427s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:44 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-0e58b58b-676b-4b99-a7fc-971fd8256ffd tempest-GroupSnapshotsTest-1799889754 None] Lock "cinder-quobyte-8750a676-aa9f-4b32-a7cc-593c35b52edf" released by "delete_volume" :: held 1.048s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:22:44 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-0e58b58b-676b-4b99-a7fc-971fd8256ffd tempest-GroupSnapshotsTest-1799889754 None] Created reservations ['9e8cf830-dd1f-4589-be3e-d11602f2e1cc'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:22:45 devstack cinder-volume[87038]: WARNING cinder.db.api [None req-0e58b58b-676b-4b99-a7fc-971fd8256ffd tempest-GroupSnapshotsTest-1799889754 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1190745873'] Sep 03 11:22:45 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-0e58b58b-676b-4b99-a7fc-971fd8256ffd tempest-GroupSnapshotsTest-1799889754 None] Created reservations ['c56c9202-30c3-41a5-a2e7-6bee830c36cd', 'ebfefecd-463e-4392-8032-358d13a6b75f', '9502964d-910f-4555-a883-ebeede1e0ea8', 'e824c8a6-6db9-4344-b954-2b1c9337aad5'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:22:45 devstack sudo[98296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57 Sep 03 11:22:45 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0e58b58b-676b-4b99-a7fc-971fd8256ffd tempest-GroupSnapshotsTest-1799889754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:22:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0e58b58b-676b-4b99-a7fc-971fd8256ffd tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:22:45 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0e58b58b-676b-4b99-a7fc-971fd8256ffd tempest-GroupSnapshotsTest-1799889754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:22:45 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0e58b58b-676b-4b99-a7fc-971fd8256ffd tempest-GroupSnapshotsTest-1799889754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:22:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0e58b58b-676b-4b99-a7fc-971fd8256ffd tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:22:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0e58b58b-676b-4b99-a7fc-971fd8256ffd tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:45 devstack sudo[98298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:22:45 devstack sudo[98298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:46 devstack sudo[98298]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0e58b58b-676b-4b99-a7fc-971fd8256ffd tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.723s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:46 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-0e58b58b-676b-4b99-a7fc-971fd8256ffd tempest-GroupSnapshotsTest-1799889754 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:22:46 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-0e58b58b-676b-4b99-a7fc-971fd8256ffd tempest-GroupSnapshotsTest-1799889754 None] Delete group completed successfully. Sep 03 11:22:46 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57" returned: 0 in 1.485s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57.d9ddebbc-494e-431b-8e62-c07783d2ef04 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:46 devstack sudo[98305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57.d9ddebbc-494e-431b-8e62-c07783d2ef04 Sep 03 11:22:46 devstack sudo[98305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:47 devstack sudo[98305]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57.d9ddebbc-494e-431b-8e62-c07783d2ef04" returned: 0 in 0.940s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57.d9ddebbc-494e-431b-8e62-c07783d2ef04 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:47 devstack sudo[98312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57.d9ddebbc-494e-431b-8e62-c07783d2ef04 Sep 03 11:22:47 devstack sudo[98312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:47 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-542d0ac6-2a96-4780-ab4e-3433f13c3420 tempest-GroupSnapshotsTest-1799889754 None] Group tempest-GroupSnapshotsTest-Group-2119008203: creating Sep 03 11:22:47 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-542d0ac6-2a96-4780-ab4e-3433f13c3420 tempest-GroupSnapshotsTest-1799889754 None] Group tempest-GroupSnapshotsTest-Group-2119008203: created successfully Sep 03 11:22:47 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-542d0ac6-2a96-4780-ab4e-3433f13c3420 tempest-GroupSnapshotsTest-1799889754 None] Create group completed successfully. Sep 03 11:22:48 devstack sudo[98312]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57.d9ddebbc-494e-431b-8e62-c07783d2ef04" returned: 0 in 0.888s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:48 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] Lock "cinder-quobyte-d9ddebbc-494e-431b-8e62-c07783d2ef04" released by "_delete_snapshot" :: held 4.159s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:22:48 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] Lock "cinder-quobyte-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57" released by "delete_snapshot" :: held 4.198s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:22:48 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] Created reservations ['154ac4b6-a8c4-4191-9136-8a7119d237fa', '92ad7781-b01d-4234-a606-3f1d32d5dd97', '6bd2daaa-d2b7-4955-9b6b-d27202b97c6d', '38611c97-4601-41af-ae63-8f6295bda260'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:22:48 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] Delete snapshot completed successfully. Sep 03 11:22:48 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] Lock "cinder-d9ddebbc-494e-431b-8e62-c07783d2ef04-delete_snapshot" released by "delete_snapshot" :: held 4.558s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:22:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] Snapshots deleted, issuing volume delete {{(pid=87038) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 03 11:22:48 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] Acquiring lock "cinder-quobyte-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:22:48 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] Lock "cinder-quobyte-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57" acquired by "delete_volume" :: waited 0.034s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:22:48 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb701ee-707b-4b75-85d2-697791dac76a]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:22:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:48 devstack sudo[98316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57 Sep 03 11:22:48 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:49 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d0406b25-ff2a-4f46-8d6d-ac2bc16905d4 tempest-TestImageHashVerification-2081030438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7c0527e9-9b56-4836-8781-e077e5abb490 /opt/stack/data/cinder/conversion/7c0527e9-9b56-4836-8781-e077e5abb490.temp_image.50c3d903-fff6-4d92-9e6c-74e517d11571vsyohx4_.img" returned: 0 in 5.298s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:49 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[133d9494-4564-4520-bc2e-6dcdcc1c64de]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:22:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d0406b25-ff2a-4f46-8d6d-ac2bc16905d4 tempest-TestImageHashVerification-2081030438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7c0527e9-9b56-4836-8781-e077e5abb490 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:49 devstack sudo[98318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7c0527e9-9b56-4836-8781-e077e5abb490 Sep 03 11:22:49 devstack sudo[98318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:49 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57" returned: 0 in 0.696s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:49 devstack sudo[98323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57 Sep 03 11:22:49 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:49 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57" returned: 0 in 0.345s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:49 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] Lock "cinder-quobyte-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57" released by "delete_volume" :: held 1.165s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:22:49 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bb123c0-f55d-4adb-96c3-0fdfdec4c044 tempest-GroupSnapshotsTest-1799889754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:22:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1bb123c0-f55d-4adb-96c3-0fdfdec4c044 tempest-GroupSnapshotsTest-1799889754 None] Flow 'volume_create_manager' (9e762fb0-4bfc-403e-bf36-7e14a208937b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:22:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1bb123c0-f55d-4adb-96c3-0fdfdec4c044 tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0852542-a70d-417b-96ad-b17b56ad49e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:22:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1bb123c0-f55d-4adb-96c3-0fdfdec4c044 tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0852542-a70d-417b-96ad-b17b56ad49e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-479933259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c5fef1c-13c8-4ce7-b05e-dfd6f527a0a0,host='devstack@QuobyteHD#QuobyteHD',id=09cf4b08-017c-43f8-b4f0-647b6e94f0af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8caa1cbb957e461cbedbeeb17177dcd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:22:50Z,use_quota=True,user_id='34720c2ae5d34ba49f535dcddb1aa2f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(424f843f-2406-4191-8ae8-e7a5b9b08e92),volume_type_id=424f843f-2406-4191-8ae8-e7a5b9b08e92)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:22:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1bb123c0-f55d-4adb-96c3-0fdfdec4c044 tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb1778e-f28b-485f-9ec8-32bd9504ce93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:22:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1bb123c0-f55d-4adb-96c3-0fdfdec4c044 tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (feb1778e-f28b-485f-9ec8-32bd9504ce93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:22:49 devstack sudo[98318]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1bb123c0-f55d-4adb-96c3-0fdfdec4c044 tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d02df049-7a9e-4a71-b9ae-c5699d920e14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:22:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1bb123c0-f55d-4adb-96c3-0fdfdec4c044 tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d02df049-7a9e-4a71-b9ae-c5699d920e14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09cf4b08-017c-43f8-b4f0-647b6e94f0af', 'volume_name': 'volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:22:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1bb123c0-f55d-4adb-96c3-0fdfdec4c044 tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (880d8555-ac95-46ab-89db-cb3a351b3c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:22:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1bb123c0-f55d-4adb-96c3-0fdfdec4c044 tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (880d8555-ac95-46ab-89db-cb3a351b3c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:22:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1bb123c0-f55d-4adb-96c3-0fdfdec4c044 tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf5a6f6-ec11-4058-b04b-98c775f631a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:22:49 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-1bb123c0-f55d-4adb-96c3-0fdfdec4c044 tempest-GroupSnapshotsTest-1799889754 None] Volume 09cf4b08-017c-43f8-b4f0-647b6e94f0af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af', 'volume_size': 1} Sep 03 11:22:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1bb123c0-f55d-4adb-96c3-0fdfdec4c044 tempest-GroupSnapshotsTest-1799889754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:22:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d0406b25-ff2a-4f46-8d6d-ac2bc16905d4 tempest-TestImageHashVerification-2081030438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7c0527e9-9b56-4836-8781-e077e5abb490" returned: 0 in 0.666s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:49 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-d0406b25-ff2a-4f46-8d6d-ac2bc16905d4 tempest-TestImageHashVerification-2081030438 None] Image conversion details: src /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7c0527e9-9b56-4836-8781-e077e5abb490, size 1024.00 MB, duration 5.30 sec, destination /opt/stack/data/cinder/conversion/7c0527e9-9b56-4836-8781-e077e5abb490.temp_image.50c3d903-fff6-4d92-9e6c-74e517d11571vsyohx4_.img {{(pid=87038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:22:49 devstack cinder-volume[87038]: INFO cinder.image.image_utils [None req-d0406b25-ff2a-4f46-8d6d-ac2bc16905d4 tempest-TestImageHashVerification-2081030438 None] Converted 1024.00 MB image at 193.23 MB/s Sep 03 11:22:49 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-d0406b25-ff2a-4f46-8d6d-ac2bc16905d4 tempest-TestImageHashVerification-2081030438 None] 50c3d903-fff6-4d92-9e6c-74e517d11571 was raw, no need to convert to raw {{(pid=87038) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 03 11:22:49 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] Created reservations ['33f40ace-66a3-485e-95c0-d5d711b538a8', '47159366-8ae4-4b03-8d7d-2de76cadcdc8', '78f60325-d562-4c1a-a6a2-8854389d03dc', '875701c9-35ba-42b6-9c59-9629ac501f0f'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:22:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:22:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:22:49 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:22:49 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:22:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:22:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:49 devstack sudo[98330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:22:49 devstack sudo[98330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:50 devstack sudo[98330]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.255s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:50 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:22:50 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] Deleted volume successfully. Sep 03 11:22:50 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e1c775af-868c-4e65-9395-76fce951e1c4 tempest-VolumesDeleteCascade-1068918560 None] Lock "cinder-99fa59e2-93b3-4e6d-98e9-5ab4acd43c57-delete_volume" released by "delete_volume" :: held 6.444s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:22:50 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e7820952-6390-47ce-aa61-ff4f38be98e8 tempest-VolumesDeleteCascade-1068918560 None] Acquiring lock "cinder-f9cb9d38-ab27-4b75-adda-579b3c8d1832-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:22:50 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e7820952-6390-47ce-aa61-ff4f38be98e8 tempest-VolumesDeleteCascade-1068918560 None] Lock "cinder-f9cb9d38-ab27-4b75-adda-579b3c8d1832-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:22:50 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e7820952-6390-47ce-aa61-ff4f38be98e8 tempest-VolumesDeleteCascade-1068918560 None] Acquiring lock "cinder-quobyte-f9cb9d38-ab27-4b75-adda-579b3c8d1832" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:22:50 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e7820952-6390-47ce-aa61-ff4f38be98e8 tempest-VolumesDeleteCascade-1068918560 None] Lock "cinder-quobyte-f9cb9d38-ab27-4b75-adda-579b3c8d1832" acquired by "delete_volume" :: waited 0.017s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:22:50 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b8875c-a906-41f6-81a7-c72a9281caee]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:22:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e7820952-6390-47ce-aa61-ff4f38be98e8 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f9cb9d38-ab27-4b75-adda-579b3c8d1832 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:51 devstack sudo[98333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f9cb9d38-ab27-4b75-adda-579b3c8d1832 Sep 03 11:22:51 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:51 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e7820952-6390-47ce-aa61-ff4f38be98e8 tempest-VolumesDeleteCascade-1068918560 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f9cb9d38-ab27-4b75-adda-579b3c8d1832" returned: 0 in 0.382s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e7820952-6390-47ce-aa61-ff4f38be98e8 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f9cb9d38-ab27-4b75-adda-579b3c8d1832 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:51 devstack sudo[98338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f9cb9d38-ab27-4b75-adda-579b3c8d1832 Sep 03 11:22:51 devstack sudo[98338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:51 devstack sudo[98338]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e7820952-6390-47ce-aa61-ff4f38be98e8 tempest-VolumesDeleteCascade-1068918560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f9cb9d38-ab27-4b75-adda-579b3c8d1832" returned: 0 in 0.247s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:51 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e7820952-6390-47ce-aa61-ff4f38be98e8 tempest-VolumesDeleteCascade-1068918560 None] Lock "cinder-quobyte-f9cb9d38-ab27-4b75-adda-579b3c8d1832" released by "delete_volume" :: held 0.700s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:22:51 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-e7820952-6390-47ce-aa61-ff4f38be98e8 tempest-VolumesDeleteCascade-1068918560 None] Created reservations ['15bc38fc-0b15-42d3-b7b4-df28eea87ddf', '4f31499b-dd8a-4b06-8cfc-497b391a35a1', '09857a03-2769-4b86-88f9-4ec710adda76', '676a54b8-9552-4af0-be30-a8b4460f9659'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:22:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e7820952-6390-47ce-aa61-ff4f38be98e8 tempest-VolumesDeleteCascade-1068918560 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:22:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e7820952-6390-47ce-aa61-ff4f38be98e8 tempest-VolumesDeleteCascade-1068918560 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:22:51 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e7820952-6390-47ce-aa61-ff4f38be98e8 tempest-VolumesDeleteCascade-1068918560 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:22:51 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e7820952-6390-47ce-aa61-ff4f38be98e8 tempest-VolumesDeleteCascade-1068918560 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:22:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e7820952-6390-47ce-aa61-ff4f38be98e8 tempest-VolumesDeleteCascade-1068918560 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:22:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e7820952-6390-47ce-aa61-ff4f38be98e8 tempest-VolumesDeleteCascade-1068918560 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:22:51 devstack sudo[98341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:22:51 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:22:51 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root Sep 03 11:22:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e7820952-6390-47ce-aa61-ff4f38be98e8 tempest-VolumesDeleteCascade-1068918560 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.286s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:22:51 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-e7820952-6390-47ce-aa61-ff4f38be98e8 tempest-VolumesDeleteCascade-1068918560 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:22:52 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-e7820952-6390-47ce-aa61-ff4f38be98e8 tempest-VolumesDeleteCascade-1068918560 None] Deleted volume successfully. Sep 03 11:22:52 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e7820952-6390-47ce-aa61-ff4f38be98e8 tempest-VolumesDeleteCascade-1068918560 None] Lock "cinder-f9cb9d38-ab27-4b75-adda-579b3c8d1832-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:22:55 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-905393ae-13d2-4245-9c74-abf7477ff6d7 tempest-VolumesCloneTest-1898024090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:22:55 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-905393ae-13d2-4245-9c74-abf7477ff6d7 tempest-VolumesCloneTest-1898024090 None] Flow 'volume_create_manager' (691abbcd-9927-4e3b-8d8c-1ae20b0593e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:22:55 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-905393ae-13d2-4245-9c74-abf7477ff6d7 tempest-VolumesCloneTest-1898024090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36121503-1302-4164-94c4-4f8a28155b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:22:55 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-905393ae-13d2-4245-9c74-abf7477ff6d7 tempest-VolumesCloneTest-1898024090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36121503-1302-4164-94c4-4f8a28155b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-523774541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3924121-0c9e-4027-a7b5-b385ccd43b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26126ff7fbd2450186c7774e0b049745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:22:55Z,use_quota=True,user_id='d53fd0b3d6ac46be9175e60c41e30762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:22:55 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-905393ae-13d2-4245-9c74-abf7477ff6d7 tempest-VolumesCloneTest-1898024090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d14f50-052d-4250-b602-6acf47f8cd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:22:55 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-905393ae-13d2-4245-9c74-abf7477ff6d7 tempest-VolumesCloneTest-1898024090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97d14f50-052d-4250-b602-6acf47f8cd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:22:55 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-905393ae-13d2-4245-9c74-abf7477ff6d7 tempest-VolumesCloneTest-1898024090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ed15c80-7e4a-451b-850b-2aa5ddcac9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:22:55 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-905393ae-13d2-4245-9c74-abf7477ff6d7 tempest-VolumesCloneTest-1898024090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ed15c80-7e4a-451b-850b-2aa5ddcac9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3924121-0c9e-4027-a7b5-b385ccd43b8c', 'volume_name': 'volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:22:55 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-905393ae-13d2-4245-9c74-abf7477ff6d7 tempest-VolumesCloneTest-1898024090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01827ce6-2181-47a1-95fa-bed0ab80f317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:22:55 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-905393ae-13d2-4245-9c74-abf7477ff6d7 tempest-VolumesCloneTest-1898024090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01827ce6-2181-47a1-95fa-bed0ab80f317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:22:55 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-905393ae-13d2-4245-9c74-abf7477ff6d7 tempest-VolumesCloneTest-1898024090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c49f2a4-3ea0-4ddf-a084-1a1995f696d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:22:55 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-905393ae-13d2-4245-9c74-abf7477ff6d7 tempest-VolumesCloneTest-1898024090 None] Volume f3924121-0c9e-4027-a7b5-b385ccd43b8c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c', 'volume_size': 1} Sep 03 11:22:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-905393ae-13d2-4245-9c74-abf7477ff6d7 tempest-VolumesCloneTest-1898024090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:05 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:UPDATE=75,cinder:INSERT=18,cinder:SELECT=71,cinder:DELETE=4 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:23:05 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=79,cinder:UPDATE=79,cinder:DELETE=4,cinder:INSERT=19 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:23:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d0406b25-ff2a-4f46-8d6d-ac2bc16905d4 tempest-TestImageHashVerification-2081030438 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.239s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d0406b25-ff2a-4f46-8d6d-ac2bc16905d4 tempest-TestImageHashVerification-2081030438 None] Uploaded volume to glance image-id: 50c3d903-fff6-4d92-9e6c-74e517d11571. {{(pid=87038) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 03 11:23:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9f7d4f01-797d-4052-8012-1df2e3f4189a tempest-VolumesGetTest-1157460799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.752s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-9f7d4f01-797d-4052-8012-1df2e3f4189a tempest-VolumesGetTest-1157460799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1962740532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50ce3000-bacf-4580-961f-93d16675eb3a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d7fa995d29344de194fdbabe2f065b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:22:40Z,use_quota=True,user_id='d977b948c0fd4c27bff72a5c3e2d78d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:23:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-9f7d4f01-797d-4052-8012-1df2e3f4189a tempest-VolumesGetTest-1157460799 None] Creating volume 50ce3000-bacf-4580-961f-93d16675eb3a {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:23:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9f7d4f01-797d-4052-8012-1df2e3f4189a tempest-VolumesGetTest-1157460799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9f7d4f01-797d-4052-8012-1df2e3f4189a tempest-VolumesGetTest-1157460799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-9f7d4f01-797d-4052-8012-1df2e3f4189a tempest-VolumesGetTest-1157460799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:23:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-9f7d4f01-797d-4052-8012-1df2e3f4189a tempest-VolumesGetTest-1157460799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:23:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9f7d4f01-797d-4052-8012-1df2e3f4189a tempest-VolumesGetTest-1157460799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-9f7d4f01-797d-4052-8012-1df2e3f4189a tempest-VolumesGetTest-1157460799 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:23:09 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-9f7d4f01-797d-4052-8012-1df2e3f4189a tempest-VolumesGetTest-1157460799 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:23:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9f7d4f01-797d-4052-8012-1df2e3f4189a tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-50ce3000-bacf-4580-961f-93d16675eb3a 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:09 devstack sudo[98347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-50ce3000-bacf-4580-961f-93d16675eb3a 1073741824 Sep 03 11:23:09 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:09 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-d0406b25-ff2a-4f46-8d6d-ac2bc16905d4 tempest-TestImageHashVerification-2081030438 None] Copy volume to image completed successfully. Sep 03 11:23:09 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9f7d4f01-797d-4052-8012-1df2e3f4189a tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-50ce3000-bacf-4580-961f-93d16675eb3a 1073741824" returned: 0 in 0.439s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9f7d4f01-797d-4052-8012-1df2e3f4189a tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-50ce3000-bacf-4580-961f-93d16675eb3a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:09 devstack sudo[98352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-50ce3000-bacf-4580-961f-93d16675eb3a Sep 03 11:23:09 devstack sudo[98352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:09 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ac86d24f-1a76-4d9e-85d0-ffbfd31f03f8 tempest-TestImageHashVerification-2081030438 None] Acquiring lock "cinder-7c0527e9-9b56-4836-8781-e077e5abb490-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:23:09 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ac86d24f-1a76-4d9e-85d0-ffbfd31f03f8 tempest-TestImageHashVerification-2081030438 None] Lock "cinder-7c0527e9-9b56-4836-8781-e077e5abb490-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:23:09 devstack sudo[98352]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9f7d4f01-797d-4052-8012-1df2e3f4189a tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-50ce3000-bacf-4580-961f-93d16675eb3a" returned: 0 in 0.268s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-9f7d4f01-797d-4052-8012-1df2e3f4189a tempest-VolumesGetTest-1157460799 None] <== create_volume: return (746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:23:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9f7d4f01-797d-4052-8012-1df2e3f4189a tempest-VolumesGetTest-1157460799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.750s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1bb123c0-f55d-4adb-96c3-0fdfdec4c044 tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.208s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1bb123c0-f55d-4adb-96c3-0fdfdec4c044 tempest-GroupSnapshotsTest-1799889754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3c5fef1c-13c8-4ce7-b05e-dfd6f527a0a0,created_at=2026-09-03T09:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-479933259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c5fef1c-13c8-4ce7-b05e-dfd6f527a0a0,host='devstack@QuobyteHD#QuobyteHD',id=09cf4b08-017c-43f8-b4f0-647b6e94f0af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8caa1cbb957e461cbedbeeb17177dcd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:22:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:22:50Z,use_quota=True,user_id='34720c2ae5d34ba49f535dcddb1aa2f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(424f843f-2406-4191-8ae8-e7a5b9b08e92),volume_type_id=424f843f-2406-4191-8ae8-e7a5b9b08e92)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:23:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-1bb123c0-f55d-4adb-96c3-0fdfdec4c044 tempest-GroupSnapshotsTest-1799889754 None] Creating volume 09cf4b08-017c-43f8-b4f0-647b6e94f0af {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:23:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1bb123c0-f55d-4adb-96c3-0fdfdec4c044 tempest-GroupSnapshotsTest-1799889754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1bb123c0-f55d-4adb-96c3-0fdfdec4c044 tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1bb123c0-f55d-4adb-96c3-0fdfdec4c044 tempest-GroupSnapshotsTest-1799889754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:23:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1bb123c0-f55d-4adb-96c3-0fdfdec4c044 tempest-GroupSnapshotsTest-1799889754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:23:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1bb123c0-f55d-4adb-96c3-0fdfdec4c044 tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1bb123c0-f55d-4adb-96c3-0fdfdec4c044 tempest-GroupSnapshotsTest-1799889754 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:23:09 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-1bb123c0-f55d-4adb-96c3-0fdfdec4c044 tempest-GroupSnapshotsTest-1799889754 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:23:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1bb123c0-f55d-4adb-96c3-0fdfdec4c044 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9f7d4f01-797d-4052-8012-1df2e3f4189a tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f4dc6da-a19a-4fd9-baab-d97fa2ffd815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50ce3000-bacf-4580-961f-93d16675eb3a', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:10 devstack sudo[98355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af 1073741824 Sep 03 11:23:10 devstack sudo[98355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9f7d4f01-797d-4052-8012-1df2e3f4189a tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17d944ae-6d29-42de-8ed5-5ac05fdbcc7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ac86d24f-1a76-4d9e-85d0-ffbfd31f03f8 tempest-TestImageHashVerification-2081030438 None] Acquiring lock "cinder-quobyte-7c0527e9-9b56-4836-8781-e077e5abb490" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:23:10 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-9f7d4f01-797d-4052-8012-1df2e3f4189a tempest-VolumesGetTest-1157460799 None] Volume volume-50ce3000-bacf-4580-961f-93d16675eb3a (50ce3000-bacf-4580-961f-93d16675eb3a): created successfully Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9f7d4f01-797d-4052-8012-1df2e3f4189a tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17d944ae-6d29-42de-8ed5-5ac05fdbcc7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9f7d4f01-797d-4052-8012-1df2e3f4189a tempest-VolumesGetTest-1157460799 None] Flow 'volume_create_manager' (894b8541-93ad-4bd5-8307-9556c697e5e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ac86d24f-1a76-4d9e-85d0-ffbfd31f03f8 tempest-TestImageHashVerification-2081030438 None] Lock "cinder-quobyte-7c0527e9-9b56-4836-8781-e077e5abb490" acquired by "delete_volume" :: waited 0.029s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[e994a277-a589-4430-8130-6c41f09e2574]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ac86d24f-1a76-4d9e-85d0-ffbfd31f03f8 tempest-TestImageHashVerification-2081030438 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7c0527e9-9b56-4836-8781-e077e5abb490 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:10 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-9f7d4f01-797d-4052-8012-1df2e3f4189a tempest-VolumesGetTest-1157460799 None] Created volume successfully. Sep 03 11:23:10 devstack sudo[98357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7c0527e9-9b56-4836-8781-e077e5abb490 Sep 03 11:23:10 devstack sudo[98357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:10 devstack sudo[98355]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1bb123c0-f55d-4adb-96c3-0fdfdec4c044 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af 1073741824" returned: 0 in 0.432s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1bb123c0-f55d-4adb-96c3-0fdfdec4c044 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:10 devstack sudo[98357]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ac86d24f-1a76-4d9e-85d0-ffbfd31f03f8 tempest-TestImageHashVerification-2081030438 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7c0527e9-9b56-4836-8781-e077e5abb490" returned: 0 in 0.382s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ac86d24f-1a76-4d9e-85d0-ffbfd31f03f8 tempest-TestImageHashVerification-2081030438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7c0527e9-9b56-4836-8781-e077e5abb490 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:10 devstack sudo[98365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af Sep 03 11:23:10 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:10 devstack sudo[98366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7c0527e9-9b56-4836-8781-e077e5abb490 Sep 03 11:23:10 devstack sudo[98366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:10 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1bb123c0-f55d-4adb-96c3-0fdfdec4c044 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af" returned: 0 in 0.258s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1bb123c0-f55d-4adb-96c3-0fdfdec4c044 tempest-GroupSnapshotsTest-1799889754 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1bb123c0-f55d-4adb-96c3-0fdfdec4c044 tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:10 devstack sudo[98366]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-905393ae-13d2-4245-9c74-abf7477ff6d7 tempest-VolumesCloneTest-1898024090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.455s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-905393ae-13d2-4245-9c74-abf7477ff6d7 tempest-VolumesCloneTest-1898024090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-523774541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3924121-0c9e-4027-a7b5-b385ccd43b8c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26126ff7fbd2450186c7774e0b049745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:22:55Z,use_quota=True,user_id='d53fd0b3d6ac46be9175e60c41e30762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-905393ae-13d2-4245-9c74-abf7477ff6d7 tempest-VolumesCloneTest-1898024090 None] Creating volume f3924121-0c9e-4027-a7b5-b385ccd43b8c {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-905393ae-13d2-4245-9c74-abf7477ff6d7 tempest-VolumesCloneTest-1898024090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-905393ae-13d2-4245-9c74-abf7477ff6d7 tempest-VolumesCloneTest-1898024090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-905393ae-13d2-4245-9c74-abf7477ff6d7 tempest-VolumesCloneTest-1898024090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-905393ae-13d2-4245-9c74-abf7477ff6d7 tempest-VolumesCloneTest-1898024090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-905393ae-13d2-4245-9c74-abf7477ff6d7 tempest-VolumesCloneTest-1898024090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-905393ae-13d2-4245-9c74-abf7477ff6d7 tempest-VolumesCloneTest-1898024090 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:23:10 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-905393ae-13d2-4245-9c74-abf7477ff6d7 tempest-VolumesCloneTest-1898024090 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-905393ae-13d2-4245-9c74-abf7477ff6d7 tempest-VolumesCloneTest-1898024090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ac86d24f-1a76-4d9e-85d0-ffbfd31f03f8 tempest-TestImageHashVerification-2081030438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7c0527e9-9b56-4836-8781-e077e5abb490" returned: 0 in 0.278s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:10 devstack sudo[98371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c 1073741824 Sep 03 11:23:10 devstack sudo[98371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1bb123c0-f55d-4adb-96c3-0fdfdec4c044 tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (caf5a6f6-ec11-4058-b04b-98c775f631a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1bb123c0-f55d-4adb-96c3-0fdfdec4c044 tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d3d43d-1c3d-46ac-85be-990dc5838faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ac86d24f-1a76-4d9e-85d0-ffbfd31f03f8 tempest-TestImageHashVerification-2081030438 None] Lock "cinder-quobyte-7c0527e9-9b56-4836-8781-e077e5abb490" released by "delete_volume" :: held 0.717s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:23:10 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-1bb123c0-f55d-4adb-96c3-0fdfdec4c044 tempest-GroupSnapshotsTest-1799889754 None] Volume volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af (09cf4b08-017c-43f8-b4f0-647b6e94f0af): created successfully Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1bb123c0-f55d-4adb-96c3-0fdfdec4c044 tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03d3d43d-1c3d-46ac-85be-990dc5838faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1bb123c0-f55d-4adb-96c3-0fdfdec4c044 tempest-GroupSnapshotsTest-1799889754 None] Flow 'volume_create_manager' (9e762fb0-4bfc-403e-bf36-7e14a208937b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:23:10 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-1bb123c0-f55d-4adb-96c3-0fdfdec4c044 tempest-GroupSnapshotsTest-1799889754 None] Created volume successfully. Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-ac86d24f-1a76-4d9e-85d0-ffbfd31f03f8 tempest-TestImageHashVerification-2081030438 None] Created reservations ['3fd324ed-8aae-4e4b-a43d-3ed973b2788a', '9de9c738-86c9-429c-91a0-59e000fdce87', '1e24d9e6-ce41-41cc-9781-c26e12fcb576', '85390378-dff0-4f4e-b4d2-caf7d3bc238a'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ac86d24f-1a76-4d9e-85d0-ffbfd31f03f8 tempest-TestImageHashVerification-2081030438 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ac86d24f-1a76-4d9e-85d0-ffbfd31f03f8 tempest-TestImageHashVerification-2081030438 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ac86d24f-1a76-4d9e-85d0-ffbfd31f03f8 tempest-TestImageHashVerification-2081030438 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ac86d24f-1a76-4d9e-85d0-ffbfd31f03f8 tempest-TestImageHashVerification-2081030438 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ac86d24f-1a76-4d9e-85d0-ffbfd31f03f8 tempest-TestImageHashVerification-2081030438 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ac86d24f-1a76-4d9e-85d0-ffbfd31f03f8 tempest-TestImageHashVerification-2081030438 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:10 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:23:10 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:11 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ac86d24f-1a76-4d9e-85d0-ffbfd31f03f8 tempest-TestImageHashVerification-2081030438 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.288s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:11 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-ac86d24f-1a76-4d9e-85d0-ffbfd31f03f8 tempest-TestImageHashVerification-2081030438 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:23:11 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-ac86d24f-1a76-4d9e-85d0-ffbfd31f03f8 tempest-TestImageHashVerification-2081030438 None] Deleted volume successfully. Sep 03 11:23:11 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ac86d24f-1a76-4d9e-85d0-ffbfd31f03f8 tempest-TestImageHashVerification-2081030438 None] Lock "cinder-7c0527e9-9b56-4836-8781-e077e5abb490-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:23:11 devstack sudo[98371]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-905393ae-13d2-4245-9c74-abf7477ff6d7 tempest-VolumesCloneTest-1898024090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c 1073741824" returned: 0 in 0.568s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-905393ae-13d2-4245-9c74-abf7477ff6d7 tempest-VolumesCloneTest-1898024090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:11 devstack sudo[98380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c Sep 03 11:23:11 devstack sudo[98380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:11 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f3eb430-dd58-4ba2-83f8-803560b1c3e2 tempest-VolumesGetTest-1157460799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:23:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7f3eb430-dd58-4ba2-83f8-803560b1c3e2 tempest-VolumesGetTest-1157460799 None] Flow 'volume_create_manager' (f66a95a1-30fc-49b1-a755-ef44bf6ea9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:23:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7f3eb430-dd58-4ba2-83f8-803560b1c3e2 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61bbffb3-486b-4ae6-9c94-041df45efe58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7f3eb430-dd58-4ba2-83f8-803560b1c3e2 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61bbffb3-486b-4ae6-9c94-041df45efe58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:23:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1241732669',display_name='tempest-VolumesGetTest-Volume-832620909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d1217f9-dcf9-4df9-a43c-f27e6a9b0070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7fa995d29344de194fdbabe2f065b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:23:12Z,use_quota=True,user_id='d977b948c0fd4c27bff72a5c3e2d78d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7f3eb430-dd58-4ba2-83f8-803560b1c3e2 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b6becd2-3a23-4f2f-8bf7-666c5bd61bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:11 devstack sudo[98380]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7f3eb430-dd58-4ba2-83f8-803560b1c3e2 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b6becd2-3a23-4f2f-8bf7-666c5bd61bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7f3eb430-dd58-4ba2-83f8-803560b1c3e2 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36c4522e-c265-4b24-ac69-405cc722c44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7f3eb430-dd58-4ba2-83f8-803560b1c3e2 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36c4522e-c265-4b24-ac69-405cc722c44a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d1217f9-dcf9-4df9-a43c-f27e6a9b0070', 'volume_name': 'volume-6d1217f9-dcf9-4df9-a43c-f27e6a9b0070', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7f3eb430-dd58-4ba2-83f8-803560b1c3e2 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08278d12-cf80-46f6-9e4f-23534602262e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7f3eb430-dd58-4ba2-83f8-803560b1c3e2 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08278d12-cf80-46f6-9e4f-23534602262e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7f3eb430-dd58-4ba2-83f8-803560b1c3e2 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4ce3311-0a86-49e8-af04-fcf3664a1c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:11 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-7f3eb430-dd58-4ba2-83f8-803560b1c3e2 tempest-VolumesGetTest-1157460799 None] Volume 6d1217f9-dcf9-4df9-a43c-f27e6a9b0070: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d1217f9-dcf9-4df9-a43c-f27e6a9b0070', 'volume_size': 1} Sep 03 11:23:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7f3eb430-dd58-4ba2-83f8-803560b1c3e2 tempest-VolumesGetTest-1157460799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-905393ae-13d2-4245-9c74-abf7477ff6d7 tempest-VolumesCloneTest-1898024090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c" returned: 0 in 0.286s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-905393ae-13d2-4245-9c74-abf7477ff6d7 tempest-VolumesCloneTest-1898024090 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:23:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-905393ae-13d2-4245-9c74-abf7477ff6d7 tempest-VolumesCloneTest-1898024090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7f3eb430-dd58-4ba2-83f8-803560b1c3e2 tempest-VolumesGetTest-1157460799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7f3eb430-dd58-4ba2-83f8-803560b1c3e2 tempest-VolumesGetTest-1157460799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:23:11Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1241732669',display_name='tempest-VolumesGetTest-Volume-832620909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d1217f9-dcf9-4df9-a43c-f27e6a9b0070,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7fa995d29344de194fdbabe2f065b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:23:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:23:12Z,use_quota=True,user_id='d977b948c0fd4c27bff72a5c3e2d78d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:23:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-7f3eb430-dd58-4ba2-83f8-803560b1c3e2 tempest-VolumesGetTest-1157460799 None] Creating volume 6d1217f9-dcf9-4df9-a43c-f27e6a9b0070 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:23:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7f3eb430-dd58-4ba2-83f8-803560b1c3e2 tempest-VolumesGetTest-1157460799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7f3eb430-dd58-4ba2-83f8-803560b1c3e2 tempest-VolumesGetTest-1157460799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7f3eb430-dd58-4ba2-83f8-803560b1c3e2 tempest-VolumesGetTest-1157460799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:23:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7f3eb430-dd58-4ba2-83f8-803560b1c3e2 tempest-VolumesGetTest-1157460799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:23:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7f3eb430-dd58-4ba2-83f8-803560b1c3e2 tempest-VolumesGetTest-1157460799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7f3eb430-dd58-4ba2-83f8-803560b1c3e2 tempest-VolumesGetTest-1157460799 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:23:11 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-7f3eb430-dd58-4ba2-83f8-803560b1c3e2 tempest-VolumesGetTest-1157460799 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:23:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7f3eb430-dd58-4ba2-83f8-803560b1c3e2 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d1217f9-dcf9-4df9-a43c-f27e6a9b0070 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:11 devstack sudo[98383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d1217f9-dcf9-4df9-a43c-f27e6a9b0070 1073741824 Sep 03 11:23:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-905393ae-13d2-4245-9c74-abf7477ff6d7 tempest-VolumesCloneTest-1898024090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c49f2a4-3ea0-4ddf-a084-1a1995f696d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:11 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-905393ae-13d2-4245-9c74-abf7477ff6d7 tempest-VolumesCloneTest-1898024090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a445c42-478f-4023-984f-aefc09990311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:11 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-905393ae-13d2-4245-9c74-abf7477ff6d7 tempest-VolumesCloneTest-1898024090 None] Volume volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c (f3924121-0c9e-4027-a7b5-b385ccd43b8c): created successfully Sep 03 11:23:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-905393ae-13d2-4245-9c74-abf7477ff6d7 tempest-VolumesCloneTest-1898024090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a445c42-478f-4023-984f-aefc09990311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-905393ae-13d2-4245-9c74-abf7477ff6d7 tempest-VolumesCloneTest-1898024090 None] Flow 'volume_create_manager' (691abbcd-9927-4e3b-8d8c-1ae20b0593e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:23:11 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-905393ae-13d2-4245-9c74-abf7477ff6d7 tempest-VolumesCloneTest-1898024090 None] Created volume successfully. Sep 03 11:23:12 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7f3eb430-dd58-4ba2-83f8-803560b1c3e2 tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d1217f9-dcf9-4df9-a43c-f27e6a9b0070 1073741824" returned: 0 in 0.586s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7f3eb430-dd58-4ba2-83f8-803560b1c3e2 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d1217f9-dcf9-4df9-a43c-f27e6a9b0070 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:12 devstack sudo[98389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d1217f9-dcf9-4df9-a43c-f27e6a9b0070 Sep 03 11:23:12 devstack sudo[98389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:12 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-bde9b06f-5556-4645-8d15-57743a1598bc tempest-GroupSnapshotsTest-1799889754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:23:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bde9b06f-5556-4645-8d15-57743a1598bc tempest-GroupSnapshotsTest-1799889754 None] Flow 'volume_create_manager' (ab4acbcd-9872-4749-928a-073b8943f898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:23:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bde9b06f-5556-4645-8d15-57743a1598bc tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59985f5e-14ac-40af-9c95-48627560616d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bde9b06f-5556-4645-8d15-57743a1598bc tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59985f5e-14ac-40af-9c95-48627560616d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-706240164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c5fef1c-13c8-4ce7-b05e-dfd6f527a0a0,host='devstack@QuobyteHD#QuobyteHD',id=9c872177-e751-480a-a7a8-12b26af246d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8caa1cbb957e461cbedbeeb17177dcd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:23:12Z,use_quota=True,user_id='34720c2ae5d34ba49f535dcddb1aa2f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(424f843f-2406-4191-8ae8-e7a5b9b08e92),volume_type_id=424f843f-2406-4191-8ae8-e7a5b9b08e92)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bde9b06f-5556-4645-8d15-57743a1598bc tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69df3c82-e12c-42dd-bc76-481af53ab381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:12 devstack sudo[98389]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bde9b06f-5556-4645-8d15-57743a1598bc tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69df3c82-e12c-42dd-bc76-481af53ab381) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bde9b06f-5556-4645-8d15-57743a1598bc tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6b06ea-c59e-474b-9b15-b6a14fd3d4d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bde9b06f-5556-4645-8d15-57743a1598bc tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6b06ea-c59e-474b-9b15-b6a14fd3d4d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c872177-e751-480a-a7a8-12b26af246d4', 'volume_name': 'volume-9c872177-e751-480a-a7a8-12b26af246d4', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bde9b06f-5556-4645-8d15-57743a1598bc tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd38b527-1a89-4716-bb5c-8b5e664605e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bde9b06f-5556-4645-8d15-57743a1598bc tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd38b527-1a89-4716-bb5c-8b5e664605e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bde9b06f-5556-4645-8d15-57743a1598bc tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a537091-7c62-4818-8b95-e0a3d08dff6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:12 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-bde9b06f-5556-4645-8d15-57743a1598bc tempest-GroupSnapshotsTest-1799889754 None] Volume 9c872177-e751-480a-a7a8-12b26af246d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c872177-e751-480a-a7a8-12b26af246d4', 'volume_size': 1} Sep 03 11:23:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bde9b06f-5556-4645-8d15-57743a1598bc tempest-GroupSnapshotsTest-1799889754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7f3eb430-dd58-4ba2-83f8-803560b1c3e2 tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d1217f9-dcf9-4df9-a43c-f27e6a9b0070" returned: 0 in 0.358s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7f3eb430-dd58-4ba2-83f8-803560b1c3e2 tempest-VolumesGetTest-1157460799 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:23:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7f3eb430-dd58-4ba2-83f8-803560b1c3e2 tempest-VolumesGetTest-1157460799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bde9b06f-5556-4645-8d15-57743a1598bc tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-bde9b06f-5556-4645-8d15-57743a1598bc tempest-GroupSnapshotsTest-1799889754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3c5fef1c-13c8-4ce7-b05e-dfd6f527a0a0,created_at=2026-09-03T09:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-706240164',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3c5fef1c-13c8-4ce7-b05e-dfd6f527a0a0,host='devstack@QuobyteHD#QuobyteHD',id=9c872177-e751-480a-a7a8-12b26af246d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8caa1cbb957e461cbedbeeb17177dcd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:23:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:23:12Z,use_quota=True,user_id='34720c2ae5d34ba49f535dcddb1aa2f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(424f843f-2406-4191-8ae8-e7a5b9b08e92),volume_type_id=424f843f-2406-4191-8ae8-e7a5b9b08e92)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:23:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-bde9b06f-5556-4645-8d15-57743a1598bc tempest-GroupSnapshotsTest-1799889754 None] Creating volume 9c872177-e751-480a-a7a8-12b26af246d4 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:23:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bde9b06f-5556-4645-8d15-57743a1598bc tempest-GroupSnapshotsTest-1799889754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bde9b06f-5556-4645-8d15-57743a1598bc tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-bde9b06f-5556-4645-8d15-57743a1598bc tempest-GroupSnapshotsTest-1799889754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:23:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-bde9b06f-5556-4645-8d15-57743a1598bc tempest-GroupSnapshotsTest-1799889754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:23:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bde9b06f-5556-4645-8d15-57743a1598bc tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-bde9b06f-5556-4645-8d15-57743a1598bc tempest-GroupSnapshotsTest-1799889754 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:23:12 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-bde9b06f-5556-4645-8d15-57743a1598bc tempest-GroupSnapshotsTest-1799889754 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:23:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bde9b06f-5556-4645-8d15-57743a1598bc tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7f3eb430-dd58-4ba2-83f8-803560b1c3e2 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4ce3311-0a86-49e8-af04-fcf3664a1c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d1217f9-dcf9-4df9-a43c-f27e6a9b0070', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7f3eb430-dd58-4ba2-83f8-803560b1c3e2 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb29c18-2bed-4ed1-8b6a-bcec2851b46c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:12 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4 1073741824 Sep 03 11:23:12 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:12 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-7f3eb430-dd58-4ba2-83f8-803560b1c3e2 tempest-VolumesGetTest-1157460799 None] Volume volume-6d1217f9-dcf9-4df9-a43c-f27e6a9b0070 (6d1217f9-dcf9-4df9-a43c-f27e6a9b0070): created successfully Sep 03 11:23:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7f3eb430-dd58-4ba2-83f8-803560b1c3e2 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (beb29c18-2bed-4ed1-8b6a-bcec2851b46c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7f3eb430-dd58-4ba2-83f8-803560b1c3e2 tempest-VolumesGetTest-1157460799 None] Flow 'volume_create_manager' (f66a95a1-30fc-49b1-a755-ef44bf6ea9eb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:23:12 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-7f3eb430-dd58-4ba2-83f8-803560b1c3e2 tempest-VolumesGetTest-1157460799 None] Created volume successfully. Sep 03 11:23:12 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:23:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Flow 'volume_create_manager' (fd10da73-1ca3-4562-bacb-88604ce8d087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:23:13 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a2e699f-d868-4559-bb1d-ff4d90080db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:13 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a2e699f-d868-4559-bb1d-ff4d90080db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:23:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-609490246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b7f957-ec29-448e-9885-b22ca0f22aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26126ff7fbd2450186c7774e0b049745',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:23:13Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=f3924121-0c9e-4027-a7b5-b385ccd43b8c,status='creating',terminated_at=None,updated_at=2026-09-03T09:23:13Z,use_quota=True,user_id='d53fd0b3d6ac46be9175e60c41e30762',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:13 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f31da44e-e3e6-4356-afb5-9e912ab21748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:13 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f31da44e-e3e6-4356-afb5-9e912ab21748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:13 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e24c60f-256b-476f-9c8e-c50f7c40b71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:13 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e24c60f-256b-476f-9c8e-c50f7c40b71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '72b7f957-ec29-448e-9885-b22ca0f22aaf', 'volume_name': 'volume-72b7f957-ec29-448e-9885-b22ca0f22aaf', 'volume_size': 2, 'source_volid': 'f3924121-0c9e-4027-a7b5-b385ccd43b8c', 'source_volstatus': 'available'}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:13 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc84213d-7782-4a5e-abb9-f5b5768ef822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:13 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc84213d-7782-4a5e-abb9-f5b5768ef822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:13 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce9102d5-a1a1-4739-9cd0-a6bff89e53e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:13 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Volume 72b7f957-ec29-448e-9885-b22ca0f22aaf: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-72b7f957-ec29-448e-9885-b22ca0f22aaf', 'volume_size': 2, 'source_volid': 'f3924121-0c9e-4027-a7b5-b385ccd43b8c', 'source_volstatus': 'available'} Sep 03 11:23:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:13 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bde9b06f-5556-4645-8d15-57743a1598bc tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4 1073741824" returned: 0 in 0.529s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bde9b06f-5556-4645-8d15-57743a1598bc tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:13 devstack sudo[98399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4 Sep 03 11:23:13 devstack sudo[98399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:13 devstack sudo[98399]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bde9b06f-5556-4645-8d15-57743a1598bc tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4" returned: 0 in 0.250s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:13 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-bde9b06f-5556-4645-8d15-57743a1598bc tempest-GroupSnapshotsTest-1799889754 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:23:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bde9b06f-5556-4645-8d15-57743a1598bc tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.403s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:13 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Cloning volume f3924121-0c9e-4027-a7b5-b385ccd43b8c to volume 72b7f957-ec29-448e-9885-b22ca0f22aaf Sep 03 11:23:13 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bde9b06f-5556-4645-8d15-57743a1598bc tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a537091-7c62-4818-8b95-e0a3d08dff6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c872177-e751-480a-a7a8-12b26af246d4', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:13 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bde9b06f-5556-4645-8d15-57743a1598bc tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15eb866b-ec04-4653-b37e-79f5f0e2c777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:13 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-bde9b06f-5556-4645-8d15-57743a1598bc tempest-GroupSnapshotsTest-1799889754 None] Volume volume-9c872177-e751-480a-a7a8-12b26af246d4 (9c872177-e751-480a-a7a8-12b26af246d4): created successfully Sep 03 11:23:13 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bde9b06f-5556-4645-8d15-57743a1598bc tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15eb866b-ec04-4653-b37e-79f5f0e2c777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:13 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bde9b06f-5556-4645-8d15-57743a1598bc tempest-GroupSnapshotsTest-1799889754 None] Flow 'volume_create_manager' (ab4acbcd-9872-4749-928a-073b8943f898) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:23:13 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Creating offline snapshot 9e3a27da-3c29-4e7d-90e3-f4b9dce8e2cd of volume f3924121-0c9e-4027-a7b5-b385ccd43b8c {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:23:13 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-bde9b06f-5556-4645-8d15-57743a1598bc tempest-GroupSnapshotsTest-1799889754 None] Created volume successfully. Sep 03 11:23:13 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b4fce9-28b0-4694-ad74-e7335039fbc3]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:13 devstack sudo[98402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c Sep 03 11:23:13 devstack sudo[98402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:14 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-733c78ad-689f-47d2-b716-93f0da8bba0c tempest-GroupSnapshotsTest-1799889754 None] Update group completed successfully. Sep 03 11:23:14 devstack sudo[98402]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c" returned: 0 in 0.455s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c.9e3a27da-3c29-4e7d-90e3-f4b9dce8e2cd 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:14 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-cbceda55-7423-44f6-9710-e7e7bb7e0180 tempest-VolumesGetTest-1157460799 None] Acquiring lock "cinder-6d1217f9-dcf9-4df9-a43c-f27e6a9b0070-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:23:14 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-cbceda55-7423-44f6-9710-e7e7bb7e0180 tempest-VolumesGetTest-1157460799 None] Lock "cinder-6d1217f9-dcf9-4df9-a43c-f27e6a9b0070-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:23:14 devstack sudo[98407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c.9e3a27da-3c29-4e7d-90e3-f4b9dce8e2cd 1G Sep 03 11:23:14 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:14 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-cbceda55-7423-44f6-9710-e7e7bb7e0180 tempest-VolumesGetTest-1157460799 None] Acquiring lock "cinder-quobyte-6d1217f9-dcf9-4df9-a43c-f27e6a9b0070" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:23:14 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-cbceda55-7423-44f6-9710-e7e7bb7e0180 tempest-VolumesGetTest-1157460799 None] Lock "cinder-quobyte-6d1217f9-dcf9-4df9-a43c-f27e6a9b0070" acquired by "delete_volume" :: waited 0.046s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:23:14 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b774278-444f-4ad4-b9e0-b43701245d4f]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cbceda55-7423-44f6-9710-e7e7bb7e0180 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d1217f9-dcf9-4df9-a43c-f27e6a9b0070 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:14 devstack sudo[98409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d1217f9-dcf9-4df9-a43c-f27e6a9b0070 Sep 03 11:23:14 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:14 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c.9e3a27da-3c29-4e7d-90e3-f4b9dce8e2cd 1G" returned: 0 in 0.454s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c.9e3a27da-3c29-4e7d-90e3-f4b9dce8e2cd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:14 devstack sudo[98415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c.9e3a27da-3c29-4e7d-90e3-f4b9dce8e2cd Sep 03 11:23:14 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:14 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cbceda55-7423-44f6-9710-e7e7bb7e0180 tempest-VolumesGetTest-1157460799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d1217f9-dcf9-4df9-a43c-f27e6a9b0070" returned: 0 in 0.376s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cbceda55-7423-44f6-9710-e7e7bb7e0180 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d1217f9-dcf9-4df9-a43c-f27e6a9b0070 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:14 devstack sudo[98420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d1217f9-dcf9-4df9-a43c-f27e6a9b0070 Sep 03 11:23:14 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:14 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c.9e3a27da-3c29-4e7d-90e3-f4b9dce8e2cd" returned: 0 in 0.292s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:14 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c.9e3a27da-3c29-4e7d-90e3-f4b9dce8e2cd is being set with open permissions: ugo+rw Sep 03 11:23:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c.9e3a27da-3c29-4e7d-90e3-f4b9dce8e2cd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:14 devstack sudo[98425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c.9e3a27da-3c29-4e7d-90e3-f4b9dce8e2cd Sep 03 11:23:14 devstack sudo[98425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:14 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cbceda55-7423-44f6-9710-e7e7bb7e0180 tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d1217f9-dcf9-4df9-a43c-f27e6a9b0070" returned: 0 in 0.258s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:14 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-cbceda55-7423-44f6-9710-e7e7bb7e0180 tempest-VolumesGetTest-1157460799 None] Lock "cinder-quobyte-6d1217f9-dcf9-4df9-a43c-f27e6a9b0070" released by "delete_volume" :: held 0.685s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:23:14 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-cbceda55-7423-44f6-9710-e7e7bb7e0180 tempest-VolumesGetTest-1157460799 None] Created reservations ['86fc1c4b-a9c2-4b32-8a86-7ac9c6be299e', 'fce2ee65-372f-4827-91c6-10974661b17e', '31e8a696-fc7f-4d41-8f44-e3764cccdfb2', 'f83bf411-8409-41b6-877c-ea97698dba50'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:23:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-cbceda55-7423-44f6-9710-e7e7bb7e0180 tempest-VolumesGetTest-1157460799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-cbceda55-7423-44f6-9710-e7e7bb7e0180 tempest-VolumesGetTest-1157460799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:15 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-cbceda55-7423-44f6-9710-e7e7bb7e0180 tempest-VolumesGetTest-1157460799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:23:15 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-cbceda55-7423-44f6-9710-e7e7bb7e0180 tempest-VolumesGetTest-1157460799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:23:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-cbceda55-7423-44f6-9710-e7e7bb7e0180 tempest-VolumesGetTest-1157460799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cbceda55-7423-44f6-9710-e7e7bb7e0180 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:15 devstack sudo[98428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:23:15 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:15 devstack sudo[98425]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c.9e3a27da-3c29-4e7d-90e3-f4b9dce8e2cd" returned: 0 in 0.281s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:15 devstack sudo[98431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c.info Sep 03 11:23:15 devstack sudo[98431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:15 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-0ab86dce-f35a-4038-ad74-52ff467463ac tempest-GroupSnapshotsTest-1799889754 None] Update group completed successfully. Sep 03 11:23:15 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cbceda55-7423-44f6-9710-e7e7bb7e0180 tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.398s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:15 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-cbceda55-7423-44f6-9710-e7e7bb7e0180 tempest-VolumesGetTest-1157460799 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:23:15 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-cbceda55-7423-44f6-9710-e7e7bb7e0180 tempest-VolumesGetTest-1157460799 None] Deleted volume successfully. Sep 03 11:23:15 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-cbceda55-7423-44f6-9710-e7e7bb7e0180 tempest-VolumesGetTest-1157460799 None] Lock "cinder-6d1217f9-dcf9-4df9-a43c-f27e6a9b0070-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:23:15 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b524b498-14f3-45da-abe8-e30ea10e95b3 tempest-VolumesGetTest-1157460799 None] Acquiring lock "cinder-50ce3000-bacf-4580-961f-93d16675eb3a-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:23:15 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b524b498-14f3-45da-abe8-e30ea10e95b3 tempest-VolumesGetTest-1157460799 None] Lock "cinder-50ce3000-bacf-4580-961f-93d16675eb3a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:23:15 devstack sudo[98431]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c.info" returned: 0 in 0.369s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:15 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c.info is being set with open permissions: ugo+rw Sep 03 11:23:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:15 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b524b498-14f3-45da-abe8-e30ea10e95b3 tempest-VolumesGetTest-1157460799 None] Acquiring lock "cinder-quobyte-50ce3000-bacf-4580-961f-93d16675eb3a" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:23:15 devstack sudo[98435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c.info Sep 03 11:23:15 devstack sudo[98435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:15 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b524b498-14f3-45da-abe8-e30ea10e95b3 tempest-VolumesGetTest-1157460799 None] Lock "cinder-quobyte-50ce3000-bacf-4580-961f-93d16675eb3a" acquired by "delete_volume" :: waited 0.018s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:23:15 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9caf890-6254-4fa0-a38e-9ffb2ca8b3a6]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b524b498-14f3-45da-abe8-e30ea10e95b3 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-50ce3000-bacf-4580-961f-93d16675eb3a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:15 devstack sudo[98439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-50ce3000-bacf-4580-961f-93d16675eb3a Sep 03 11:23:15 devstack sudo[98439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:15 devstack sudo[98435]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c.info" returned: 0 in 0.315s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:15 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Acquiring lock "cinder-quobyte-72b7f957-ec29-448e-9885-b22ca0f22aaf" by "_copy_volume_from_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:23:15 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Lock "cinder-quobyte-72b7f957-ec29-448e-9885-b22ca0f22aaf" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:23:15 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] snapshot: 9e3a27da-3c29-4e7d-90e3-f4b9dce8e2cd, volume: 72b7f957-ec29-448e-9885-b22ca0f22aaf, {{(pid=87038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 11:23:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:15 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:23:15 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:23:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:15 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fee11c1-9318-41d8-a9a6-b920263ad7d7]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c.9e3a27da-3c29-4e7d-90e3-f4b9dce8e2cd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:16 devstack sudo[98439]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b524b498-14f3-45da-abe8-e30ea10e95b3 tempest-VolumesGetTest-1157460799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-50ce3000-bacf-4580-961f-93d16675eb3a" returned: 0 in 0.469s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b524b498-14f3-45da-abe8-e30ea10e95b3 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-50ce3000-bacf-4580-961f-93d16675eb3a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:16 devstack sudo[98480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-50ce3000-bacf-4580-961f-93d16675eb3a Sep 03 11:23:16 devstack sudo[98480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:16 devstack sudo[98474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c.9e3a27da-3c29-4e7d-90e3-f4b9dce8e2cd Sep 03 11:23:16 devstack sudo[98474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:16 devstack sudo[98480]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b524b498-14f3-45da-abe8-e30ea10e95b3 tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-50ce3000-bacf-4580-961f-93d16675eb3a" returned: 0 in 0.384s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:16 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b524b498-14f3-45da-abe8-e30ea10e95b3 tempest-VolumesGetTest-1157460799 None] Lock "cinder-quobyte-50ce3000-bacf-4580-961f-93d16675eb3a" released by "delete_volume" :: held 0.900s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:23:16 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-fceba2f9-8145-45ed-bca3-f25f747c1bf1 tempest-GroupSnapshotsTest-1799889754 None] Update group completed successfully. Sep 03 11:23:16 devstack sudo[98474]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c.9e3a27da-3c29-4e7d-90e3-f4b9dce8e2cd" returned: 0 in 0.564s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:16 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:23:16 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[659e7edd-ea1f-4291-9369-cc1859bf6abf]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:16 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-b524b498-14f3-45da-abe8-e30ea10e95b3 tempest-VolumesGetTest-1157460799 None] Created reservations ['9acb4894-795e-4404-9eb1-9348cb105305', 'ca357467-b323-4b8f-84f1-6e82d716e1ce', 'd877ce02-17fe-4367-afb4-632398493874', '8d759de7-9d30-41f5-886e-0ba123cff7b0'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:23:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b524b498-14f3-45da-abe8-e30ea10e95b3 tempest-VolumesGetTest-1157460799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b524b498-14f3-45da-abe8-e30ea10e95b3 tempest-VolumesGetTest-1157460799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:16 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-b524b498-14f3-45da-abe8-e30ea10e95b3 tempest-VolumesGetTest-1157460799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:23:16 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-b524b498-14f3-45da-abe8-e30ea10e95b3 tempest-VolumesGetTest-1157460799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:23:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b524b498-14f3-45da-abe8-e30ea10e95b3 tempest-VolumesGetTest-1157460799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b524b498-14f3-45da-abe8-e30ea10e95b3 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:16 devstack sudo[98490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:23:16 devstack sudo[98490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:16 devstack sudo[98489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c Sep 03 11:23:16 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:16 devstack sudo[98490]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b524b498-14f3-45da-abe8-e30ea10e95b3 tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.320s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:16 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-b524b498-14f3-45da-abe8-e30ea10e95b3 tempest-VolumesGetTest-1157460799 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:23:16 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-b524b498-14f3-45da-abe8-e30ea10e95b3 tempest-VolumesGetTest-1157460799 None] Deleted volume successfully. Sep 03 11:23:16 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c" returned: 0 in 0.448s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:16 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c {{(pid=87038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 11:23:16 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Creating direct copy from snapshot {{(pid=87038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 11:23:17 devstack cinder-volume[87038]: DEBUG cinder.utils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Path /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-72b7f957-ec29-448e-9885-b22ca0f22aaf not found in is_blk_device check {{(pid=87038) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 11:23:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-72b7f957-ec29-448e-9885-b22ca0f22aaf {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:17 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b524b498-14f3-45da-abe8-e30ea10e95b3 tempest-VolumesGetTest-1157460799 None] Lock "cinder-50ce3000-bacf-4580-961f-93d16675eb3a-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:23:17 devstack sudo[98498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-72b7f957-ec29-448e-9885-b22ca0f22aaf Sep 03 11:23:17 devstack sudo[98498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:17 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-9940d357-0aaa-46fb-8cfb-779784ac594a tempest-VolumesGetTest-1157460799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:23:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9940d357-0aaa-46fb-8cfb-779784ac594a tempest-VolumesGetTest-1157460799 None] Flow 'volume_create_manager' (62b3fb25-40e6-4903-87a4-6d138c3115a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:23:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9940d357-0aaa-46fb-8cfb-779784ac594a tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7ce708d-9ed5-42a5-b284-f2af7f365418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9940d357-0aaa-46fb-8cfb-779784ac594a tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7ce708d-9ed5-42a5-b284-f2af7f365418) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1045784634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73190cd8-b9df-4468-bce6-0f945a65a80e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7fa995d29344de194fdbabe2f065b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:23:17Z,use_quota=True,user_id='d977b948c0fd4c27bff72a5c3e2d78d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9940d357-0aaa-46fb-8cfb-779784ac594a tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3fa8494-bb56-437a-93f8-d3cbee47f29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9940d357-0aaa-46fb-8cfb-779784ac594a tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3fa8494-bb56-437a-93f8-d3cbee47f29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9940d357-0aaa-46fb-8cfb-779784ac594a tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f72c323-9f27-4f7a-b5f2-d3b1e1baf9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9940d357-0aaa-46fb-8cfb-779784ac594a tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f72c323-9f27-4f7a-b5f2-d3b1e1baf9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73190cd8-b9df-4468-bce6-0f945a65a80e', 'volume_name': 'volume-73190cd8-b9df-4468-bce6-0f945a65a80e', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9940d357-0aaa-46fb-8cfb-779784ac594a tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c57ee2a-2573-470e-b34f-b679615d2a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9940d357-0aaa-46fb-8cfb-779784ac594a tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c57ee2a-2573-470e-b34f-b679615d2a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9940d357-0aaa-46fb-8cfb-779784ac594a tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bf5b885-8be8-4f74-bf1a-bfcb21685fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:17 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-9940d357-0aaa-46fb-8cfb-779784ac594a tempest-VolumesGetTest-1157460799 None] Volume 73190cd8-b9df-4468-bce6-0f945a65a80e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73190cd8-b9df-4468-bce6-0f945a65a80e', 'volume_size': 1} Sep 03 11:23:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9940d357-0aaa-46fb-8cfb-779784ac594a tempest-VolumesGetTest-1157460799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:17 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-fddc51e6-2a4e-45cb-b9fb-36fbe681df29 tempest-GroupSnapshotsTest-1799889754 None] Update group completed successfully. Sep 03 11:23:17 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:23:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:23:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:23:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:18 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:23:18 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:18 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.607s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:18 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:23:18 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:23:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread count: 28 {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:23:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread info: [<_MainThread(MainThread, started 139554943000704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:23:20 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] GroupSnapshot 991b26d3-c2be-44a9-af31-9b5962baa0f7: creating. Sep 03 11:23:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] Group snapshot 991b26d3-c2be-44a9-af31-9b5962baa0f7: creating. {{(pid=87038) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 03 11:23:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-72b7f957-ec29-448e-9885-b22ca0f22aaf" returned: 0 in 5.346s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:22 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Image conversion details: src /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c, size 1024.00 MB, duration 5.35 sec, destination /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-72b7f957-ec29-448e-9885-b22ca0f22aaf {{(pid=87038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:23:22 devstack cinder-volume[87038]: INFO cinder.image.image_utils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Converted 1024.00 MB image at 191.52 MB/s Sep 03 11:23:22 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-72b7f957-ec29-448e-9885-b22ca0f22aaf is being set with open permissions: ugo+rw Sep 03 11:23:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-72b7f957-ec29-448e-9885-b22ca0f22aaf {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:22 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-72b7f957-ec29-448e-9885-b22ca0f22aaf Sep 03 11:23:22 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:22 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-72b7f957-ec29-448e-9885-b22ca0f22aaf" returned: 0 in 0.260s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:22 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Lock "cinder-quobyte-72b7f957-ec29-448e-9885-b22ca0f22aaf" released by "_copy_volume_from_snapshot" :: held 6.707s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:23:22 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Acquiring lock "cinder-quobyte-9e3a27da-3c29-4e7d-90e3-f4b9dce8e2cd" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:23:22 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Lock "cinder-quobyte-9e3a27da-3c29-4e7d-90e3-f4b9dce8e2cd" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:23:22 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Deleting offline snapshot 9e3a27da-3c29-4e7d-90e3-f4b9dce8e2cd of volume f3924121-0c9e-4027-a7b5-b385ccd43b8c {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:23:22 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] snapshot_file for this snap is: volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c.9e3a27da-3c29-4e7d-90e3-f4b9dce8e2cd {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:23:22 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5cd5780-5f80-44dd-a703-1d3c96d20f39]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c.9e3a27da-3c29-4e7d-90e3-f4b9dce8e2cd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:22 devstack sudo[98519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c.9e3a27da-3c29-4e7d-90e3-f4b9dce8e2cd Sep 03 11:23:22 devstack sudo[98519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:23 devstack sudo[98519]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c.9e3a27da-3c29-4e7d-90e3-f4b9dce8e2cd" returned: 0 in 0.389s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:23 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:23:23 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce34e3e0-fd31-4001-ab58-fca43657ee48]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:23 devstack sudo[98525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c Sep 03 11:23:23 devstack sudo[98525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:23 devstack sudo[98525]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c" returned: 0 in 0.540s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c.9e3a27da-3c29-4e7d-90e3-f4b9dce8e2cd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:23 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c.9e3a27da-3c29-4e7d-90e3-f4b9dce8e2cd Sep 03 11:23:23 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:24 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c.9e3a27da-3c29-4e7d-90e3-f4b9dce8e2cd" returned: 0 in 0.376s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c.9e3a27da-3c29-4e7d-90e3-f4b9dce8e2cd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:24 devstack sudo[98535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c.9e3a27da-3c29-4e7d-90e3-f4b9dce8e2cd Sep 03 11:23:24 devstack sudo[98535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:24 devstack sudo[98535]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c.9e3a27da-3c29-4e7d-90e3-f4b9dce8e2cd" returned: 0 in 0.251s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:24 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Lock "cinder-quobyte-9e3a27da-3c29-4e7d-90e3-f4b9dce8e2cd" released by "_delete_snapshot" :: held 1.667s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:23:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.842s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9940d357-0aaa-46fb-8cfb-779784ac594a tempest-VolumesGetTest-1157460799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.050s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-9940d357-0aaa-46fb-8cfb-779784ac594a tempest-VolumesGetTest-1157460799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:23:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1045784634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73190cd8-b9df-4468-bce6-0f945a65a80e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7fa995d29344de194fdbabe2f065b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:23:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:23:17Z,use_quota=True,user_id='d977b948c0fd4c27bff72a5c3e2d78d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:23:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-9940d357-0aaa-46fb-8cfb-779784ac594a tempest-VolumesGetTest-1157460799 None] Creating volume 73190cd8-b9df-4468-bce6-0f945a65a80e {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:23:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9940d357-0aaa-46fb-8cfb-779784ac594a tempest-VolumesGetTest-1157460799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9940d357-0aaa-46fb-8cfb-779784ac594a tempest-VolumesGetTest-1157460799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-9940d357-0aaa-46fb-8cfb-779784ac594a tempest-VolumesGetTest-1157460799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:23:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-9940d357-0aaa-46fb-8cfb-779784ac594a tempest-VolumesGetTest-1157460799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:23:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9940d357-0aaa-46fb-8cfb-779784ac594a tempest-VolumesGetTest-1157460799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-9940d357-0aaa-46fb-8cfb-779784ac594a tempest-VolumesGetTest-1157460799 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:23:24 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-9940d357-0aaa-46fb-8cfb-779784ac594a tempest-VolumesGetTest-1157460799 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:23:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9940d357-0aaa-46fb-8cfb-779784ac594a tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:24 devstack sudo[98538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e 1073741824 Sep 03 11:23:24 devstack sudo[98538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce9102d5-a1a1-4739-9cd0-a6bff89e53e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72b7f957-ec29-448e-9885-b22ca0f22aaf', 'volume_size': 2, 'source_volid': 'f3924121-0c9e-4027-a7b5-b385ccd43b8c', 'source_volstatus': 'available'}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (697ab14c-a7a1-48c2-97ee-80aeb67e8561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:24 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Volume volume-72b7f957-ec29-448e-9885-b22ca0f22aaf (72b7f957-ec29-448e-9885-b22ca0f22aaf): created successfully Sep 03 11:23:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (697ab14c-a7a1-48c2-97ee-80aeb67e8561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Flow 'volume_create_manager' (fd10da73-1ca3-4562-bacb-88604ce8d087) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:23:24 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-49cd026e-e484-4558-a0a8-3bdf5dedb1dd tempest-VolumesCloneTest-1898024090 None] Created volume successfully. Sep 03 11:23:24 devstack sudo[98538]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9940d357-0aaa-46fb-8cfb-779784ac594a tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e 1073741824" returned: 0 in 0.440s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9940d357-0aaa-46fb-8cfb-779784ac594a tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:24 devstack sudo[98544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e Sep 03 11:23:24 devstack sudo[98544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:25 devstack sudo[98544]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9940d357-0aaa-46fb-8cfb-779784ac594a tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e" returned: 0 in 0.261s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:25 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-9940d357-0aaa-46fb-8cfb-779784ac594a tempest-VolumesGetTest-1157460799 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:23:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9940d357-0aaa-46fb-8cfb-779784ac594a tempest-VolumesGetTest-1157460799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.899s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9940d357-0aaa-46fb-8cfb-779784ac594a tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bf5b885-8be8-4f74-bf1a-bfcb21685fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73190cd8-b9df-4468-bce6-0f945a65a80e', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9940d357-0aaa-46fb-8cfb-779784ac594a tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73d6bc9e-fdf5-4b15-89fc-6c17f3245b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:25 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-9940d357-0aaa-46fb-8cfb-779784ac594a tempest-VolumesGetTest-1157460799 None] Volume volume-73190cd8-b9df-4468-bce6-0f945a65a80e (73190cd8-b9df-4468-bce6-0f945a65a80e): created successfully Sep 03 11:23:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9940d357-0aaa-46fb-8cfb-779784ac594a tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73d6bc9e-fdf5-4b15-89fc-6c17f3245b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9940d357-0aaa-46fb-8cfb-779784ac594a tempest-VolumesGetTest-1157460799 None] Flow 'volume_create_manager' (62b3fb25-40e6-4903-87a4-6d138c3115a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:23:25 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] Creating offline snapshot 4b89de97-6b83-4702-95c9-20d0020ab458 of volume 9c872177-e751-480a-a7a8-12b26af246d4 {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:23:25 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-9940d357-0aaa-46fb-8cfb-779784ac594a tempest-VolumesGetTest-1157460799 None] Created volume successfully. Sep 03 11:23:25 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[21133d1c-7dfd-4c5e-bab8-733d0565ac73]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:25 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-61ed17b4-4f9d-4f57-95e6-7c3aacca3b45 tempest-VolumesCloneTest-1898024090 None] Acquiring lock "cinder-72b7f957-ec29-448e-9885-b22ca0f22aaf-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:23:25 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-61ed17b4-4f9d-4f57-95e6-7c3aacca3b45 tempest-VolumesCloneTest-1898024090 None] Lock "cinder-72b7f957-ec29-448e-9885-b22ca0f22aaf-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:23:25 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-61ed17b4-4f9d-4f57-95e6-7c3aacca3b45 tempest-VolumesCloneTest-1898024090 None] Acquiring lock "cinder-quobyte-72b7f957-ec29-448e-9885-b22ca0f22aaf" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:23:25 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-61ed17b4-4f9d-4f57-95e6-7c3aacca3b45 tempest-VolumesCloneTest-1898024090 None] Lock "cinder-quobyte-72b7f957-ec29-448e-9885-b22ca0f22aaf" acquired by "delete_volume" :: waited 0.019s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:23:25 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8fa7856-96ec-4af8-8a6d-07b1db764826]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-61ed17b4-4f9d-4f57-95e6-7c3aacca3b45 tempest-VolumesCloneTest-1898024090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-72b7f957-ec29-448e-9885-b22ca0f22aaf {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:25 devstack sudo[98547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4 Sep 03 11:23:25 devstack sudo[98547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:25 devstack sudo[98548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-72b7f957-ec29-448e-9885-b22ca0f22aaf Sep 03 11:23:25 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:25 devstack sudo[98547]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4" returned: 0 in 0.445s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4.4b89de97-6b83-4702-95c9-20d0020ab458 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:25 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4.4b89de97-6b83-4702-95c9-20d0020ab458 1G Sep 03 11:23:25 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:25 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-61ed17b4-4f9d-4f57-95e6-7c3aacca3b45 tempest-VolumesCloneTest-1898024090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-72b7f957-ec29-448e-9885-b22ca0f22aaf" returned: 0 in 0.417s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-61ed17b4-4f9d-4f57-95e6-7c3aacca3b45 tempest-VolumesCloneTest-1898024090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-72b7f957-ec29-448e-9885-b22ca0f22aaf {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:25 devstack sudo[98559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-72b7f957-ec29-448e-9885-b22ca0f22aaf Sep 03 11:23:25 devstack sudo[98559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:26 devstack sudo[98559]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-61ed17b4-4f9d-4f57-95e6-7c3aacca3b45 tempest-VolumesCloneTest-1898024090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-72b7f957-ec29-448e-9885-b22ca0f22aaf" returned: 0 in 0.312s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:26 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4.4b89de97-6b83-4702-95c9-20d0020ab458 1G" returned: 0 in 0.454s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c872177-e751-480a-a7a8-12b26af246d4 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4.4b89de97-6b83-4702-95c9-20d0020ab458 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:26 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-61ed17b4-4f9d-4f57-95e6-7c3aacca3b45 tempest-VolumesCloneTest-1898024090 None] Lock "cinder-quobyte-72b7f957-ec29-448e-9885-b22ca0f22aaf" released by "delete_volume" :: held 0.804s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:23:26 devstack sudo[98565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c872177-e751-480a-a7a8-12b26af246d4 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4.4b89de97-6b83-4702-95c9-20d0020ab458 Sep 03 11:23:26 devstack sudo[98565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:26 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-61ed17b4-4f9d-4f57-95e6-7c3aacca3b45 tempest-VolumesCloneTest-1898024090 None] Created reservations ['028cf3a2-469e-4145-adb6-ef31f6a04cfc', 'aa5c72ef-fae5-4478-a520-287e46b579a2', '4876af5a-f608-4514-aed5-180b31c7fe0a', '4bca1423-e1d9-4a1d-b339-5ea415e2f9c4'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:23:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-61ed17b4-4f9d-4f57-95e6-7c3aacca3b45 tempest-VolumesCloneTest-1898024090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-61ed17b4-4f9d-4f57-95e6-7c3aacca3b45 tempest-VolumesCloneTest-1898024090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:26 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-61ed17b4-4f9d-4f57-95e6-7c3aacca3b45 tempest-VolumesCloneTest-1898024090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:23:26 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-61ed17b4-4f9d-4f57-95e6-7c3aacca3b45 tempest-VolumesCloneTest-1898024090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:23:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-61ed17b4-4f9d-4f57-95e6-7c3aacca3b45 tempest-VolumesCloneTest-1898024090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-61ed17b4-4f9d-4f57-95e6-7c3aacca3b45 tempest-VolumesCloneTest-1898024090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:26 devstack sudo[98567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:23:26 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:26 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a95d921d-b4be-4a58-b0e7-2e6fefa24157 tempest-VolumesCloneTest-1898024090 None] Acquiring lock "cinder-f3924121-0c9e-4027-a7b5-b385ccd43b8c-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:23:26 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a95d921d-b4be-4a58-b0e7-2e6fefa24157 tempest-VolumesCloneTest-1898024090 None] Lock "cinder-f3924121-0c9e-4027-a7b5-b385ccd43b8c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:23:26 devstack sudo[98565]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c872177-e751-480a-a7a8-12b26af246d4 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4.4b89de97-6b83-4702-95c9-20d0020ab458" returned: 0 in 0.502s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:26 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4.4b89de97-6b83-4702-95c9-20d0020ab458 is being set with open permissions: ugo+rw: NotImplementedError Sep 03 11:23:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4.4b89de97-6b83-4702-95c9-20d0020ab458 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:26 devstack sudo[98573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4.4b89de97-6b83-4702-95c9-20d0020ab458 Sep 03 11:23:26 devstack sudo[98573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:26 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-61ed17b4-4f9d-4f57-95e6-7c3aacca3b45 tempest-VolumesCloneTest-1898024090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.372s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:26 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-61ed17b4-4f9d-4f57-95e6-7c3aacca3b45 tempest-VolumesCloneTest-1898024090 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:23:26 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a95d921d-b4be-4a58-b0e7-2e6fefa24157 tempest-VolumesCloneTest-1898024090 None] Acquiring lock "cinder-quobyte-f3924121-0c9e-4027-a7b5-b385ccd43b8c" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:23:26 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-61ed17b4-4f9d-4f57-95e6-7c3aacca3b45 tempest-VolumesCloneTest-1898024090 None] Deleted volume successfully. Sep 03 11:23:26 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a95d921d-b4be-4a58-b0e7-2e6fefa24157 tempest-VolumesCloneTest-1898024090 None] Lock "cinder-quobyte-f3924121-0c9e-4027-a7b5-b385ccd43b8c" acquired by "delete_volume" :: waited 0.029s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:23:26 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-61ed17b4-4f9d-4f57-95e6-7c3aacca3b45 tempest-VolumesCloneTest-1898024090 None] Lock "cinder-72b7f957-ec29-448e-9885-b22ca0f22aaf-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:23:26 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3f55d91-022a-48a9-919f-7525817049b5]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a95d921d-b4be-4a58-b0e7-2e6fefa24157 tempest-VolumesCloneTest-1898024090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:26 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:23:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Flow 'volume_create_manager' (5de413d7-5c1e-473f-970f-b2917ba2f5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:23:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f57891e-1f2f-4b79-9463-d199f77bef17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:26 devstack sudo[98573]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4.4b89de97-6b83-4702-95c9-20d0020ab458" returned: 0 in 0.291s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f57891e-1f2f-4b79-9463-d199f77bef17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:23:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-117248637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18bd3219-b2d9-42f6-a9a9-9039d884316d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d7fa995d29344de194fdbabe2f065b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:23:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=73190cd8-b9df-4468-bce6-0f945a65a80e,status='creating',terminated_at=None,updated_at=2026-09-03T09:23:27Z,use_quota=True,user_id='d977b948c0fd4c27bff72a5c3e2d78d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48f0bedd-c5d4-4433-a4de-962f1490f34b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:26 devstack sudo[98575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c Sep 03 11:23:26 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48f0bedd-c5d4-4433-a4de-962f1490f34b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d00ac055-e7fe-44ae-bd9b-3871ece96411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d00ac055-e7fe-44ae-bd9b-3871ece96411) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '18bd3219-b2d9-42f6-a9a9-9039d884316d', 'volume_name': 'volume-18bd3219-b2d9-42f6-a9a9-9039d884316d', 'volume_size': 1, 'source_volid': '73190cd8-b9df-4468-bce6-0f945a65a80e', 'source_volstatus': 'available'}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca1ca76c-8c00-4a4b-b05f-cb37fcf3f00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca1ca76c-8c00-4a4b-b05f-cb37fcf3f00e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ba433a6-9b0a-4d27-a444-2240e5b880e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:26 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Volume 18bd3219-b2d9-42f6-a9a9-9039d884316d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-18bd3219-b2d9-42f6-a9a9-9039d884316d', 'volume_size': 1, 'source_volid': '73190cd8-b9df-4468-bce6-0f945a65a80e', 'source_volstatus': 'available'} Sep 03 11:23:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:27 devstack sudo[98578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4.info Sep 03 11:23:27 devstack sudo[98578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:27 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a95d921d-b4be-4a58-b0e7-2e6fefa24157 tempest-VolumesCloneTest-1898024090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c" returned: 0 in 0.397s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a95d921d-b4be-4a58-b0e7-2e6fefa24157 tempest-VolumesCloneTest-1898024090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:27 devstack sudo[98584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c Sep 03 11:23:27 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:27 devstack sudo[98578]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4.info" returned: 0 in 0.285s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:27 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4.info is being set with open permissions: ugo+rw: NotImplementedError Sep 03 11:23:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:27 devstack sudo[98587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4.info Sep 03 11:23:27 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:27 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a95d921d-b4be-4a58-b0e7-2e6fefa24157 tempest-VolumesCloneTest-1898024090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3924121-0c9e-4027-a7b5-b385ccd43b8c" returned: 0 in 0.293s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:27 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a95d921d-b4be-4a58-b0e7-2e6fefa24157 tempest-VolumesCloneTest-1898024090 None] Lock "cinder-quobyte-f3924121-0c9e-4027-a7b5-b385ccd43b8c" released by "delete_volume" :: held 0.779s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:23:27 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-a95d921d-b4be-4a58-b0e7-2e6fefa24157 tempest-VolumesCloneTest-1898024090 None] Created reservations ['6f4df727-36aa-4bf8-b311-6b5881f5058d', 'c0dce0bb-79ed-42bb-b48b-da47521d2f1e', '64156db3-55bc-4a26-8312-7f1c23bcb4f0', 'ae216219-6bf7-43e9-8b5f-7a5e2b2d4744'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:23:27 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4.info" returned: 0 in 0.286s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.456s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] Creating offline snapshot c1942eeb-de4e-4746-8513-30158be2bddd of volume 09cf4b08-017c-43f8-b4f0-647b6e94f0af {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:23:27 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[f11e8131-23df-411b-97bd-138881743c80]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a95d921d-b4be-4a58-b0e7-2e6fefa24157 tempest-VolumesCloneTest-1898024090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a95d921d-b4be-4a58-b0e7-2e6fefa24157 tempest-VolumesCloneTest-1898024090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a95d921d-b4be-4a58-b0e7-2e6fefa24157 tempest-VolumesCloneTest-1898024090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:23:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a95d921d-b4be-4a58-b0e7-2e6fefa24157 tempest-VolumesCloneTest-1898024090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:23:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a95d921d-b4be-4a58-b0e7-2e6fefa24157 tempest-VolumesCloneTest-1898024090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a95d921d-b4be-4a58-b0e7-2e6fefa24157 tempest-VolumesCloneTest-1898024090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:27 devstack sudo[98592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:23:27 devstack sudo[98592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:27 devstack sudo[98591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af Sep 03 11:23:27 devstack sudo[98591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:27 devstack sudo[98592]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a95d921d-b4be-4a58-b0e7-2e6fefa24157 tempest-VolumesCloneTest-1898024090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.287s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:27 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-a95d921d-b4be-4a58-b0e7-2e6fefa24157 tempest-VolumesCloneTest-1898024090 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:23:27 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-a95d921d-b4be-4a58-b0e7-2e6fefa24157 tempest-VolumesCloneTest-1898024090 None] Deleted volume successfully. Sep 03 11:23:28 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a95d921d-b4be-4a58-b0e7-2e6fefa24157 tempest-VolumesCloneTest-1898024090 None] Lock "cinder-f3924121-0c9e-4027-a7b5-b385ccd43b8c-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:23:28 devstack sudo[98591]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af" returned: 0 in 0.429s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af.c1942eeb-de4e-4746-8513-30158be2bddd 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:28 devstack sudo[98600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af.c1942eeb-de4e-4746-8513-30158be2bddd 1G Sep 03 11:23:28 devstack sudo[98600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:28 devstack sudo[98600]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af.c1942eeb-de4e-4746-8513-30158be2bddd 1G" returned: 0 in 0.452s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af.c1942eeb-de4e-4746-8513-30158be2bddd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:28 devstack sudo[98606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af.c1942eeb-de4e-4746-8513-30158be2bddd Sep 03 11:23:28 devstack sudo[98606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:28 devstack sudo[98606]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af.c1942eeb-de4e-4746-8513-30158be2bddd" returned: 0 in 0.370s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:28 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af.c1942eeb-de4e-4746-8513-30158be2bddd is being set with open permissions: ugo+rw: NotImplementedError Sep 03 11:23:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af.c1942eeb-de4e-4746-8513-30158be2bddd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:28 devstack sudo[98612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af.c1942eeb-de4e-4746-8513-30158be2bddd Sep 03 11:23:28 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:29 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af.c1942eeb-de4e-4746-8513-30158be2bddd" returned: 0 in 0.320s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:29 devstack sudo[98615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af.info Sep 03 11:23:29 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:29 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:23:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Flow 'volume_create_manager' (9a7efd18-d623-44f9-a137-20d2ccd12d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:23:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e340e7f-bf08-490e-b9e0-a9164e6c5320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e340e7f-bf08-490e-b9e0-a9164e6c5320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16ec70b0-457a-4dfe-bab9-a3c37320e667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a74e5a4a1b7447d5b35cfb1b7985ecdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:23:29Z,use_quota=True,user_id='ef2aca0b3d87454093d93136e8929ec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (637ad426-492e-4500-9698-993bbf7e7b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (637ad426-492e-4500-9698-993bbf7e7b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a2031a3-ee1e-43d0-a1a6-1a902400d030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:29 devstack cinder-volume[87038]: DEBUG cinder.image.glance [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Creating Keystone auth plugin from conf {{(pid=87038) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 11:23:29 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af.info" returned: 0 in 0.279s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:29 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af.info is being set with open permissions: ugo+rw: NotImplementedError Sep 03 11:23:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:29 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af.info Sep 03 11:23:29 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:29 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af.info" returned: 0 in 0.263s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.224s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 2.812s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:29 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Cloning volume 73190cd8-b9df-4468-bce6-0f945a65a80e to volume 18bd3219-b2d9-42f6-a9a9-9039d884316d Sep 03 11:23:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a2031a3-ee1e-43d0-a1a6-1a902400d030) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '16ec70b0-457a-4dfe-bab9-a3c37320e667', 'volume_name': 'volume-16ec70b0-457a-4dfe-bab9-a3c37320e667', 'volume_size': 1, 'image_id': 'f481b8be-570c-4abf-8603-2f4872d1c4da', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f481b8be-570c-4abf-8603-2f4872d1c4da', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a15a8070744df4fa7cd29941b6feb85c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a74e5a4a1b7447d5b35cfb1b7985ecdb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4cb1ab259af8e09c7fc3b5e4faa6d41907fe5412741ddce6c06e458fbaa81209aeea38b4ec45c5b62270bd1363cc7ef7a9548d6f8d012589464c088448473a09', 'id': 'f481b8be-570c-4abf-8603-2f4872d1c4da', 'created_at': datetime.datetime(2026, 9, 3, 9, 23, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 23, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f481b8be-570c-4abf-8603-2f4872d1c4da/file', 'properties': {}}, 'image_service': }' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf499bd9-700d-47d7-93ab-44833c23f388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf499bd9-700d-47d7-93ab-44833c23f388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c212c54-fe16-4da3-8332-331d8e63da24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:29 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Volume 16ec70b0-457a-4dfe-bab9-a3c37320e667: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-16ec70b0-457a-4dfe-bab9-a3c37320e667', 'volume_size': 1, 'image_id': 'f481b8be-570c-4abf-8603-2f4872d1c4da', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f481b8be-570c-4abf-8603-2f4872d1c4da', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a15a8070744df4fa7cd29941b6feb85c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a74e5a4a1b7447d5b35cfb1b7985ecdb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4cb1ab259af8e09c7fc3b5e4faa6d41907fe5412741ddce6c06e458fbaa81209aeea38b4ec45c5b62270bd1363cc7ef7a9548d6f8d012589464c088448473a09', 'id': 'f481b8be-570c-4abf-8603-2f4872d1c4da', 'created_at': datetime.datetime(2026, 9, 3, 9, 23, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 23, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f481b8be-570c-4abf-8603-2f4872d1c4da/file', 'properties': {}}, 'image_service': } Sep 03 11:23:29 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Trying to clone 16ec70b0-457a-4dfe-bab9-a3c37320e667 from image f481b8be-570c-4abf-8603-2f4872d1c4da at location (None, [{'url': 'file:///opt/stack/data/glance/images/f481b8be-570c-4abf-8603-2f4872d1c4da', 'metadata': {}}]). {{(pid=87038) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 11:23:29 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Creating offline snapshot cd463a60-ecd6-4ad2-822a-b9a842ab71fd of volume 73190cd8-b9df-4468-bce6-0f945a65a80e {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:23:29 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[05132b07-ba11-4e80-9ef2-cdf3ec0d42d0]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:30 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f481b8be-570c-4abf-8603-2f4872d1c4da_36wa69lzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87038) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 11:23:30 devstack cinder-volume[87038]: INFO cinder.image.image_utils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Image download 0.00 MB at 0.00 MB/s Sep 03 11:23:30 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-90fc1c2e-a1c6-4b55-bf3c-57addf4c41d4 tempest-GroupSnapshotsTest-1799889754 None] group_snapshot 991b26d3-c2be-44a9-af31-9b5962baa0f7: created successfully Sep 03 11:23:30 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e Sep 03 11:23:30 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:30 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14aa63a-4767-4880-94ed-84529da6d6a6]: (4, 'raw') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f481b8be-570c-4abf-8603-2f4872d1c4da_36wa69lzdevstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:30 devstack sudo[98623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f481b8be-570c-4abf-8603-2f4872d1c4da_36wa69lzdevstack@QuobyteHD Sep 03 11:23:30 devstack sudo[98623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:30 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e" returned: 0 in 0.409s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e.cd463a60-ecd6-4ad2-822a-b9a842ab71fd 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:30 devstack sudo[98628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e.cd463a60-ecd6-4ad2-822a-b9a842ab71fd 1G Sep 03 11:23:30 devstack sudo[98628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:30 devstack sudo[98623]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f481b8be-570c-4abf-8603-2f4872d1c4da_36wa69lzdevstack@QuobyteHD" returned: 0 in 0.377s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f481b8be-570c-4abf-8603-2f4872d1c4da_36wa69lzdevstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:30 devstack sudo[98632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f481b8be-570c-4abf-8603-2f4872d1c4da_36wa69lzdevstack@QuobyteHD Sep 03 11:23:30 devstack sudo[98632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:30 devstack sudo[98628]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e.cd463a60-ecd6-4ad2-822a-b9a842ab71fd 1G" returned: 0 in 0.452s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73190cd8-b9df-4468-bce6-0f945a65a80e -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e.cd463a60-ecd6-4ad2-822a-b9a842ab71fd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:30 devstack sudo[98632]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f481b8be-570c-4abf-8603-2f4872d1c4da_36wa69lzdevstack@QuobyteHD" returned: 1 in 0.358s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f481b8be-570c-4abf-8603-2f4872d1c4da_36wa69lzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:23:30 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Temporary image f481b8be-570c-4abf-8603-2f4872d1c4da is fetched for user ef2aca0b3d87454093d93136e8929ec3. {{(pid=87038) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 11:23:30 devstack sudo[98640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73190cd8-b9df-4468-bce6-0f945a65a80e -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e.cd463a60-ecd6-4ad2-822a-b9a842ab71fd Sep 03 11:23:30 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:30 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[56272e90-33bd-45a0-9c3d-6875545d73c9]: (4, 'raw') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f481b8be-570c-4abf-8603-2f4872d1c4da_36wa69lzdevstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:31 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] group_snapshot 991b26d3-c2be-44a9-af31-9b5962baa0f7: deleting Sep 03 11:23:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] group_snapshot 991b26d3-c2be-44a9-af31-9b5962baa0f7: deleting {{(pid=87038) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 03 11:23:31 devstack sudo[98642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f481b8be-570c-4abf-8603-2f4872d1c4da_36wa69lzdevstack@QuobyteHD Sep 03 11:23:31 devstack sudo[98642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:31 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] Acquiring lock "cinder-quobyte-9c872177-e751-480a-a7a8-12b26af246d4" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:23:31 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] Lock "cinder-quobyte-9c872177-e751-480a-a7a8-12b26af246d4" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:23:31 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] Acquiring lock "cinder-quobyte-4b89de97-6b83-4702-95c9-20d0020ab458" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:23:31 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] Lock "cinder-quobyte-4b89de97-6b83-4702-95c9-20d0020ab458" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:23:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] Deleting offline snapshot 4b89de97-6b83-4702-95c9-20d0020ab458 of volume 9c872177-e751-480a-a7a8-12b26af246d4 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:23:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] snapshot_file for this snap is: volume-9c872177-e751-480a-a7a8-12b26af246d4.4b89de97-6b83-4702-95c9-20d0020ab458 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:23:31 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-49204a46-3f4f-4931-a605-6d8422eabab2 tempest-VolumesNegativeTest-491497304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:23:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-49204a46-3f4f-4931-a605-6d8422eabab2 tempest-VolumesNegativeTest-491497304 None] Flow 'volume_create_manager' (2f7ab80f-e62c-48cc-a57e-53257bf9c434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:23:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-49204a46-3f4f-4931-a605-6d8422eabab2 tempest-VolumesNegativeTest-491497304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b10860e-df41-4a1e-aada-c66ceb4876ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:31 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[777ce8b4-02fc-4557-8041-c5cf65f6eee6]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:31 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4.4b89de97-6b83-4702-95c9-20d0020ab458 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73190cd8-b9df-4468-bce6-0f945a65a80e -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e.cd463a60-ecd6-4ad2-822a-b9a842ab71fd" returned: 0 in 0.480s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:31 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e.cd463a60-ecd6-4ad2-822a-b9a842ab71fd is being set with open permissions: ugo+rw Sep 03 11:23:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e.cd463a60-ecd6-4ad2-822a-b9a842ab71fd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-49204a46-3f4f-4931-a605-6d8422eabab2 tempest-VolumesNegativeTest-491497304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b10860e-df41-4a1e-aada-c66ceb4876ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-336449983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac3f20dc-e6ff-4a90-be8b-f34d5cbfc4df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ced8b011fb84edb83d16c1a1c5feb44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:23:31Z,use_quota=True,user_id='d720a0d3b3954a52a9767123d8161031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-49204a46-3f4f-4931-a605-6d8422eabab2 tempest-VolumesNegativeTest-491497304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a0b461b-2483-4433-8c2e-bdf713fabd08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-49204a46-3f4f-4931-a605-6d8422eabab2 tempest-VolumesNegativeTest-491497304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a0b461b-2483-4433-8c2e-bdf713fabd08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:31 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e.cd463a60-ecd6-4ad2-822a-b9a842ab71fd Sep 03 11:23:31 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-49204a46-3f4f-4931-a605-6d8422eabab2 tempest-VolumesNegativeTest-491497304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f9db1e5-9166-460d-8183-23e5c91f4d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-49204a46-3f4f-4931-a605-6d8422eabab2 tempest-VolumesNegativeTest-491497304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f9db1e5-9166-460d-8183-23e5c91f4d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac3f20dc-e6ff-4a90-be8b-f34d5cbfc4df', 'volume_name': 'volume-ac3f20dc-e6ff-4a90-be8b-f34d5cbfc4df', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-49204a46-3f4f-4931-a605-6d8422eabab2 tempest-VolumesNegativeTest-491497304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8c4588c-85be-474b-8b27-08763bb6ff8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:31 devstack sudo[98642]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-49204a46-3f4f-4931-a605-6d8422eabab2 tempest-VolumesNegativeTest-491497304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8c4588c-85be-474b-8b27-08763bb6ff8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-49204a46-3f4f-4931-a605-6d8422eabab2 tempest-VolumesNegativeTest-491497304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2698a50e-749d-4be8-9023-519f4c53684a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:31 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-49204a46-3f4f-4931-a605-6d8422eabab2 tempest-VolumesNegativeTest-491497304 None] Volume ac3f20dc-e6ff-4a90-be8b-f34d5cbfc4df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac3f20dc-e6ff-4a90-be8b-f34d5cbfc4df', 'volume_size': 1} Sep 03 11:23:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-49204a46-3f4f-4931-a605-6d8422eabab2 tempest-VolumesNegativeTest-491497304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:31 devstack sudo[98647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4.4b89de97-6b83-4702-95c9-20d0020ab458 Sep 03 11:23:31 devstack sudo[98647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f481b8be-570c-4abf-8603-2f4872d1c4da_36wa69lzdevstack@QuobyteHD" returned: 0 in 0.461s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f481b8be-570c-4abf-8603-2f4872d1c4da_36wa69lzdevstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:31 devstack sudo[98654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f481b8be-570c-4abf-8603-2f4872d1c4da_36wa69lzdevstack@QuobyteHD Sep 03 11:23:31 devstack sudo[98654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:31 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e.cd463a60-ecd6-4ad2-822a-b9a842ab71fd" returned: 0 in 0.314s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:31 devstack sudo[98660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e.info Sep 03 11:23:31 devstack sudo[98660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:31 devstack sudo[98647]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4.4b89de97-6b83-4702-95c9-20d0020ab458" returned: 0 in 0.414s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c872177-e751-480a-a7a8-12b26af246d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:23:31 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[696fa8c0-5bc9-4e99-b44c-3d711c727d05]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:31 devstack sudo[98654]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f481b8be-570c-4abf-8603-2f4872d1c4da_36wa69lzdevstack@QuobyteHD" returned: 1 in 0.349s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f481b8be-570c-4abf-8603-2f4872d1c4da_36wa69lzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:23:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:31 devstack sudo[98663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4 Sep 03 11:23:31 devstack sudo[98663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:31 devstack sudo[98660]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e.info" returned: 0 in 0.266s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:31 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e.info is being set with open permissions: ugo+rw Sep 03 11:23:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:31 devstack sudo[98668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e.info Sep 03 11:23:31 devstack sudo[98668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:32 devstack sudo[98663]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4" returned: 0 in 0.364s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4.4b89de97-6b83-4702-95c9-20d0020ab458 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:32 devstack sudo[98673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4.4b89de97-6b83-4702-95c9-20d0020ab458 Sep 03 11:23:32 devstack sudo[98673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:32 devstack sudo[98668]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e.info" returned: 0 in 0.256s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:32 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Acquiring lock "cinder-quobyte-18bd3219-b2d9-42f6-a9a9-9039d884316d" by "_copy_volume_from_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:23:32 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Lock "cinder-quobyte-18bd3219-b2d9-42f6-a9a9-9039d884316d" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:23:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] snapshot: cd463a60-ecd6-4ad2-822a-b9a842ab71fd, volume: 18bd3219-b2d9-42f6-a9a9-9039d884316d, {{(pid=87038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 11:23:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:23:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:23:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:32 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[e84bfa0c-3376-4149-af45-61b8a81d8ca8]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e.cd463a60-ecd6-4ad2-822a-b9a842ab71fd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:32 devstack sudo[98676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e.cd463a60-ecd6-4ad2-822a-b9a842ab71fd Sep 03 11:23:32 devstack sudo[98676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:32 devstack sudo[98673]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4.4b89de97-6b83-4702-95c9-20d0020ab458" returned: 0 in 0.396s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4.4b89de97-6b83-4702-95c9-20d0020ab458 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:32 devstack sudo[98682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4.4b89de97-6b83-4702-95c9-20d0020ab458 Sep 03 11:23:32 devstack sudo[98682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:32 devstack sudo[98676]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e.cd463a60-ecd6-4ad2-822a-b9a842ab71fd" returned: 0 in 0.372s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73190cd8-b9df-4468-bce6-0f945a65a80e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:23:32 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[db7f83cd-1531-47ee-b1cd-9efc6a7730c6]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:32 devstack sudo[98687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e Sep 03 11:23:32 devstack sudo[98687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:32 devstack sudo[98682]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4.4b89de97-6b83-4702-95c9-20d0020ab458" returned: 0 in 0.254s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:32 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] Lock "cinder-quobyte-4b89de97-6b83-4702-95c9-20d0020ab458" released by "_delete_snapshot" :: held 1.581s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:23:32 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] Lock "cinder-quobyte-9c872177-e751-480a-a7a8-12b26af246d4" released by "delete_snapshot" :: held 1.611s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:23:32 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] Acquiring lock "cinder-quobyte-09cf4b08-017c-43f8-b4f0-647b6e94f0af" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:23:32 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] Lock "cinder-quobyte-09cf4b08-017c-43f8-b4f0-647b6e94f0af" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:23:32 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] Acquiring lock "cinder-quobyte-c1942eeb-de4e-4746-8513-30158be2bddd" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:23:32 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] Lock "cinder-quobyte-c1942eeb-de4e-4746-8513-30158be2bddd" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:23:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] Deleting offline snapshot c1942eeb-de4e-4746-8513-30158be2bddd of volume 09cf4b08-017c-43f8-b4f0-647b6e94f0af {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:23:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] snapshot_file for this snap is: volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af.c1942eeb-de4e-4746-8513-30158be2bddd {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:23:32 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccb81ae-7f53-4b25-b059-5202b099991b]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af.c1942eeb-de4e-4746-8513-30158be2bddd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:32 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af.c1942eeb-de4e-4746-8513-30158be2bddd Sep 03 11:23:32 devstack sudo[98687]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:32 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e" returned: 0 in 0.361s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e {{(pid=87038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 11:23:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Creating direct copy from snapshot {{(pid=87038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 11:23:32 devstack cinder-volume[87038]: DEBUG cinder.utils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Path /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-18bd3219-b2d9-42f6-a9a9-9039d884316d not found in is_blk_device check {{(pid=87038) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 11:23:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-18bd3219-b2d9-42f6-a9a9-9039d884316d {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:32 devstack sudo[98695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-18bd3219-b2d9-42f6-a9a9-9039d884316d Sep 03 11:23:32 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:33 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af.c1942eeb-de4e-4746-8513-30158be2bddd" returned: 0 in 0.356s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:33 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:23:33 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[5841feef-fab6-414b-a54c-00d394a65acc]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:33 devstack sudo[98703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af Sep 03 11:23:33 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:33 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af" returned: 0 in 0.486s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af.c1942eeb-de4e-4746-8513-30158be2bddd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:33 devstack sudo[98715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af.c1942eeb-de4e-4746-8513-30158be2bddd Sep 03 11:23:33 devstack sudo[98715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:34 devstack sudo[98715]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af.c1942eeb-de4e-4746-8513-30158be2bddd" returned: 0 in 0.630s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af.c1942eeb-de4e-4746-8513-30158be2bddd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:34 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af.c1942eeb-de4e-4746-8513-30158be2bddd Sep 03 11:23:34 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:35 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af.c1942eeb-de4e-4746-8513-30158be2bddd" returned: 0 in 0.877s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] Lock "cinder-quobyte-c1942eeb-de4e-4746-8513-30158be2bddd" released by "_delete_snapshot" :: held 2.495s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:23:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] Lock "cinder-quobyte-09cf4b08-017c-43f8-b4f0-647b6e94f0af" released by "delete_snapshot" :: held 2.539s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:23:35 devstack cinder-volume[87038]: WARNING cinder.quota [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2006915842 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2006915842, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:23:35 devstack cinder-volume[87038]: WARNING cinder.quota [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2006915842 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2006915842, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:23:35 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] Created reservations ['dab1d0f1-5951-4175-90ac-cf6a40c78eb3', '7d177521-d50d-4cba-a8e6-f146306b2385', '929e8d6f-ddf8-4101-9f7d-a6dcebff8072', '275d8f57-4cfb-452e-9bd6-ab8d55896590'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:23:35 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] Created reservations ['0d679076-9373-45d6-8f80-d30a5e2e1e04', 'c40470ab-6678-44fe-b728-347135da7169', '46c8340f-ee3b-4a17-9ac8-a6a30e76efc0', 'cafe9a6c-52d7-4f85-ad66-1b62a31d0792'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:23:35 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-1f3d58a8-851f-4679-aaf8-a3bf75926888 tempest-GroupSnapshotsTest-1799889754 None] group_snapshot 991b26d3-c2be-44a9-af31-9b5962baa0f7: deleted successfully Sep 03 11:23:37 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-18bd3219-b2d9-42f6-a9a9-9039d884316d" returned: 0 in 4.586s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:37 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Image conversion details: src /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e, size 1024.00 MB, duration 4.59 sec, destination /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-18bd3219-b2d9-42f6-a9a9-9039d884316d {{(pid=87038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:23:37 devstack cinder-volume[87038]: INFO cinder.image.image_utils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Converted 1024.00 MB image at 223.25 MB/s Sep 03 11:23:37 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-18bd3219-b2d9-42f6-a9a9-9039d884316d is being set with open permissions: ugo+rw Sep 03 11:23:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-18bd3219-b2d9-42f6-a9a9-9039d884316d {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:37 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-18bd3219-b2d9-42f6-a9a9-9039d884316d Sep 03 11:23:37 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:37 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-bb8d0164-36a8-4278-a31b-aca161cda084 tempest-GroupSnapshotsTest-1799889754 None] Acquiring lock "cinder-quobyte-09cf4b08-017c-43f8-b4f0-647b6e94f0af" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:23:37 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-bb8d0164-36a8-4278-a31b-aca161cda084 tempest-GroupSnapshotsTest-1799889754 None] Lock "cinder-quobyte-09cf4b08-017c-43f8-b4f0-647b6e94f0af" acquired by "delete_volume" :: waited 0.022s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:23:37 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[884e888e-b2cb-41f5-96b8-f94f348c082a]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bb8d0164-36a8-4278-a31b-aca161cda084 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:37 devstack sudo[98734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af Sep 03 11:23:37 devstack sudo[98734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:37 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-18bd3219-b2d9-42f6-a9a9-9039d884316d" returned: 0 in 0.259s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:37 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Lock "cinder-quobyte-18bd3219-b2d9-42f6-a9a9-9039d884316d" released by "_copy_volume_from_snapshot" :: held 5.642s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:23:37 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Acquiring lock "cinder-quobyte-cd463a60-ecd6-4ad2-822a-b9a842ab71fd" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:23:37 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Lock "cinder-quobyte-cd463a60-ecd6-4ad2-822a-b9a842ab71fd" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:23:37 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Deleting offline snapshot cd463a60-ecd6-4ad2-822a-b9a842ab71fd of volume 73190cd8-b9df-4468-bce6-0f945a65a80e {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:23:37 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] snapshot_file for this snap is: volume-73190cd8-b9df-4468-bce6-0f945a65a80e.cd463a60-ecd6-4ad2-822a-b9a842ab71fd {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:23:37 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[55d706f9-17c1-4e28-9ced-4333e30e9d24]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e.cd463a60-ecd6-4ad2-822a-b9a842ab71fd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:37 devstack sudo[98737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e.cd463a60-ecd6-4ad2-822a-b9a842ab71fd Sep 03 11:23:37 devstack sudo[98737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:38 devstack sudo[98734]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bb8d0164-36a8-4278-a31b-aca161cda084 tempest-GroupSnapshotsTest-1799889754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af" returned: 0 in 0.368s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bb8d0164-36a8-4278-a31b-aca161cda084 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:38 devstack sudo[98743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af Sep 03 11:23:38 devstack sudo[98743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:38 devstack sudo[98737]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e.cd463a60-ecd6-4ad2-822a-b9a842ab71fd" returned: 0 in 0.371s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:38 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73190cd8-b9df-4468-bce6-0f945a65a80e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:23:38 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[8549e575-1dee-4811-9f13-3c80be835702]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:38 devstack sudo[98743]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bb8d0164-36a8-4278-a31b-aca161cda084 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-09cf4b08-017c-43f8-b4f0-647b6e94f0af" returned: 0 in 0.262s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:38 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-bb8d0164-36a8-4278-a31b-aca161cda084 tempest-GroupSnapshotsTest-1799889754 None] Lock "cinder-quobyte-09cf4b08-017c-43f8-b4f0-647b6e94f0af" released by "delete_volume" :: held 0.705s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:23:38 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-bb8d0164-36a8-4278-a31b-aca161cda084 tempest-GroupSnapshotsTest-1799889754 None] Acquiring lock "cinder-quobyte-9c872177-e751-480a-a7a8-12b26af246d4" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:23:38 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-bb8d0164-36a8-4278-a31b-aca161cda084 tempest-GroupSnapshotsTest-1799889754 None] Lock "cinder-quobyte-9c872177-e751-480a-a7a8-12b26af246d4" acquired by "delete_volume" :: waited 0.017s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:23:38 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8089c7-4ed7-4c1b-99e5-567d94d892be]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bb8d0164-36a8-4278-a31b-aca161cda084 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:38 devstack sudo[98749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e Sep 03 11:23:38 devstack sudo[98749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:38 devstack sudo[98750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4 Sep 03 11:23:38 devstack sudo[98750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:38 devstack sudo[98750]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bb8d0164-36a8-4278-a31b-aca161cda084 tempest-GroupSnapshotsTest-1799889754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4" returned: 0 in 0.349s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bb8d0164-36a8-4278-a31b-aca161cda084 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:38 devstack sudo[98758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4 Sep 03 11:23:38 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:38 devstack sudo[98749]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e" returned: 0 in 0.565s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e.cd463a60-ecd6-4ad2-822a-b9a842ab71fd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:38 devstack sudo[98761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e.cd463a60-ecd6-4ad2-822a-b9a842ab71fd Sep 03 11:23:38 devstack sudo[98761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:38 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bb8d0164-36a8-4278-a31b-aca161cda084 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9c872177-e751-480a-a7a8-12b26af246d4" returned: 0 in 0.245s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:38 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-bb8d0164-36a8-4278-a31b-aca161cda084 tempest-GroupSnapshotsTest-1799889754 None] Lock "cinder-quobyte-9c872177-e751-480a-a7a8-12b26af246d4" released by "delete_volume" :: held 0.653s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:23:39 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-bb8d0164-36a8-4278-a31b-aca161cda084 tempest-GroupSnapshotsTest-1799889754 None] Created reservations ['3c3848d3-a4fd-4910-b2aa-b2ccabd5b31b'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:23:39 devstack cinder-volume[87038]: WARNING cinder.quota [None req-bb8d0164-36a8-4278-a31b-aca161cda084 tempest-GroupSnapshotsTest-1799889754 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2006915842 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2006915842, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:23:39 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-bb8d0164-36a8-4278-a31b-aca161cda084 tempest-GroupSnapshotsTest-1799889754 None] Created reservations ['de05763a-8acd-4e37-bb6d-ffb3857f14d1', '66939162-6936-4f8a-ade1-71d20ebe3cbe', '4ade925c-a078-4cee-b47b-25b8b8d20283', 'c2b5d543-bf1c-4697-8f3b-64039fb34911'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:23:39 devstack sudo[98761]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e.cd463a60-ecd6-4ad2-822a-b9a842ab71fd" returned: 0 in 0.385s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e.cd463a60-ecd6-4ad2-822a-b9a842ab71fd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:39 devstack sudo[98768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e.cd463a60-ecd6-4ad2-822a-b9a842ab71fd Sep 03 11:23:39 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-bb8d0164-36a8-4278-a31b-aca161cda084 tempest-GroupSnapshotsTest-1799889754 None] Created reservations ['4ed89d96-1beb-4706-89ce-8d519920c06a', '2d43901a-574d-4a2f-8b17-cec5ba29926b', '11728960-ac95-424d-8973-18d1edebee51', '884d114a-4aff-4015-9ed3-5d6d1a4a22ee'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:23:39 devstack sudo[98768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bb8d0164-36a8-4278-a31b-aca161cda084 tempest-GroupSnapshotsTest-1799889754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bb8d0164-36a8-4278-a31b-aca161cda084 tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-bb8d0164-36a8-4278-a31b-aca161cda084 tempest-GroupSnapshotsTest-1799889754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:23:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-bb8d0164-36a8-4278-a31b-aca161cda084 tempest-GroupSnapshotsTest-1799889754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:23:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bb8d0164-36a8-4278-a31b-aca161cda084 tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bb8d0164-36a8-4278-a31b-aca161cda084 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:39 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:23:39 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:39 devstack sudo[98768]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e.cd463a60-ecd6-4ad2-822a-b9a842ab71fd" returned: 0 in 0.244s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:39 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Lock "cinder-quobyte-cd463a60-ecd6-4ad2-822a-b9a842ab71fd" released by "_delete_snapshot" :: held 1.654s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:23:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.710s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-49204a46-3f4f-4931-a605-6d8422eabab2 tempest-VolumesNegativeTest-491497304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.148s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-49204a46-3f4f-4931-a605-6d8422eabab2 tempest-VolumesNegativeTest-491497304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-336449983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac3f20dc-e6ff-4a90-be8b-f34d5cbfc4df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ced8b011fb84edb83d16c1a1c5feb44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:23:31Z,use_quota=True,user_id='d720a0d3b3954a52a9767123d8161031',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:23:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-49204a46-3f4f-4931-a605-6d8422eabab2 tempest-VolumesNegativeTest-491497304 None] Creating volume ac3f20dc-e6ff-4a90-be8b-f34d5cbfc4df {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:23:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-49204a46-3f4f-4931-a605-6d8422eabab2 tempest-VolumesNegativeTest-491497304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-49204a46-3f4f-4931-a605-6d8422eabab2 tempest-VolumesNegativeTest-491497304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-49204a46-3f4f-4931-a605-6d8422eabab2 tempest-VolumesNegativeTest-491497304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:23:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-49204a46-3f4f-4931-a605-6d8422eabab2 tempest-VolumesNegativeTest-491497304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:23:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-49204a46-3f4f-4931-a605-6d8422eabab2 tempest-VolumesNegativeTest-491497304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-49204a46-3f4f-4931-a605-6d8422eabab2 tempest-VolumesNegativeTest-491497304 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:23:39 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-49204a46-3f4f-4931-a605-6d8422eabab2 tempest-VolumesNegativeTest-491497304 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:23:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-49204a46-3f4f-4931-a605-6d8422eabab2 tempest-VolumesNegativeTest-491497304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac3f20dc-e6ff-4a90-be8b-f34d5cbfc4df 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ba433a6-9b0a-4d27-a444-2240e5b880e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18bd3219-b2d9-42f6-a9a9-9039d884316d', 'volume_size': 1, 'source_volid': '73190cd8-b9df-4468-bce6-0f945a65a80e', 'source_volstatus': 'available'}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:39 devstack sudo[98773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac3f20dc-e6ff-4a90-be8b-f34d5cbfc4df 1073741824 Sep 03 11:23:39 devstack sudo[98773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e2cfb84-2d54-411d-b605-0eeb03506251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:39 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Volume volume-18bd3219-b2d9-42f6-a9a9-9039d884316d (18bd3219-b2d9-42f6-a9a9-9039d884316d): created successfully Sep 03 11:23:39 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e2cfb84-2d54-411d-b605-0eeb03506251) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Flow 'volume_create_manager' (5de413d7-5c1e-473f-970f-b2917ba2f5e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:23:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bb8d0164-36a8-4278-a31b-aca161cda084 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.267s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:39 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-bb8d0164-36a8-4278-a31b-aca161cda084 tempest-GroupSnapshotsTest-1799889754 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:23:39 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-bb8d0164-36a8-4278-a31b-aca161cda084 tempest-GroupSnapshotsTest-1799889754 None] Delete group completed successfully. Sep 03 11:23:39 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-28c2c2b5-55cc-4ad4-937f-8f1f6c7f6235 tempest-VolumesGetTest-1157460799 None] Created volume successfully. Sep 03 11:23:40 devstack sudo[98773]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-49204a46-3f4f-4931-a605-6d8422eabab2 tempest-VolumesNegativeTest-491497304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac3f20dc-e6ff-4a90-be8b-f34d5cbfc4df 1073741824" returned: 0 in 0.507s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-49204a46-3f4f-4931-a605-6d8422eabab2 tempest-VolumesNegativeTest-491497304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac3f20dc-e6ff-4a90-be8b-f34d5cbfc4df {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:40 devstack sudo[98780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac3f20dc-e6ff-4a90-be8b-f34d5cbfc4df Sep 03 11:23:40 devstack sudo[98780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:40 devstack sudo[98780]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-49204a46-3f4f-4931-a605-6d8422eabab2 tempest-VolumesNegativeTest-491497304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac3f20dc-e6ff-4a90-be8b-f34d5cbfc4df" returned: 0 in 0.300s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:40 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-49204a46-3f4f-4931-a605-6d8422eabab2 tempest-VolumesNegativeTest-491497304 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:23:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-49204a46-3f4f-4931-a605-6d8422eabab2 tempest-VolumesNegativeTest-491497304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.637s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:40 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16ec70b0-457a-4dfe-bab9-a3c37320e667,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a74e5a4a1b7447d5b35cfb1b7985ecdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:23:29Z,use_quota=True,user_id='ef2aca0b3d87454093d93136e8929ec3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:23:40 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Creating volume 16ec70b0-457a-4dfe-bab9-a3c37320e667 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:23:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:40 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:23:40 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:23:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:40 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:23:40 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:23:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-16ec70b0-457a-4dfe-bab9-a3c37320e667 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-49204a46-3f4f-4931-a605-6d8422eabab2 tempest-VolumesNegativeTest-491497304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2698a50e-749d-4be8-9023-519f4c53684a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac3f20dc-e6ff-4a90-be8b-f34d5cbfc4df', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-49204a46-3f4f-4931-a605-6d8422eabab2 tempest-VolumesNegativeTest-491497304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb5443f6-4ea7-403c-9cb8-002d0286e2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:40 devstack sudo[98783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-16ec70b0-457a-4dfe-bab9-a3c37320e667 1073741824 Sep 03 11:23:40 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:40 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-49204a46-3f4f-4931-a605-6d8422eabab2 tempest-VolumesNegativeTest-491497304 None] Volume volume-ac3f20dc-e6ff-4a90-be8b-f34d5cbfc4df (ac3f20dc-e6ff-4a90-be8b-f34d5cbfc4df): created successfully Sep 03 11:23:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-49204a46-3f4f-4931-a605-6d8422eabab2 tempest-VolumesNegativeTest-491497304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb5443f6-4ea7-403c-9cb8-002d0286e2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-49204a46-3f4f-4931-a605-6d8422eabab2 tempest-VolumesNegativeTest-491497304 None] Flow 'volume_create_manager' (2f7ab80f-e62c-48cc-a57e-53257bf9c434) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:23:40 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-49204a46-3f4f-4931-a605-6d8422eabab2 tempest-VolumesNegativeTest-491497304 None] Created volume successfully. Sep 03 11:23:40 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-be9d58b6-3877-4c58-9c29-8692c1d015d5 tempest-GroupSnapshotsTest-1799889754 None] Group tempest-GroupSnapshotsTest-Group-1660816875: creating Sep 03 11:23:40 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-5491c73b-9ba5-4617-a25a-72881eb211b8 tempest-VolumesGetTest-1157460799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:23:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5491c73b-9ba5-4617-a25a-72881eb211b8 tempest-VolumesGetTest-1157460799 None] Flow 'volume_create_manager' (41698038-be14-4a1d-a3a3-1cfc83b33579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:23:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5491c73b-9ba5-4617-a25a-72881eb211b8 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2064e581-501a-4ada-802c-d7792af8be61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5491c73b-9ba5-4617-a25a-72881eb211b8 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2064e581-501a-4ada-802c-d7792af8be61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:23:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-374345369',display_name='tempest-VolumesGetTest-Volume-139228197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cb93230-7e4f-47db-9310-9d8622362719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7fa995d29344de194fdbabe2f065b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:23:41Z,use_quota=True,user_id='d977b948c0fd4c27bff72a5c3e2d78d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5491c73b-9ba5-4617-a25a-72881eb211b8 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f30c01-5d34-4d12-8cef-9d73bfdfeb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5491c73b-9ba5-4617-a25a-72881eb211b8 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f30c01-5d34-4d12-8cef-9d73bfdfeb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5491c73b-9ba5-4617-a25a-72881eb211b8 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4818fce-3ed0-4874-a5fb-fdfcbd751232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5491c73b-9ba5-4617-a25a-72881eb211b8 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4818fce-3ed0-4874-a5fb-fdfcbd751232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cb93230-7e4f-47db-9310-9d8622362719', 'volume_name': 'volume-6cb93230-7e4f-47db-9310-9d8622362719', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5491c73b-9ba5-4617-a25a-72881eb211b8 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0ac1f0d-fee2-40ea-9c4a-ee69f3749b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5491c73b-9ba5-4617-a25a-72881eb211b8 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0ac1f0d-fee2-40ea-9c4a-ee69f3749b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5491c73b-9ba5-4617-a25a-72881eb211b8 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5479065-633c-491e-8961-0fb77e27702f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:40 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-5491c73b-9ba5-4617-a25a-72881eb211b8 tempest-VolumesGetTest-1157460799 None] Volume 6cb93230-7e4f-47db-9310-9d8622362719: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cb93230-7e4f-47db-9310-9d8622362719', 'volume_size': 1} Sep 03 11:23:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5491c73b-9ba5-4617-a25a-72881eb211b8 tempest-VolumesGetTest-1157460799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:40 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-be9d58b6-3877-4c58-9c29-8692c1d015d5 tempest-GroupSnapshotsTest-1799889754 None] Group tempest-GroupSnapshotsTest-Group-1660816875: created successfully Sep 03 11:23:40 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-be9d58b6-3877-4c58-9c29-8692c1d015d5 tempest-GroupSnapshotsTest-1799889754 None] Create group completed successfully. Sep 03 11:23:40 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-16ec70b0-457a-4dfe-bab9-a3c37320e667 1073741824" returned: 0 in 0.446s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-16ec70b0-457a-4dfe-bab9-a3c37320e667 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:40 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-16ec70b0-457a-4dfe-bab9-a3c37320e667 Sep 03 11:23:40 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:41 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-16ec70b0-457a-4dfe-bab9-a3c37320e667" returned: 0 in 0.246s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:41 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:23:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5491c73b-9ba5-4617-a25a-72881eb211b8 tempest-VolumesGetTest-1157460799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.419s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:41 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5491c73b-9ba5-4617-a25a-72881eb211b8 tempest-VolumesGetTest-1157460799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:23:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-374345369',display_name='tempest-VolumesGetTest-Volume-139228197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cb93230-7e4f-47db-9310-9d8622362719,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7fa995d29344de194fdbabe2f065b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:23:41Z,use_quota=True,user_id='d977b948c0fd4c27bff72a5c3e2d78d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:23:41 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-5491c73b-9ba5-4617-a25a-72881eb211b8 tempest-VolumesGetTest-1157460799 None] Creating volume 6cb93230-7e4f-47db-9310-9d8622362719 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:23:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5491c73b-9ba5-4617-a25a-72881eb211b8 tempest-VolumesGetTest-1157460799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5491c73b-9ba5-4617-a25a-72881eb211b8 tempest-VolumesGetTest-1157460799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:41 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5491c73b-9ba5-4617-a25a-72881eb211b8 tempest-VolumesGetTest-1157460799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:23:41 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5491c73b-9ba5-4617-a25a-72881eb211b8 tempest-VolumesGetTest-1157460799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:23:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5491c73b-9ba5-4617-a25a-72881eb211b8 tempest-VolumesGetTest-1157460799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:41 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5491c73b-9ba5-4617-a25a-72881eb211b8 tempest-VolumesGetTest-1157460799 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:23:41 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-5491c73b-9ba5-4617-a25a-72881eb211b8 tempest-VolumesGetTest-1157460799 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:23:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5491c73b-9ba5-4617-a25a-72881eb211b8 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6cb93230-7e4f-47db-9310-9d8622362719 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:41 devstack sudo[98792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6cb93230-7e4f-47db-9310-9d8622362719 1073741824 Sep 03 11:23:41 devstack sudo[98792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:41 devstack cinder-volume[87038]: DEBUG cinder.volume.volume_utils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Attempting download of f481b8be-570c-4abf-8603-2f4872d1c4da ((None, [{'url': 'file:///opt/stack/data/glance/images/f481b8be-570c-4abf-8603-2f4872d1c4da', 'metadata': {}}])) to volume 16ec70b0-457a-4dfe-bab9-a3c37320e667. {{(pid=87038) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 11:23:41 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[60374f6c-f634-454b-a0fb-a6a077c39b09]: (4, 'raw') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f481b8be-570c-4abf-8603-2f4872d1c4da_6uymx_ja {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:41 devstack sudo[98794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f481b8be-570c-4abf-8603-2f4872d1c4da_6uymx_ja Sep 03 11:23:41 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:41 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f481b8be-570c-4abf-8603-2f4872d1c4da_6uymx_ja" returned: 0 in 0.369s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f481b8be-570c-4abf-8603-2f4872d1c4da_6uymx_ja {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:41 devstack sudo[98792]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5491c73b-9ba5-4617-a25a-72881eb211b8 tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6cb93230-7e4f-47db-9310-9d8622362719 1073741824" returned: 0 in 0.500s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5491c73b-9ba5-4617-a25a-72881eb211b8 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6cb93230-7e4f-47db-9310-9d8622362719 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:41 devstack sudo[98806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6cb93230-7e4f-47db-9310-9d8622362719 Sep 03 11:23:41 devstack sudo[98806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:41 devstack sudo[98802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f481b8be-570c-4abf-8603-2f4872d1c4da_6uymx_ja Sep 03 11:23:41 devstack sudo[98802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:42 devstack sudo[98806]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5491c73b-9ba5-4617-a25a-72881eb211b8 tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6cb93230-7e4f-47db-9310-9d8622362719" returned: 0 in 0.373s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5491c73b-9ba5-4617-a25a-72881eb211b8 tempest-VolumesGetTest-1157460799 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5491c73b-9ba5-4617-a25a-72881eb211b8 tempest-VolumesGetTest-1157460799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5491c73b-9ba5-4617-a25a-72881eb211b8 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5479065-633c-491e-8961-0fb77e27702f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cb93230-7e4f-47db-9310-9d8622362719', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5491c73b-9ba5-4617-a25a-72881eb211b8 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4b6a727-bb57-4b0b-bea1-18fbb5ee89c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:42 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-5491c73b-9ba5-4617-a25a-72881eb211b8 tempest-VolumesGetTest-1157460799 None] Volume volume-6cb93230-7e4f-47db-9310-9d8622362719 (6cb93230-7e4f-47db-9310-9d8622362719): created successfully Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5491c73b-9ba5-4617-a25a-72881eb211b8 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4b6a727-bb57-4b0b-bea1-18fbb5ee89c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5491c73b-9ba5-4617-a25a-72881eb211b8 tempest-VolumesGetTest-1157460799 None] Flow 'volume_create_manager' (41698038-be14-4a1d-a3a3-1cfc83b33579) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:23:42 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-5491c73b-9ba5-4617-a25a-72881eb211b8 tempest-VolumesGetTest-1157460799 None] Created volume successfully. Sep 03 11:23:42 devstack sudo[98802]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f481b8be-570c-4abf-8603-2f4872d1c4da_6uymx_ja" returned: 1 in 0.585s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f481b8be-570c-4abf-8603-2f4872d1c4da_6uymx_ja' failed. Not Retrying. {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a145025-ba8b-43de-8174-ef7670bc21a4]: (4, 'raw') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f481b8be-570c-4abf-8603-2f4872d1c4da_36wa69lzdevstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a30719a-8672-427e-ad6c-29c2c185b368 tempest-GroupSnapshotsTest-1799889754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6a30719a-8672-427e-ad6c-29c2c185b368 tempest-GroupSnapshotsTest-1799889754 None] Flow 'volume_create_manager' (c92f68d1-aab5-4fd8-a5d5-6e548573baab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:23:42 devstack sudo[98812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f481b8be-570c-4abf-8603-2f4872d1c4da_36wa69lzdevstack@QuobyteHD Sep 03 11:23:42 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6a30719a-8672-427e-ad6c-29c2c185b368 tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6585de12-24ac-4d66-a3d3-2496dea44869) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6a30719a-8672-427e-ad6c-29c2c185b368 tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6585de12-24ac-4d66-a3d3-2496dea44869) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1865761620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=954adaab-5b17-4a6c-97f4-b969bb0934d8,host='devstack@QuobyteHD#QuobyteHD',id=e129fefa-5b2f-480f-a6e8-0954d0f0ea99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8caa1cbb957e461cbedbeeb17177dcd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:23:42Z,use_quota=True,user_id='34720c2ae5d34ba49f535dcddb1aa2f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e1b87d6-b75a-49cb-8329-8be506e4fcda),volume_type_id=6e1b87d6-b75a-49cb-8329-8be506e4fcda)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6a30719a-8672-427e-ad6c-29c2c185b368 tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21ff8401-5237-4ecd-a6a0-aaddb291b713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6a30719a-8672-427e-ad6c-29c2c185b368 tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21ff8401-5237-4ecd-a6a0-aaddb291b713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6a30719a-8672-427e-ad6c-29c2c185b368 tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c689231-93b5-4dc1-a6c3-62e257358443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6a30719a-8672-427e-ad6c-29c2c185b368 tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c689231-93b5-4dc1-a6c3-62e257358443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e129fefa-5b2f-480f-a6e8-0954d0f0ea99', 'volume_name': 'volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6a30719a-8672-427e-ad6c-29c2c185b368 tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a285ab-e112-40b7-a45e-4fcc877d4bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6a30719a-8672-427e-ad6c-29c2c185b368 tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a285ab-e112-40b7-a45e-4fcc877d4bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6a30719a-8672-427e-ad6c-29c2c185b368 tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24d80a10-0a1d-45c7-8656-f8b2948890f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:42 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-6a30719a-8672-427e-ad6c-29c2c185b368 tempest-GroupSnapshotsTest-1799889754 None] Volume e129fefa-5b2f-480f-a6e8-0954d0f0ea99: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99', 'volume_size': 1} Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6a30719a-8672-427e-ad6c-29c2c185b368 tempest-GroupSnapshotsTest-1799889754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6a30719a-8672-427e-ad6c-29c2c185b368 tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6a30719a-8672-427e-ad6c-29c2c185b368 tempest-GroupSnapshotsTest-1799889754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=954adaab-5b17-4a6c-97f4-b969bb0934d8,created_at=2026-09-03T09:23:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1865761620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=954adaab-5b17-4a6c-97f4-b969bb0934d8,host='devstack@QuobyteHD#QuobyteHD',id=e129fefa-5b2f-480f-a6e8-0954d0f0ea99,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8caa1cbb957e461cbedbeeb17177dcd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:23:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:23:42Z,use_quota=True,user_id='34720c2ae5d34ba49f535dcddb1aa2f9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(6e1b87d6-b75a-49cb-8329-8be506e4fcda),volume_type_id=6e1b87d6-b75a-49cb-8329-8be506e4fcda)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-6a30719a-8672-427e-ad6c-29c2c185b368 tempest-GroupSnapshotsTest-1799889754 None] Creating volume e129fefa-5b2f-480f-a6e8-0954d0f0ea99 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6a30719a-8672-427e-ad6c-29c2c185b368 tempest-GroupSnapshotsTest-1799889754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6a30719a-8672-427e-ad6c-29c2c185b368 tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6a30719a-8672-427e-ad6c-29c2c185b368 tempest-GroupSnapshotsTest-1799889754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6a30719a-8672-427e-ad6c-29c2c185b368 tempest-GroupSnapshotsTest-1799889754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6a30719a-8672-427e-ad6c-29c2c185b368 tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6a30719a-8672-427e-ad6c-29c2c185b368 tempest-GroupSnapshotsTest-1799889754 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:23:42 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-6a30719a-8672-427e-ad6c-29c2c185b368 tempest-GroupSnapshotsTest-1799889754 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6a30719a-8672-427e-ad6c-29c2c185b368 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:42 devstack sudo[98814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99 1073741824 Sep 03 11:23:42 devstack sudo[98814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:42 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f481b8be-570c-4abf-8603-2f4872d1c4da_36wa69lzdevstack@QuobyteHD" returned: 0 in 0.410s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f481b8be-570c-4abf-8603-2f4872d1c4da_36wa69lzdevstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:42 devstack sudo[98818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f481b8be-570c-4abf-8603-2f4872d1c4da_36wa69lzdevstack@QuobyteHD Sep 03 11:23:42 devstack sudo[98818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-c871017b-0c42-4146-aa74-8e13b4f582ee tempest-VolumesGetTest-1157460799 None] Acquiring lock "cinder-6cb93230-7e4f-47db-9310-9d8622362719-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-c871017b-0c42-4146-aa74-8e13b4f582ee tempest-VolumesGetTest-1157460799 None] Lock "cinder-6cb93230-7e4f-47db-9310-9d8622362719-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-c871017b-0c42-4146-aa74-8e13b4f582ee tempest-VolumesGetTest-1157460799 None] Acquiring lock "cinder-quobyte-6cb93230-7e4f-47db-9310-9d8622362719" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-c871017b-0c42-4146-aa74-8e13b4f582ee tempest-VolumesGetTest-1157460799 None] Lock "cinder-quobyte-6cb93230-7e4f-47db-9310-9d8622362719" acquired by "delete_volume" :: waited 0.022s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d0e0f6-eb3f-4be9-b31b-947edc516711]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c871017b-0c42-4146-aa74-8e13b4f582ee tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6cb93230-7e4f-47db-9310-9d8622362719 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:43 devstack sudo[98814]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6a30719a-8672-427e-ad6c-29c2c185b368 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99 1073741824" returned: 0 in 0.602s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:43 devstack sudo[98825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6cb93230-7e4f-47db-9310-9d8622362719 Sep 03 11:23:43 devstack sudo[98825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:43 devstack sudo[98818]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f481b8be-570c-4abf-8603-2f4872d1c4da_36wa69lzdevstack@QuobyteHD" returned: 1 in 0.454s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f481b8be-570c-4abf-8603-2f4872d1c4da_36wa69lzdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:23:43 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] f481b8be-570c-4abf-8603-2f4872d1c4da was raw, converting to qcow2 {{(pid=87038) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 11:23:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f481b8be-570c-4abf-8603-2f4872d1c4da_36wa69lzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-16ec70b0-457a-4dfe-bab9-a3c37320e667 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:43 devstack sudo[98830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f481b8be-570c-4abf-8603-2f4872d1c4da_36wa69lzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-16ec70b0-457a-4dfe-bab9-a3c37320e667 Sep 03 11:23:43 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6a30719a-8672-427e-ad6c-29c2c185b368 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:43 devstack sudo[98832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99 Sep 03 11:23:43 devstack sudo[98832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:43 devstack sudo[98825]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c871017b-0c42-4146-aa74-8e13b4f582ee tempest-VolumesGetTest-1157460799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6cb93230-7e4f-47db-9310-9d8622362719" returned: 0 in 0.525s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c871017b-0c42-4146-aa74-8e13b4f582ee tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6cb93230-7e4f-47db-9310-9d8622362719 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:43 devstack sudo[98841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6cb93230-7e4f-47db-9310-9d8622362719 Sep 03 11:23:43 devstack sudo[98841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:43 devstack sudo[98832]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6a30719a-8672-427e-ad6c-29c2c185b368 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99" returned: 0 in 0.421s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6a30719a-8672-427e-ad6c-29c2c185b368 tempest-GroupSnapshotsTest-1799889754 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:23:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6a30719a-8672-427e-ad6c-29c2c185b368 tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6a30719a-8672-427e-ad6c-29c2c185b368 tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24d80a10-0a1d-45c7-8656-f8b2948890f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6a30719a-8672-427e-ad6c-29c2c185b368 tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61ec2d6d-6e92-4510-b3ff-9ed44e92c276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:43 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-6a30719a-8672-427e-ad6c-29c2c185b368 tempest-GroupSnapshotsTest-1799889754 None] Volume volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99 (e129fefa-5b2f-480f-a6e8-0954d0f0ea99): created successfully Sep 03 11:23:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6a30719a-8672-427e-ad6c-29c2c185b368 tempest-GroupSnapshotsTest-1799889754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61ec2d6d-6e92-4510-b3ff-9ed44e92c276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6a30719a-8672-427e-ad6c-29c2c185b368 tempest-GroupSnapshotsTest-1799889754 None] Flow 'volume_create_manager' (c92f68d1-aab5-4fd8-a5d5-6e548573baab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:23:43 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-6a30719a-8672-427e-ad6c-29c2c185b368 tempest-GroupSnapshotsTest-1799889754 None] Created volume successfully. Sep 03 11:23:43 devstack sudo[98841]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c871017b-0c42-4146-aa74-8e13b4f582ee tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6cb93230-7e4f-47db-9310-9d8622362719" returned: 0 in 0.336s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:43 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-c871017b-0c42-4146-aa74-8e13b4f582ee tempest-VolumesGetTest-1157460799 None] Lock "cinder-quobyte-6cb93230-7e4f-47db-9310-9d8622362719" released by "delete_volume" :: held 0.915s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:23:43 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f481b8be-570c-4abf-8603-2f4872d1c4da_36wa69lzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-16ec70b0-457a-4dfe-bab9-a3c37320e667" returned: 0 in 0.751s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:43 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f481b8be-570c-4abf-8603-2f4872d1c4da_36wa69lzdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-16ec70b0-457a-4dfe-bab9-a3c37320e667 {{(pid=87038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:23:43 devstack cinder-volume[87038]: INFO cinder.image.image_utils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Converted 0.00 MB image at 0.00 MB/s Sep 03 11:23:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-16ec70b0-457a-4dfe-bab9-a3c37320e667 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:43 devstack sudo[98845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-16ec70b0-457a-4dfe-bab9-a3c37320e667 1G Sep 03 11:23:43 devstack sudo[98845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:43 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-c871017b-0c42-4146-aa74-8e13b4f582ee tempest-VolumesGetTest-1157460799 None] Created reservations ['bcee1649-94fb-4d9b-85f1-b4c40aee2397', 'ed78f4bc-747a-49d2-9ea9-9257117f939c', '5ba0fd65-c228-441a-bf69-7e03873ad1c4', 'c444c001-e74f-4963-b341-66b24777e0a4'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:23:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-c871017b-0c42-4146-aa74-8e13b4f582ee tempest-VolumesGetTest-1157460799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-c871017b-0c42-4146-aa74-8e13b4f582ee tempest-VolumesGetTest-1157460799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-c871017b-0c42-4146-aa74-8e13b4f582ee tempest-VolumesGetTest-1157460799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:23:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-c871017b-0c42-4146-aa74-8e13b4f582ee tempest-VolumesGetTest-1157460799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:23:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-c871017b-0c42-4146-aa74-8e13b4f582ee tempest-VolumesGetTest-1157460799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c871017b-0c42-4146-aa74-8e13b4f582ee tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:43 devstack sudo[98848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:23:44 devstack sudo[98848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:44 devstack sudo[98845]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-16ec70b0-457a-4dfe-bab9-a3c37320e667 1G" returned: 0 in 0.414s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:44 devstack cinder-volume[87038]: DEBUG cinder.volume.volume_utils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Downloaded image f481b8be-570c-4abf-8603-2f4872d1c4da ((None, [{'url': 'file:///opt/stack/data/glance/images/f481b8be-570c-4abf-8603-2f4872d1c4da', 'metadata': {}}])) to volume 16ec70b0-457a-4dfe-bab9-a3c37320e667 successfully. {{(pid=87038) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 11:23:44 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Temporary image f481b8be-570c-4abf-8603-2f4872d1c4da for user ef2aca0b3d87454093d93136e8929ec3 is deleted. {{(pid=87038) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 11:23:44 devstack cinder-volume[87038]: DEBUG cinder.volume.volume_utils [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Marking volume 16ec70b0-457a-4dfe-bab9-a3c37320e667 as bootable. {{(pid=87038) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 11:23:44 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Copying metadata from image f481b8be-570c-4abf-8603-2f4872d1c4da to 16ec70b0-457a-4dfe-bab9-a3c37320e667. {{(pid=87038) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 11:23:44 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Creating volume glance metadata for volume 16ec70b0-457a-4dfe-bab9-a3c37320e667 backed by image f481b8be-570c-4abf-8603-2f4872d1c4da with: {'image_id': 'f481b8be-570c-4abf-8603-2f4872d1c4da', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a15a8070744df4fa7cd29941b6feb85c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87038) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 11:23:44 devstack sudo[98848]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c871017b-0c42-4146-aa74-8e13b4f582ee tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.403s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:44 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-c871017b-0c42-4146-aa74-8e13b4f582ee tempest-VolumesGetTest-1157460799 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:23:44 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-c871017b-0c42-4146-aa74-8e13b4f582ee tempest-VolumesGetTest-1157460799 None] Deleted volume successfully. Sep 03 11:23:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c212c54-fe16-4da3-8332-331d8e63da24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16ec70b0-457a-4dfe-bab9-a3c37320e667', 'volume_size': 1, 'image_id': 'f481b8be-570c-4abf-8603-2f4872d1c4da', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f481b8be-570c-4abf-8603-2f4872d1c4da', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a15a8070744df4fa7cd29941b6feb85c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a74e5a4a1b7447d5b35cfb1b7985ecdb', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4cb1ab259af8e09c7fc3b5e4faa6d41907fe5412741ddce6c06e458fbaa81209aeea38b4ec45c5b62270bd1363cc7ef7a9548d6f8d012589464c088448473a09', 'id': 'f481b8be-570c-4abf-8603-2f4872d1c4da', 'created_at': datetime.datetime(2026, 9, 3, 9, 23, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 23, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f481b8be-570c-4abf-8603-2f4872d1c4da/file', 'properties': {}}, 'image_service': }' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7851e414-fe0b-4d6f-9fcb-6faced67f44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:44 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-c871017b-0c42-4146-aa74-8e13b4f582ee tempest-VolumesGetTest-1157460799 None] Lock "cinder-6cb93230-7e4f-47db-9310-9d8622362719-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:23:44 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Volume volume-16ec70b0-457a-4dfe-bab9-a3c37320e667 (16ec70b0-457a-4dfe-bab9-a3c37320e667): created successfully Sep 03 11:23:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7851e414-fe0b-4d6f-9fcb-6faced67f44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Flow 'volume_create_manager' (9a7efd18-d623-44f9-a137-20d2ccd12d78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:23:44 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-62ae1cfa-9b44-4c6e-8319-1f560bbe4f78 tempest-VolumeImageDependencyTests-459894675 None] Created volume successfully. Sep 03 11:23:44 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-59e065be-0afa-43aa-a9b0-5cb743871fb8 tempest-VolumeImageDependencyTests-459894675 None] Acquiring lock "cinder-16ec70b0-457a-4dfe-bab9-a3c37320e667-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:23:44 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-59e065be-0afa-43aa-a9b0-5cb743871fb8 tempest-VolumeImageDependencyTests-459894675 None] Lock "cinder-16ec70b0-457a-4dfe-bab9-a3c37320e667-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:23:44 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-59e065be-0afa-43aa-a9b0-5cb743871fb8 tempest-VolumeImageDependencyTests-459894675 None] Acquiring lock "cinder-quobyte-16ec70b0-457a-4dfe-bab9-a3c37320e667" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:23:44 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-59e065be-0afa-43aa-a9b0-5cb743871fb8 tempest-VolumeImageDependencyTests-459894675 None] Lock "cinder-quobyte-16ec70b0-457a-4dfe-bab9-a3c37320e667" acquired by "delete_volume" :: waited 0.017s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:23:44 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[94e5ebf3-3082-4fc2-81ce-a8f1aa0bee70]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-59e065be-0afa-43aa-a9b0-5cb743871fb8 tempest-VolumeImageDependencyTests-459894675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-16ec70b0-457a-4dfe-bab9-a3c37320e667 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:45 devstack sudo[98869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-16ec70b0-457a-4dfe-bab9-a3c37320e667 Sep 03 11:23:45 devstack sudo[98869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:45 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-d080ea90-dc13-49bf-83da-e2cc0526b686 tempest-GroupSnapshotsTest-1799889754 None] GroupSnapshot 75741166-8669-4533-be1d-b5cbb06986c7: creating. Sep 03 11:23:45 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2099aa49-68b5-42c4-9f3e-ee31f3a80635 tempest-VolumesGetTest-1157460799 None] Acquiring lock "cinder-18bd3219-b2d9-42f6-a9a9-9039d884316d-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:23:45 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d080ea90-dc13-49bf-83da-e2cc0526b686 tempest-GroupSnapshotsTest-1799889754 None] Group snapshot 75741166-8669-4533-be1d-b5cbb06986c7: creating. {{(pid=87038) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 03 11:23:45 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2099aa49-68b5-42c4-9f3e-ee31f3a80635 tempest-VolumesGetTest-1157460799 None] Lock "cinder-18bd3219-b2d9-42f6-a9a9-9039d884316d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:23:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d080ea90-dc13-49bf-83da-e2cc0526b686 tempest-GroupSnapshotsTest-1799889754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d080ea90-dc13-49bf-83da-e2cc0526b686 tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:45 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-d080ea90-dc13-49bf-83da-e2cc0526b686 tempest-GroupSnapshotsTest-1799889754 None] Creating offline snapshot 1bd07401-a8e9-4b61-8f62-667c351ae4c8 of volume e129fefa-5b2f-480f-a6e8-0954d0f0ea99 {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:23:45 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2099aa49-68b5-42c4-9f3e-ee31f3a80635 tempest-VolumesGetTest-1157460799 None] Acquiring lock "cinder-quobyte-18bd3219-b2d9-42f6-a9a9-9039d884316d" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:23:45 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b4b943-cf70-4925-93a8-a3542957c885]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d080ea90-dc13-49bf-83da-e2cc0526b686 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:45 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2099aa49-68b5-42c4-9f3e-ee31f3a80635 tempest-VolumesGetTest-1157460799 None] Lock "cinder-quobyte-18bd3219-b2d9-42f6-a9a9-9039d884316d" acquired by "delete_volume" :: waited 0.034s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:23:45 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[1718c9a0-c3d8-40b1-9d41-ca40202484fc]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2099aa49-68b5-42c4-9f3e-ee31f3a80635 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-18bd3219-b2d9-42f6-a9a9-9039d884316d {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:45 devstack sudo[98869]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-59e065be-0afa-43aa-a9b0-5cb743871fb8 tempest-VolumeImageDependencyTests-459894675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-16ec70b0-457a-4dfe-bab9-a3c37320e667" returned: 0 in 0.547s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-59e065be-0afa-43aa-a9b0-5cb743871fb8 tempest-VolumeImageDependencyTests-459894675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-16ec70b0-457a-4dfe-bab9-a3c37320e667 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:45 devstack sudo[98876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-16ec70b0-457a-4dfe-bab9-a3c37320e667 Sep 03 11:23:45 devstack sudo[98876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:45 devstack sudo[98872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99 Sep 03 11:23:45 devstack sudo[98872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:45 devstack sudo[98875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-18bd3219-b2d9-42f6-a9a9-9039d884316d Sep 03 11:23:45 devstack sudo[98875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:45 devstack sudo[98876]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-59e065be-0afa-43aa-a9b0-5cb743871fb8 tempest-VolumeImageDependencyTests-459894675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-16ec70b0-457a-4dfe-bab9-a3c37320e667" returned: 0 in 0.335s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:45 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-59e065be-0afa-43aa-a9b0-5cb743871fb8 tempest-VolumeImageDependencyTests-459894675 None] Lock "cinder-quobyte-16ec70b0-457a-4dfe-bab9-a3c37320e667" released by "delete_volume" :: held 0.931s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:23:45 devstack sudo[98872]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d080ea90-dc13-49bf-83da-e2cc0526b686 tempest-GroupSnapshotsTest-1799889754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99" returned: 0 in 0.521s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d080ea90-dc13-49bf-83da-e2cc0526b686 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99.1bd07401-a8e9-4b61-8f62-667c351ae4c8 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:45 devstack sudo[98875]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:45 devstack sudo[98888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99.1bd07401-a8e9-4b61-8f62-667c351ae4c8 1G Sep 03 11:23:45 devstack sudo[98888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2099aa49-68b5-42c4-9f3e-ee31f3a80635 tempest-VolumesGetTest-1157460799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-18bd3219-b2d9-42f6-a9a9-9039d884316d" returned: 0 in 0.520s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2099aa49-68b5-42c4-9f3e-ee31f3a80635 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-18bd3219-b2d9-42f6-a9a9-9039d884316d {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:45 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-59e065be-0afa-43aa-a9b0-5cb743871fb8 tempest-VolumeImageDependencyTests-459894675 None] Created reservations ['2b7daee6-219e-490c-a9de-e27472bd66f7', '81d2da0c-6f22-44c7-9ff1-4213c65a3631', '3df33e60-403f-4d44-985b-e2a1d9e40923', '6df9ca62-d732-450c-9f49-e3c973ca5d9a'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:23:45 devstack sudo[98890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-18bd3219-b2d9-42f6-a9a9-9039d884316d Sep 03 11:23:45 devstack sudo[98890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-59e065be-0afa-43aa-a9b0-5cb743871fb8 tempest-VolumeImageDependencyTests-459894675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-59e065be-0afa-43aa-a9b0-5cb743871fb8 tempest-VolumeImageDependencyTests-459894675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:46 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-59e065be-0afa-43aa-a9b0-5cb743871fb8 tempest-VolumeImageDependencyTests-459894675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:23:46 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-59e065be-0afa-43aa-a9b0-5cb743871fb8 tempest-VolumeImageDependencyTests-459894675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:23:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-59e065be-0afa-43aa-a9b0-5cb743871fb8 tempest-VolumeImageDependencyTests-459894675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-59e065be-0afa-43aa-a9b0-5cb743871fb8 tempest-VolumeImageDependencyTests-459894675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:46 devstack sudo[98892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:23:46 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:46 devstack sudo[98890]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2099aa49-68b5-42c4-9f3e-ee31f3a80635 tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-18bd3219-b2d9-42f6-a9a9-9039d884316d" returned: 0 in 0.335s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:46 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2099aa49-68b5-42c4-9f3e-ee31f3a80635 tempest-VolumesGetTest-1157460799 None] Lock "cinder-quobyte-18bd3219-b2d9-42f6-a9a9-9039d884316d" released by "delete_volume" :: held 0.924s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:23:46 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-59e065be-0afa-43aa-a9b0-5cb743871fb8 tempest-VolumeImageDependencyTests-459894675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.310s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:46 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-59e065be-0afa-43aa-a9b0-5cb743871fb8 tempest-VolumeImageDependencyTests-459894675 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:23:46 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-2099aa49-68b5-42c4-9f3e-ee31f3a80635 tempest-VolumesGetTest-1157460799 None] Created reservations ['66f76254-a627-44ae-bfb2-04688805bf0d', '34539990-8504-4176-b208-340cdca118c2', '9833cab2-0a46-4995-b4b0-2cfb6f9f2dd7', 'fe47b308-2b86-4df4-819d-ba5e7107e282'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:23:46 devstack sudo[98888]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:46 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-59e065be-0afa-43aa-a9b0-5cb743871fb8 tempest-VolumeImageDependencyTests-459894675 None] Deleted volume successfully. Sep 03 11:23:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d080ea90-dc13-49bf-83da-e2cc0526b686 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99.1bd07401-a8e9-4b61-8f62-667c351ae4c8 1G" returned: 0 in 0.532s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d080ea90-dc13-49bf-83da-e2cc0526b686 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99.1bd07401-a8e9-4b61-8f62-667c351ae4c8 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:46 devstack sudo[98900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99.1bd07401-a8e9-4b61-8f62-667c351ae4c8 Sep 03 11:23:46 devstack sudo[98900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:46 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-59e065be-0afa-43aa-a9b0-5cb743871fb8 tempest-VolumeImageDependencyTests-459894675 None] Lock "cinder-16ec70b0-457a-4dfe-bab9-a3c37320e667-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:23:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2099aa49-68b5-42c4-9f3e-ee31f3a80635 tempest-VolumesGetTest-1157460799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2099aa49-68b5-42c4-9f3e-ee31f3a80635 tempest-VolumesGetTest-1157460799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:46 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2099aa49-68b5-42c4-9f3e-ee31f3a80635 tempest-VolumesGetTest-1157460799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:23:46 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2099aa49-68b5-42c4-9f3e-ee31f3a80635 tempest-VolumesGetTest-1157460799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:23:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2099aa49-68b5-42c4-9f3e-ee31f3a80635 tempest-VolumesGetTest-1157460799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2099aa49-68b5-42c4-9f3e-ee31f3a80635 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:46 devstack sudo[98902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:23:46 devstack sudo[98902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:46 devstack sudo[98900]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d080ea90-dc13-49bf-83da-e2cc0526b686 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99.1bd07401-a8e9-4b61-8f62-667c351ae4c8" returned: 0 in 0.318s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:46 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-d080ea90-dc13-49bf-83da-e2cc0526b686 tempest-GroupSnapshotsTest-1799889754 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99.1bd07401-a8e9-4b61-8f62-667c351ae4c8 is being set with open permissions: ugo+rw: NotImplementedError Sep 03 11:23:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d080ea90-dc13-49bf-83da-e2cc0526b686 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99.1bd07401-a8e9-4b61-8f62-667c351ae4c8 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:46 devstack sudo[98902]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:46 devstack sudo[98908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99.1bd07401-a8e9-4b61-8f62-667c351ae4c8 Sep 03 11:23:46 devstack sudo[98908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2099aa49-68b5-42c4-9f3e-ee31f3a80635 tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.275s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:46 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-2099aa49-68b5-42c4-9f3e-ee31f3a80635 tempest-VolumesGetTest-1157460799 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:23:46 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-2099aa49-68b5-42c4-9f3e-ee31f3a80635 tempest-VolumesGetTest-1157460799 None] Deleted volume successfully. Sep 03 11:23:46 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2099aa49-68b5-42c4-9f3e-ee31f3a80635 tempest-VolumesGetTest-1157460799 None] Lock "cinder-18bd3219-b2d9-42f6-a9a9-9039d884316d-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:23:46 devstack sudo[98908]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d080ea90-dc13-49bf-83da-e2cc0526b686 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99.1bd07401-a8e9-4b61-8f62-667c351ae4c8" returned: 0 in 0.285s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d080ea90-dc13-49bf-83da-e2cc0526b686 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:47 devstack sudo[98912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99.info Sep 03 11:23:47 devstack sudo[98912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:47 devstack sudo[98912]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d080ea90-dc13-49bf-83da-e2cc0526b686 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99.info" returned: 0 in 0.344s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:47 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-d080ea90-dc13-49bf-83da-e2cc0526b686 tempest-GroupSnapshotsTest-1799889754 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99.info is being set with open permissions: ugo+rw: NotImplementedError Sep 03 11:23:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d080ea90-dc13-49bf-83da-e2cc0526b686 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:47 devstack sudo[98915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99.info Sep 03 11:23:47 devstack sudo[98915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:47 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8eedd748-8ac7-4f26-bad3-6d53623d9f81 tempest-VolumesGetTest-1157460799 None] Acquiring lock "cinder-73190cd8-b9df-4468-bce6-0f945a65a80e-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:23:47 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8eedd748-8ac7-4f26-bad3-6d53623d9f81 tempest-VolumesGetTest-1157460799 None] Lock "cinder-73190cd8-b9df-4468-bce6-0f945a65a80e-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:23:48 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8eedd748-8ac7-4f26-bad3-6d53623d9f81 tempest-VolumesGetTest-1157460799 None] Acquiring lock "cinder-quobyte-73190cd8-b9df-4468-bce6-0f945a65a80e" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:23:48 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8eedd748-8ac7-4f26-bad3-6d53623d9f81 tempest-VolumesGetTest-1157460799 None] Lock "cinder-quobyte-73190cd8-b9df-4468-bce6-0f945a65a80e" acquired by "delete_volume" :: waited 0.042s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:23:48 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c42932f-4721-4f11-8aa4-b99f1c9e9bba]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8eedd748-8ac7-4f26-bad3-6d53623d9f81 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:48 devstack sudo[98915]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d080ea90-dc13-49bf-83da-e2cc0526b686 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99.info" returned: 0 in 0.799s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d080ea90-dc13-49bf-83da-e2cc0526b686 tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.963s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:48 devstack sudo[98961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e Sep 03 11:23:48 devstack sudo[98961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:48 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-d080ea90-dc13-49bf-83da-e2cc0526b686 tempest-GroupSnapshotsTest-1799889754 None] group_snapshot 75741166-8669-4533-be1d-b5cbb06986c7: created successfully Sep 03 11:23:48 devstack sudo[98961]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8eedd748-8ac7-4f26-bad3-6d53623d9f81 tempest-VolumesGetTest-1157460799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e" returned: 0 in 0.703s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8eedd748-8ac7-4f26-bad3-6d53623d9f81 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:48 devstack sudo[98988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e Sep 03 11:23:48 devstack sudo[98988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:48 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-d5b095dc-166d-4bb5-ba64-24eaa45bcdaf tempest-GroupSnapshotsTest-1799889754 None] group_snapshot 75741166-8669-4533-be1d-b5cbb06986c7: deleting Sep 03 11:23:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5b095dc-166d-4bb5-ba64-24eaa45bcdaf tempest-GroupSnapshotsTest-1799889754 None] group_snapshot 75741166-8669-4533-be1d-b5cbb06986c7: deleting {{(pid=87038) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 03 11:23:49 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d5b095dc-166d-4bb5-ba64-24eaa45bcdaf tempest-GroupSnapshotsTest-1799889754 None] Acquiring lock "cinder-quobyte-e129fefa-5b2f-480f-a6e8-0954d0f0ea99" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:23:49 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d5b095dc-166d-4bb5-ba64-24eaa45bcdaf tempest-GroupSnapshotsTest-1799889754 None] Lock "cinder-quobyte-e129fefa-5b2f-480f-a6e8-0954d0f0ea99" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:23:49 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d5b095dc-166d-4bb5-ba64-24eaa45bcdaf tempest-GroupSnapshotsTest-1799889754 None] Acquiring lock "cinder-quobyte-1bd07401-a8e9-4b61-8f62-667c351ae4c8" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:23:49 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d5b095dc-166d-4bb5-ba64-24eaa45bcdaf tempest-GroupSnapshotsTest-1799889754 None] Lock "cinder-quobyte-1bd07401-a8e9-4b61-8f62-667c351ae4c8" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:23:49 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-d5b095dc-166d-4bb5-ba64-24eaa45bcdaf tempest-GroupSnapshotsTest-1799889754 None] Deleting offline snapshot 1bd07401-a8e9-4b61-8f62-667c351ae4c8 of volume e129fefa-5b2f-480f-a6e8-0954d0f0ea99 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:23:49 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-d5b095dc-166d-4bb5-ba64-24eaa45bcdaf tempest-GroupSnapshotsTest-1799889754 None] snapshot_file for this snap is: volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99.1bd07401-a8e9-4b61-8f62-667c351ae4c8 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:23:49 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb7c4ed-c255-4772-9a1a-ea158879d53e]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5b095dc-166d-4bb5-ba64-24eaa45bcdaf tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99.1bd07401-a8e9-4b61-8f62-667c351ae4c8 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:49 devstack sudo[98988]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8eedd748-8ac7-4f26-bad3-6d53623d9f81 tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-73190cd8-b9df-4468-bce6-0f945a65a80e" returned: 0 in 0.647s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:49 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8eedd748-8ac7-4f26-bad3-6d53623d9f81 tempest-VolumesGetTest-1157460799 None] Lock "cinder-quobyte-73190cd8-b9df-4468-bce6-0f945a65a80e" released by "delete_volume" :: held 1.493s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:23:49 devstack sudo[98992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99.1bd07401-a8e9-4b61-8f62-667c351ae4c8 Sep 03 11:23:49 devstack sudo[98992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:49 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-8eedd748-8ac7-4f26-bad3-6d53623d9f81 tempest-VolumesGetTest-1157460799 None] Created reservations ['3e5fd664-4203-4e10-9d35-f467434160a0', '11a40d72-01a3-44f3-b48a-952d2385fd64', 'a1254ec0-7aa0-4b6d-a921-186cd5940f2e', 'bd964429-c0b3-41fb-9ae2-22d781b706a7'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:23:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-8eedd748-8ac7-4f26-bad3-6d53623d9f81 tempest-VolumesGetTest-1157460799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-8eedd748-8ac7-4f26-bad3-6d53623d9f81 tempest-VolumesGetTest-1157460799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:49 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-8eedd748-8ac7-4f26-bad3-6d53623d9f81 tempest-VolumesGetTest-1157460799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:23:49 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-8eedd748-8ac7-4f26-bad3-6d53623d9f81 tempest-VolumesGetTest-1157460799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:23:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-8eedd748-8ac7-4f26-bad3-6d53623d9f81 tempest-VolumesGetTest-1157460799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8eedd748-8ac7-4f26-bad3-6d53623d9f81 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:49 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:23:49 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:50 devstack sudo[98992]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5b095dc-166d-4bb5-ba64-24eaa45bcdaf tempest-GroupSnapshotsTest-1799889754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99.1bd07401-a8e9-4b61-8f62-667c351ae4c8" returned: 0 in 0.815s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:50 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-d5b095dc-166d-4bb5-ba64-24eaa45bcdaf tempest-GroupSnapshotsTest-1799889754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:23:50 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7b9649-1ad1-40e2-b07b-5c6701a8c019]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5b095dc-166d-4bb5-ba64-24eaa45bcdaf tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:50 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8eedd748-8ac7-4f26-bad3-6d53623d9f81 tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.389s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:50 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-8eedd748-8ac7-4f26-bad3-6d53623d9f81 tempest-VolumesGetTest-1157460799 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:23:50 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-8eedd748-8ac7-4f26-bad3-6d53623d9f81 tempest-VolumesGetTest-1157460799 None] Deleted volume successfully. Sep 03 11:23:50 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8eedd748-8ac7-4f26-bad3-6d53623d9f81 tempest-VolumesGetTest-1157460799 None] Lock "cinder-73190cd8-b9df-4468-bce6-0f945a65a80e-delete_volume" released by "delete_volume" :: held 2.470s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:23:50 devstack sudo[99005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99 Sep 03 11:23:50 devstack sudo[99005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:50 devstack sudo[99005]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5b095dc-166d-4bb5-ba64-24eaa45bcdaf tempest-GroupSnapshotsTest-1799889754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99" returned: 0 in 0.647s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5b095dc-166d-4bb5-ba64-24eaa45bcdaf tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99.1bd07401-a8e9-4b61-8f62-667c351ae4c8 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:50 devstack sudo[99010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99.1bd07401-a8e9-4b61-8f62-667c351ae4c8 Sep 03 11:23:50 devstack sudo[99010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:51 devstack sudo[99010]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5b095dc-166d-4bb5-ba64-24eaa45bcdaf tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99.1bd07401-a8e9-4b61-8f62-667c351ae4c8" returned: 0 in 0.566s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5b095dc-166d-4bb5-ba64-24eaa45bcdaf tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99.1bd07401-a8e9-4b61-8f62-667c351ae4c8 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:51 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99.1bd07401-a8e9-4b61-8f62-667c351ae4c8 Sep 03 11:23:51 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:51 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:23:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Flow 'volume_create_manager' (8cd3f378-719e-45f1-be10-5c8f0deead01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:23:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af1d5f6d-ef08-41d8-8e16-932893564214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af1d5f6d-ef08-41d8-8e16-932893564214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1062776802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21286997-5644-48a6-982c-6b196ba9a1cd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d7fa995d29344de194fdbabe2f065b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:23:52Z,use_quota=True,user_id='d977b948c0fd4c27bff72a5c3e2d78d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5627a7fa-7852-419c-8789-5f7c31827a37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5627a7fa-7852-419c-8789-5f7c31827a37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (393c0c83-9720-4af1-a58d-300b74af69f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:51 devstack cinder-volume[87038]: DEBUG cinder.image.glance [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Creating Keystone auth plugin from conf {{(pid=87038) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 11:23:51 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5b095dc-166d-4bb5-ba64-24eaa45bcdaf tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99.1bd07401-a8e9-4b61-8f62-667c351ae4c8" returned: 0 in 0.548s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:52 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d5b095dc-166d-4bb5-ba64-24eaa45bcdaf tempest-GroupSnapshotsTest-1799889754 None] Lock "cinder-quobyte-1bd07401-a8e9-4b61-8f62-667c351ae4c8" released by "_delete_snapshot" :: held 2.814s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:23:52 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d5b095dc-166d-4bb5-ba64-24eaa45bcdaf tempest-GroupSnapshotsTest-1799889754 None] Lock "cinder-quobyte-e129fefa-5b2f-480f-a6e8-0954d0f0ea99" released by "delete_snapshot" :: held 2.849s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:23:52 devstack cinder-volume[87038]: WARNING cinder.quota [None req-d5b095dc-166d-4bb5-ba64-24eaa45bcdaf tempest-GroupSnapshotsTest-1799889754 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-20006509 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-20006509, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:23:52 devstack cinder-volume[87038]: WARNING cinder.quota [None req-d5b095dc-166d-4bb5-ba64-24eaa45bcdaf tempest-GroupSnapshotsTest-1799889754 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-20006509 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-20006509, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:23:52 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-d5b095dc-166d-4bb5-ba64-24eaa45bcdaf tempest-GroupSnapshotsTest-1799889754 None] Created reservations ['e541beba-56ad-49d8-9c13-830ed7fec764', '2fbcbbde-10b7-47a1-b604-2e3409468b81', '4b9f3c1b-d869-42fb-8bfe-9a4a1b411123', 'eaf0e95f-9245-4b9e-8a43-8d42eb12460b'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:23:52 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-d5b095dc-166d-4bb5-ba64-24eaa45bcdaf tempest-GroupSnapshotsTest-1799889754 None] group_snapshot 75741166-8669-4533-be1d-b5cbb06986c7: deleted successfully Sep 03 11:23:52 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (393c0c83-9720-4af1-a58d-300b74af69f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '21286997-5644-48a6-982c-6b196ba9a1cd', 'volume_name': 'volume-21286997-5644-48a6-982c-6b196ba9a1cd', 'volume_size': 1, 'image_id': 'e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72db6f41ce954ca898cc9f539a1cd3c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'created_at': datetime.datetime(2026, 9, 3, 9, 7, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 7, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:52 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ade022-75aa-452c-ba2d-cf67609f6b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:52 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18ade022-75aa-452c-ba2d-cf67609f6b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:52 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36e6d622-1758-4595-97cc-ddf3fd0f31b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:52 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Volume 21286997-5644-48a6-982c-6b196ba9a1cd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-21286997-5644-48a6-982c-6b196ba9a1cd', 'volume_size': 1, 'image_id': 'e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72db6f41ce954ca898cc9f539a1cd3c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'created_at': datetime.datetime(2026, 9, 3, 9, 7, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 7, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 03 11:23:52 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Trying to clone 21286997-5644-48a6-982c-6b196ba9a1cd from image e1b59027-cb2e-4dc7-b35a-2801c7a053de at location (None, [{'url': 'file:///opt/stack/data/glance/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'metadata': {}}]). {{(pid=87038) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 11:23:53 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_bdw8dizydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87038) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 11:23:53 devstack cinder-volume[87038]: INFO cinder.image.image_utils [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Image download 20.69 MB at 20.69 MB/s Sep 03 11:23:53 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[f920f31a-fd6e-4310-baa4-030219abae43]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:53 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-00649831-9dbd-48b6-8af7-3f15f940000f tempest-CinderUnicodeTest-473464386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:23:53 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-00649831-9dbd-48b6-8af7-3f15f940000f tempest-CinderUnicodeTest-473464386 None] Flow 'volume_create_manager' (6fbc0f04-1900-4d0d-89f0-38db54326a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:23:53 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-00649831-9dbd-48b6-8af7-3f15f940000f tempest-CinderUnicodeTest-473464386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eda62f2-d602-45c2-a28a-bb803c4628b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_bdw8dizydevstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:53 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-00649831-9dbd-48b6-8af7-3f15f940000f tempest-CinderUnicodeTest-473464386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2eda62f2-d602-45c2-a28a-bb803c4628b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f89c1b24-b114-4552-893c-dbac7a2b6aea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8f266891f346918d57411c9c7b88ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:23:53Z,use_quota=True,user_id='576a1513063a400b81cd0461c32f40d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:53 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-00649831-9dbd-48b6-8af7-3f15f940000f tempest-CinderUnicodeTest-473464386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a329a9aa-81d7-4931-b7f6-ed2e66f2ddfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:53 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-00649831-9dbd-48b6-8af7-3f15f940000f tempest-CinderUnicodeTest-473464386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a329a9aa-81d7-4931-b7f6-ed2e66f2ddfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:53 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-00649831-9dbd-48b6-8af7-3f15f940000f tempest-CinderUnicodeTest-473464386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d04e84-43ae-41ff-878b-14088483c387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:53 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-00649831-9dbd-48b6-8af7-3f15f940000f tempest-CinderUnicodeTest-473464386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7d04e84-43ae-41ff-878b-14088483c387) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f89c1b24-b114-4552-893c-dbac7a2b6aea', 'volume_name': 'volume-f89c1b24-b114-4552-893c-dbac7a2b6aea', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:53 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-00649831-9dbd-48b6-8af7-3f15f940000f tempest-CinderUnicodeTest-473464386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2873b2ce-b65f-409f-b802-9e19c19b947c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:53 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-00649831-9dbd-48b6-8af7-3f15f940000f tempest-CinderUnicodeTest-473464386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2873b2ce-b65f-409f-b802-9e19c19b947c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:53 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-00649831-9dbd-48b6-8af7-3f15f940000f tempest-CinderUnicodeTest-473464386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c826f8cd-4f7a-4fd5-984b-51018733156c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:53 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-00649831-9dbd-48b6-8af7-3f15f940000f tempest-CinderUnicodeTest-473464386 None] Volume f89c1b24-b114-4552-893c-dbac7a2b6aea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f89c1b24-b114-4552-893c-dbac7a2b6aea', 'volume_size': 1} Sep 03 11:23:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-00649831-9dbd-48b6-8af7-3f15f940000f tempest-CinderUnicodeTest-473464386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-00649831-9dbd-48b6-8af7-3f15f940000f tempest-CinderUnicodeTest-473464386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:53 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-00649831-9dbd-48b6-8af7-3f15f940000f tempest-CinderUnicodeTest-473464386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:23:53Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f89c1b24-b114-4552-893c-dbac7a2b6aea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8f266891f346918d57411c9c7b88ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:23:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:23:53Z,use_quota=True,user_id='576a1513063a400b81cd0461c32f40d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:23:53 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-00649831-9dbd-48b6-8af7-3f15f940000f tempest-CinderUnicodeTest-473464386 None] Creating volume f89c1b24-b114-4552-893c-dbac7a2b6aea {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:23:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-00649831-9dbd-48b6-8af7-3f15f940000f tempest-CinderUnicodeTest-473464386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-00649831-9dbd-48b6-8af7-3f15f940000f tempest-CinderUnicodeTest-473464386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:53 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-00649831-9dbd-48b6-8af7-3f15f940000f tempest-CinderUnicodeTest-473464386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:23:53 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-00649831-9dbd-48b6-8af7-3f15f940000f tempest-CinderUnicodeTest-473464386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:23:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-00649831-9dbd-48b6-8af7-3f15f940000f tempest-CinderUnicodeTest-473464386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:53 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-00649831-9dbd-48b6-8af7-3f15f940000f tempest-CinderUnicodeTest-473464386 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:23:53 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-00649831-9dbd-48b6-8af7-3f15f940000f tempest-CinderUnicodeTest-473464386 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:23:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-00649831-9dbd-48b6-8af7-3f15f940000f tempest-CinderUnicodeTest-473464386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f89c1b24-b114-4552-893c-dbac7a2b6aea 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:53 devstack sudo[99043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_bdw8dizydevstack@QuobyteHD Sep 03 11:23:53 devstack sudo[99043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:53 devstack sudo[99044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f89c1b24-b114-4552-893c-dbac7a2b6aea 1073741824 Sep 03 11:23:53 devstack sudo[99044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:53 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d7ca53e9-2d78-4867-92a2-defc7631dbf1 tempest-GroupSnapshotsTest-1799889754 None] Acquiring lock "cinder-quobyte-e129fefa-5b2f-480f-a6e8-0954d0f0ea99" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:23:53 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d7ca53e9-2d78-4867-92a2-defc7631dbf1 tempest-GroupSnapshotsTest-1799889754 None] Lock "cinder-quobyte-e129fefa-5b2f-480f-a6e8-0954d0f0ea99" acquired by "delete_volume" :: waited 0.029s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:23:53 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef957f6-bf7e-4309-8fd4-5c9624dc5a0f]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d7ca53e9-2d78-4867-92a2-defc7631dbf1 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:53 devstack sudo[99047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99 Sep 03 11:23:53 devstack sudo[99047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:53 devstack sudo[99043]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_bdw8dizydevstack@QuobyteHD" returned: 0 in 0.470s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:53 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Temporary image e1b59027-cb2e-4dc7-b35a-2801c7a053de is fetched for user d977b948c0fd4c27bff72a5c3e2d78d5. {{(pid=87038) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 11:23:53 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9822465-ec80-4a85-81f2-98691e9d23db]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_bdw8dizydevstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:53 devstack sudo[99055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_bdw8dizydevstack@QuobyteHD Sep 03 11:23:53 devstack sudo[99055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:54 devstack sudo[99044]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-00649831-9dbd-48b6-8af7-3f15f940000f tempest-CinderUnicodeTest-473464386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f89c1b24-b114-4552-893c-dbac7a2b6aea 1073741824" returned: 0 in 0.626s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:54 devstack sudo[99047]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d7ca53e9-2d78-4867-92a2-defc7631dbf1 tempest-GroupSnapshotsTest-1799889754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99" returned: 0 in 0.471s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d7ca53e9-2d78-4867-92a2-defc7631dbf1 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-00649831-9dbd-48b6-8af7-3f15f940000f tempest-CinderUnicodeTest-473464386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f89c1b24-b114-4552-893c-dbac7a2b6aea {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:54 devstack sudo[99061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99 Sep 03 11:23:54 devstack sudo[99061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:54 devstack sudo[99062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f89c1b24-b114-4552-893c-dbac7a2b6aea Sep 03 11:23:54 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:54 devstack sudo[99055]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_bdw8dizydevstack@QuobyteHD" returned: 0 in 0.380s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:54 devstack sudo[99061]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:54 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d7ca53e9-2d78-4867-92a2-defc7631dbf1 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e129fefa-5b2f-480f-a6e8-0954d0f0ea99" returned: 0 in 0.304s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-00649831-9dbd-48b6-8af7-3f15f940000f tempest-CinderUnicodeTest-473464386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f89c1b24-b114-4552-893c-dbac7a2b6aea" returned: 0 in 0.273s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:54 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-00649831-9dbd-48b6-8af7-3f15f940000f tempest-CinderUnicodeTest-473464386 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:23:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-00649831-9dbd-48b6-8af7-3f15f940000f tempest-CinderUnicodeTest-473464386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.160s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:54 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1062776802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21286997-5644-48a6-982c-6b196ba9a1cd,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d7fa995d29344de194fdbabe2f065b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:23:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:23:52Z,use_quota=True,user_id='d977b948c0fd4c27bff72a5c3e2d78d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:23:54 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Creating volume 21286997-5644-48a6-982c-6b196ba9a1cd {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:23:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:54 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:23:54 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:23:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:54 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:23:54 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:23:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-21286997-5644-48a6-982c-6b196ba9a1cd 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:54 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d7ca53e9-2d78-4867-92a2-defc7631dbf1 tempest-GroupSnapshotsTest-1799889754 None] Lock "cinder-quobyte-e129fefa-5b2f-480f-a6e8-0954d0f0ea99" released by "delete_volume" :: held 0.912s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:23:54 devstack sudo[99070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-21286997-5644-48a6-982c-6b196ba9a1cd 1073741824 Sep 03 11:23:54 devstack sudo[99070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:54 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-00649831-9dbd-48b6-8af7-3f15f940000f tempest-CinderUnicodeTest-473464386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c826f8cd-4f7a-4fd5-984b-51018733156c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f89c1b24-b114-4552-893c-dbac7a2b6aea', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:54 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-00649831-9dbd-48b6-8af7-3f15f940000f tempest-CinderUnicodeTest-473464386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f22fe02-6af7-4853-958d-41ba1860dc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:54 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-00649831-9dbd-48b6-8af7-3f15f940000f tempest-CinderUnicodeTest-473464386 None] Volume volume-f89c1b24-b114-4552-893c-dbac7a2b6aea (f89c1b24-b114-4552-893c-dbac7a2b6aea): created successfully Sep 03 11:23:54 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-00649831-9dbd-48b6-8af7-3f15f940000f tempest-CinderUnicodeTest-473464386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f22fe02-6af7-4853-958d-41ba1860dc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:54 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-00649831-9dbd-48b6-8af7-3f15f940000f tempest-CinderUnicodeTest-473464386 None] Flow 'volume_create_manager' (6fbc0f04-1900-4d0d-89f0-38db54326a25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:23:54 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-00649831-9dbd-48b6-8af7-3f15f940000f tempest-CinderUnicodeTest-473464386 None] Created volume successfully. Sep 03 11:23:54 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-d7ca53e9-2d78-4867-92a2-defc7631dbf1 tempest-GroupSnapshotsTest-1799889754 None] Created reservations ['ab37d980-b12d-4ef4-befc-b35da7527a0a'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:23:54 devstack cinder-volume[87038]: WARNING cinder.quota [None req-d7ca53e9-2d78-4867-92a2-defc7631dbf1 tempest-GroupSnapshotsTest-1799889754 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-20006509 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-20006509, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:23:54 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-d7ca53e9-2d78-4867-92a2-defc7631dbf1 tempest-GroupSnapshotsTest-1799889754 None] Created reservations ['1af5fe98-0fc8-417d-9814-ba2d2b77ac70', '0a69c7aa-d3bd-4e44-9465-9642dda17398', '0c7fdf37-5f82-4a74-a7d9-b4df0716ca97', 'c890e295-fd26-400d-99ae-95390cbba007'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:23:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d7ca53e9-2d78-4867-92a2-defc7631dbf1 tempest-GroupSnapshotsTest-1799889754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d7ca53e9-2d78-4867-92a2-defc7631dbf1 tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:54 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d7ca53e9-2d78-4867-92a2-defc7631dbf1 tempest-GroupSnapshotsTest-1799889754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:23:54 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d7ca53e9-2d78-4867-92a2-defc7631dbf1 tempest-GroupSnapshotsTest-1799889754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:23:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d7ca53e9-2d78-4867-92a2-defc7631dbf1 tempest-GroupSnapshotsTest-1799889754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d7ca53e9-2d78-4867-92a2-defc7631dbf1 tempest-GroupSnapshotsTest-1799889754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:54 devstack sudo[99076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:23:54 devstack sudo[99076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:54 devstack sudo[99070]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-21286997-5644-48a6-982c-6b196ba9a1cd 1073741824" returned: 0 in 0.538s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-21286997-5644-48a6-982c-6b196ba9a1cd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:54 devstack sudo[99078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-21286997-5644-48a6-982c-6b196ba9a1cd Sep 03 11:23:54 devstack sudo[99078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:55 devstack sudo[99076]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d7ca53e9-2d78-4867-92a2-defc7631dbf1 tempest-GroupSnapshotsTest-1799889754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.310s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:55 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-d7ca53e9-2d78-4867-92a2-defc7631dbf1 tempest-GroupSnapshotsTest-1799889754 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:23:55 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-d7ca53e9-2d78-4867-92a2-defc7631dbf1 tempest-GroupSnapshotsTest-1799889754 None] Delete group completed successfully. Sep 03 11:23:55 devstack sudo[99078]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-21286997-5644-48a6-982c-6b196ba9a1cd" returned: 0 in 0.278s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:55 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] <== create_volume: return (866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:23:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.869s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:55 devstack cinder-volume[87038]: DEBUG cinder.volume.volume_utils [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Attempting download of e1b59027-cb2e-4dc7-b35a-2801c7a053de ((None, [{'url': 'file:///opt/stack/data/glance/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'metadata': {}}])) to volume 21286997-5644-48a6-982c-6b196ba9a1cd. {{(pid=87038) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 11:23:55 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[298e7a57-688d-41ec-804f-55b6672736fc]: (4, 'raw') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1b59027-cb2e-4dc7-b35a-2801c7a053de_4dao3ua1 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:55 devstack sudo[99082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1b59027-cb2e-4dc7-b35a-2801c7a053de_4dao3ua1 Sep 03 11:23:55 devstack sudo[99082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:55 devstack sudo[99082]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1b59027-cb2e-4dc7-b35a-2801c7a053de_4dao3ua1" returned: 0 in 0.365s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1b59027-cb2e-4dc7-b35a-2801c7a053de_4dao3ua1 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:55 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-61a4d605-6532-4496-8e86-b5feab91a3b7 tempest-CinderUnicodeTest-473464386 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:23:55 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-61a4d605-6532-4496-8e86-b5feab91a3b7 tempest-CinderUnicodeTest-473464386 None] Flow 'volume_create_manager' (b5919ab2-2289-48f0-bb63-d9cea4ccc18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:23:55 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-61a4d605-6532-4496-8e86-b5feab91a3b7 tempest-CinderUnicodeTest-473464386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16fa3ae2-dc0d-4f1e-98b2-cdf582c92d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:55 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-61a4d605-6532-4496-8e86-b5feab91a3b7 tempest-CinderUnicodeTest-473464386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16fa3ae2-dc0d-4f1e-98b2-cdf582c92d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:23:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-978714375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5764b322-f91b-49b2-964f-f507c474c9e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8f266891f346918d57411c9c7b88ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:23:56Z,use_quota=True,user_id='576a1513063a400b81cd0461c32f40d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:55 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-61a4d605-6532-4496-8e86-b5feab91a3b7 tempest-CinderUnicodeTest-473464386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (432deebb-48ec-470b-b2dd-44c489b75ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:55 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-61a4d605-6532-4496-8e86-b5feab91a3b7 tempest-CinderUnicodeTest-473464386 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (432deebb-48ec-470b-b2dd-44c489b75ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:55 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-61a4d605-6532-4496-8e86-b5feab91a3b7 tempest-CinderUnicodeTest-473464386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b3a252-f426-40d5-9fec-00b9d0e02f65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:55 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-61a4d605-6532-4496-8e86-b5feab91a3b7 tempest-CinderUnicodeTest-473464386 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b3a252-f426-40d5-9fec-00b9d0e02f65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5764b322-f91b-49b2-964f-f507c474c9e6', 'volume_name': 'volume-5764b322-f91b-49b2-964f-f507c474c9e6', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:55 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-61a4d605-6532-4496-8e86-b5feab91a3b7 tempest-CinderUnicodeTest-473464386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11c1e12e-1847-44c4-94a0-e97d64921d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:55 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-61a4d605-6532-4496-8e86-b5feab91a3b7 tempest-CinderUnicodeTest-473464386 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11c1e12e-1847-44c4-94a0-e97d64921d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:55 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-61a4d605-6532-4496-8e86-b5feab91a3b7 tempest-CinderUnicodeTest-473464386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a1e15e4-ff02-4fa1-a8f4-bd648c9a77bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:55 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-61a4d605-6532-4496-8e86-b5feab91a3b7 tempest-CinderUnicodeTest-473464386 None] Volume 5764b322-f91b-49b2-964f-f507c474c9e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5764b322-f91b-49b2-964f-f507c474c9e6', 'volume_size': 1} Sep 03 11:23:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-61a4d605-6532-4496-8e86-b5feab91a3b7 tempest-CinderUnicodeTest-473464386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-61a4d605-6532-4496-8e86-b5feab91a3b7 tempest-CinderUnicodeTest-473464386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:55 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-61a4d605-6532-4496-8e86-b5feab91a3b7 tempest-CinderUnicodeTest-473464386 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:23:55Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-978714375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5764b322-f91b-49b2-964f-f507c474c9e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c8f266891f346918d57411c9c7b88ed',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:23:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:23:56Z,use_quota=True,user_id='576a1513063a400b81cd0461c32f40d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:23:55 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-61a4d605-6532-4496-8e86-b5feab91a3b7 tempest-CinderUnicodeTest-473464386 None] Creating volume 5764b322-f91b-49b2-964f-f507c474c9e6 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:23:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-61a4d605-6532-4496-8e86-b5feab91a3b7 tempest-CinderUnicodeTest-473464386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-61a4d605-6532-4496-8e86-b5feab91a3b7 tempest-CinderUnicodeTest-473464386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:55 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-61a4d605-6532-4496-8e86-b5feab91a3b7 tempest-CinderUnicodeTest-473464386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:23:55 devstack sudo[99086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1b59027-cb2e-4dc7-b35a-2801c7a053de_4dao3ua1 Sep 03 11:23:55 devstack sudo[99086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:55 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-61a4d605-6532-4496-8e86-b5feab91a3b7 tempest-CinderUnicodeTest-473464386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:23:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-61a4d605-6532-4496-8e86-b5feab91a3b7 tempest-CinderUnicodeTest-473464386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:55 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-61a4d605-6532-4496-8e86-b5feab91a3b7 tempest-CinderUnicodeTest-473464386 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:23:55 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-61a4d605-6532-4496-8e86-b5feab91a3b7 tempest-CinderUnicodeTest-473464386 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:23:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-61a4d605-6532-4496-8e86-b5feab91a3b7 tempest-CinderUnicodeTest-473464386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:55 devstack sudo[99088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6 1073741824 Sep 03 11:23:55 devstack sudo[99088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:56 devstack sudo[99086]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1b59027-cb2e-4dc7-b35a-2801c7a053de_4dao3ua1" returned: 1 in 0.443s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1b59027-cb2e-4dc7-b35a-2801c7a053de_4dao3ua1' failed. Not Retrying. {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:23:56 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8765930-efc0-4a8e-8274-b844f5bfb29f]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_bdw8dizydevstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:56 devstack sudo[99092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_bdw8dizydevstack@QuobyteHD Sep 03 11:23:56 devstack sudo[99092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:56 devstack sudo[99088]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-61a4d605-6532-4496-8e86-b5feab91a3b7 tempest-CinderUnicodeTest-473464386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6 1073741824" returned: 0 in 0.609s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-61a4d605-6532-4496-8e86-b5feab91a3b7 tempest-CinderUnicodeTest-473464386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:56 devstack sudo[99099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6 Sep 03 11:23:56 devstack sudo[99092]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:56 devstack sudo[99099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_bdw8dizydevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:56 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] e1b59027-cb2e-4dc7-b35a-2801c7a053de was qcow2, converting to qcow2 {{(pid=87038) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 11:23:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_bdw8dizydevstack@QuobyteHD /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-21286997-5644-48a6-982c-6b196ba9a1cd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:56 devstack sudo[99103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_bdw8dizydevstack@QuobyteHD /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-21286997-5644-48a6-982c-6b196ba9a1cd Sep 03 11:23:56 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:56 devstack sudo[99099]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-61a4d605-6532-4496-8e86-b5feab91a3b7 tempest-CinderUnicodeTest-473464386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6" returned: 0 in 0.353s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-61a4d605-6532-4496-8e86-b5feab91a3b7 tempest-CinderUnicodeTest-473464386 None] <== create_volume: return (1022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:23:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-61a4d605-6532-4496-8e86-b5feab91a3b7 tempest-CinderUnicodeTest-473464386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:23:56 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-61a4d605-6532-4496-8e86-b5feab91a3b7 tempest-CinderUnicodeTest-473464386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a1e15e4-ff02-4fa1-a8f4-bd648c9a77bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5764b322-f91b-49b2-964f-f507c474c9e6', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:56 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-61a4d605-6532-4496-8e86-b5feab91a3b7 tempest-CinderUnicodeTest-473464386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fae4dabc-f8fa-4670-aa47-d029a3618a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:56 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-61a4d605-6532-4496-8e86-b5feab91a3b7 tempest-CinderUnicodeTest-473464386 None] Volume volume-5764b322-f91b-49b2-964f-f507c474c9e6 (5764b322-f91b-49b2-964f-f507c474c9e6): created successfully Sep 03 11:23:56 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-61a4d605-6532-4496-8e86-b5feab91a3b7 tempest-CinderUnicodeTest-473464386 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fae4dabc-f8fa-4670-aa47-d029a3618a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:56 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-61a4d605-6532-4496-8e86-b5feab91a3b7 tempest-CinderUnicodeTest-473464386 None] Flow 'volume_create_manager' (b5919ab2-2289-48f0-bb63-d9cea4ccc18f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:23:56 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-61a4d605-6532-4496-8e86-b5feab91a3b7 tempest-CinderUnicodeTest-473464386 None] Created volume successfully. Sep 03 11:23:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-23726b76-37ac-4b57-bd95-c768fb27fe92 tempest-CinderUnicodeTest-473464386 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:23:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-23726b76-37ac-4b57-bd95-c768fb27fe92 tempest-CinderUnicodeTest-473464386 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:23:58 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-23726b76-37ac-4b57-bd95-c768fb27fe92 tempest-CinderUnicodeTest-473464386 None] Creating offline snapshot 808c4c65-b276-4de1-8f76-2b31182ab0d6 of volume 5764b322-f91b-49b2-964f-f507c474c9e6 {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:23:58 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[41761c92-3ec9-4ea1-a95d-33b707f0fe26]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:23:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23726b76-37ac-4b57-bd95-c768fb27fe92 tempest-CinderUnicodeTest-473464386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:58 devstack sudo[99115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6 Sep 03 11:23:58 devstack sudo[99115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:58 devstack sudo[99115]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23726b76-37ac-4b57-bd95-c768fb27fe92 tempest-CinderUnicodeTest-473464386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6" returned: 0 in 0.454s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23726b76-37ac-4b57-bd95-c768fb27fe92 tempest-CinderUnicodeTest-473464386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6.808c4c65-b276-4de1-8f76-2b31182ab0d6 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:58 devstack sudo[99122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6.808c4c65-b276-4de1-8f76-2b31182ab0d6 1G Sep 03 11:23:58 devstack sudo[99122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:58 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_bdw8dizydevstack@QuobyteHD /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-21286997-5644-48a6-982c-6b196ba9a1cd" returned: 0 in 2.367s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:58 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_bdw8dizydevstack@QuobyteHD, size 112.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-21286997-5644-48a6-982c-6b196ba9a1cd {{(pid=87038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:23:58 devstack cinder-volume[87038]: INFO cinder.image.image_utils [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Converted 112.00 MB image at 47.28 MB/s Sep 03 11:23:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-21286997-5644-48a6-982c-6b196ba9a1cd 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:58 devstack sudo[99124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-21286997-5644-48a6-982c-6b196ba9a1cd 1G Sep 03 11:23:58 devstack sudo[99124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:59 devstack sudo[99122]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23726b76-37ac-4b57-bd95-c768fb27fe92 tempest-CinderUnicodeTest-473464386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6.808c4c65-b276-4de1-8f76-2b31182ab0d6 1G" returned: 0 in 0.576s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23726b76-37ac-4b57-bd95-c768fb27fe92 tempest-CinderUnicodeTest-473464386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5764b322-f91b-49b2-964f-f507c474c9e6 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6.808c4c65-b276-4de1-8f76-2b31182ab0d6 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:59 devstack sudo[99132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5764b322-f91b-49b2-964f-f507c474c9e6 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6.808c4c65-b276-4de1-8f76-2b31182ab0d6 Sep 03 11:23:59 devstack sudo[99132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:23:59 devstack sudo[99124]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-21286997-5644-48a6-982c-6b196ba9a1cd 1G" returned: 0 in 0.611s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:59 devstack cinder-volume[87038]: DEBUG cinder.volume.volume_utils [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Downloaded image e1b59027-cb2e-4dc7-b35a-2801c7a053de ((None, [{'url': 'file:///opt/stack/data/glance/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'metadata': {}}])) to volume 21286997-5644-48a6-982c-6b196ba9a1cd successfully. {{(pid=87038) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 11:23:59 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Temporary image e1b59027-cb2e-4dc7-b35a-2801c7a053de for user d977b948c0fd4c27bff72a5c3e2d78d5 is deleted. {{(pid=87038) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 11:23:59 devstack cinder-volume[87038]: DEBUG cinder.volume.volume_utils [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Marking volume 21286997-5644-48a6-982c-6b196ba9a1cd as bootable. {{(pid=87038) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 11:23:59 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Copying metadata from image e1b59027-cb2e-4dc7-b35a-2801c7a053de to 21286997-5644-48a6-982c-6b196ba9a1cd. {{(pid=87038) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 11:23:59 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Creating volume glance metadata for volume 21286997-5644-48a6-982c-6b196ba9a1cd backed by image e1b59027-cb2e-4dc7-b35a-2801c7a053de with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87038) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 11:23:59 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36e6d622-1758-4595-97cc-ddf3fd0f31b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21286997-5644-48a6-982c-6b196ba9a1cd', 'volume_size': 1, 'image_id': 'e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72db6f41ce954ca898cc9f539a1cd3c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'created_at': datetime.datetime(2026, 9, 3, 9, 7, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 7, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:59 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a904263-539b-43bc-be23-bc450bb84e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:23:59 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Volume volume-21286997-5644-48a6-982c-6b196ba9a1cd (21286997-5644-48a6-982c-6b196ba9a1cd): created successfully Sep 03 11:23:59 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a904263-539b-43bc-be23-bc450bb84e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:23:59 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Flow 'volume_create_manager' (8cd3f378-719e-45f1-be10-5c8f0deead01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:23:59 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-6e1447a6-6fd8-4cd2-bb6f-ae15a389c6f2 tempest-VolumesGetTest-1157460799 None] Created volume successfully. Sep 03 11:23:59 devstack sudo[99132]: pam_unix(sudo:session): session closed for user root Sep 03 11:23:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23726b76-37ac-4b57-bd95-c768fb27fe92 tempest-CinderUnicodeTest-473464386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5764b322-f91b-49b2-964f-f507c474c9e6 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6.808c4c65-b276-4de1-8f76-2b31182ab0d6" returned: 0 in 0.360s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:23:59 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-23726b76-37ac-4b57-bd95-c768fb27fe92 tempest-CinderUnicodeTest-473464386 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6.808c4c65-b276-4de1-8f76-2b31182ab0d6 is being set with open permissions: ugo+rw Sep 03 11:23:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23726b76-37ac-4b57-bd95-c768fb27fe92 tempest-CinderUnicodeTest-473464386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6.808c4c65-b276-4de1-8f76-2b31182ab0d6 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:23:59 devstack sudo[99141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6.808c4c65-b276-4de1-8f76-2b31182ab0d6 Sep 03 11:23:59 devstack sudo[99141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:00 devstack sudo[99141]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23726b76-37ac-4b57-bd95-c768fb27fe92 tempest-CinderUnicodeTest-473464386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6.808c4c65-b276-4de1-8f76-2b31182ab0d6" returned: 0 in 0.255s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23726b76-37ac-4b57-bd95-c768fb27fe92 tempest-CinderUnicodeTest-473464386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:00 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6.info Sep 03 11:24:00 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:00 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23726b76-37ac-4b57-bd95-c768fb27fe92 tempest-CinderUnicodeTest-473464386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6.info" returned: 0 in 0.285s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:00 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-23726b76-37ac-4b57-bd95-c768fb27fe92 tempest-CinderUnicodeTest-473464386 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6.info is being set with open permissions: ugo+rw Sep 03 11:24:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23726b76-37ac-4b57-bd95-c768fb27fe92 tempest-CinderUnicodeTest-473464386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:00 devstack sudo[99147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6.info Sep 03 11:24:00 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:00 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23726b76-37ac-4b57-bd95-c768fb27fe92 tempest-CinderUnicodeTest-473464386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6.info" returned: 0 in 0.324s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-23726b76-37ac-4b57-bd95-c768fb27fe92 tempest-CinderUnicodeTest-473464386 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.371s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:00 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-23726b76-37ac-4b57-bd95-c768fb27fe92 tempest-CinderUnicodeTest-473464386 None] Create snapshot completed successfully Sep 03 11:24:01 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ecd88cd-5c6b-4c79-8519-c29615a1ab53 tempest-VolumesGetTest-1157460799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:24:01 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1ecd88cd-5c6b-4c79-8519-c29615a1ab53 tempest-VolumesGetTest-1157460799 None] Flow 'volume_create_manager' (faf0c3f4-53ba-4113-972d-968fd14cc31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:24:01 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1ecd88cd-5c6b-4c79-8519-c29615a1ab53 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98bb9195-6a52-49a8-99ef-507245ff3e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:01 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1ecd88cd-5c6b-4c79-8519-c29615a1ab53 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98bb9195-6a52-49a8-99ef-507245ff3e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:24:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1785233277',display_name='tempest-VolumesGetTest-Volume-689584010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80a91bf0-b2a8-42f4-bb76-27ebe95c852e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7fa995d29344de194fdbabe2f065b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:24:01Z,use_quota=True,user_id='d977b948c0fd4c27bff72a5c3e2d78d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:01 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1ecd88cd-5c6b-4c79-8519-c29615a1ab53 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1412c5e5-8cd0-47ea-950f-f98998045372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:01 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1ecd88cd-5c6b-4c79-8519-c29615a1ab53 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1412c5e5-8cd0-47ea-950f-f98998045372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:01 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1ecd88cd-5c6b-4c79-8519-c29615a1ab53 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ca2cbd-b0ab-4426-a8c8-8722e5a3ca14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:01 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1ecd88cd-5c6b-4c79-8519-c29615a1ab53 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ca2cbd-b0ab-4426-a8c8-8722e5a3ca14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '80a91bf0-b2a8-42f4-bb76-27ebe95c852e', 'volume_name': 'volume-80a91bf0-b2a8-42f4-bb76-27ebe95c852e', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:01 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1ecd88cd-5c6b-4c79-8519-c29615a1ab53 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7384065f-4212-4a02-936a-d7e3a8934776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:01 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1ecd88cd-5c6b-4c79-8519-c29615a1ab53 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7384065f-4212-4a02-936a-d7e3a8934776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:01 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1ecd88cd-5c6b-4c79-8519-c29615a1ab53 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c15fdb-2bd1-4eaf-a3ba-5f7ff0e1f527) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:01 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-1ecd88cd-5c6b-4c79-8519-c29615a1ab53 tempest-VolumesGetTest-1157460799 None] Volume 80a91bf0-b2a8-42f4-bb76-27ebe95c852e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-80a91bf0-b2a8-42f4-bb76-27ebe95c852e', 'volume_size': 1} Sep 03 11:24:01 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1ecd88cd-5c6b-4c79-8519-c29615a1ab53 tempest-VolumesGetTest-1157460799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:01 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1ecd88cd-5c6b-4c79-8519-c29615a1ab53 tempest-VolumesGetTest-1157460799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:01 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1ecd88cd-5c6b-4c79-8519-c29615a1ab53 tempest-VolumesGetTest-1157460799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:24:01Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1785233277',display_name='tempest-VolumesGetTest-Volume-689584010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=80a91bf0-b2a8-42f4-bb76-27ebe95c852e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7fa995d29344de194fdbabe2f065b7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:24:01Z,use_quota=True,user_id='d977b948c0fd4c27bff72a5c3e2d78d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:24:01 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-1ecd88cd-5c6b-4c79-8519-c29615a1ab53 tempest-VolumesGetTest-1157460799 None] Creating volume 80a91bf0-b2a8-42f4-bb76-27ebe95c852e {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:24:01 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1ecd88cd-5c6b-4c79-8519-c29615a1ab53 tempest-VolumesGetTest-1157460799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:01 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1ecd88cd-5c6b-4c79-8519-c29615a1ab53 tempest-VolumesGetTest-1157460799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:01 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1ecd88cd-5c6b-4c79-8519-c29615a1ab53 tempest-VolumesGetTest-1157460799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:24:01 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1ecd88cd-5c6b-4c79-8519-c29615a1ab53 tempest-VolumesGetTest-1157460799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:24:01 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1ecd88cd-5c6b-4c79-8519-c29615a1ab53 tempest-VolumesGetTest-1157460799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:01 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1ecd88cd-5c6b-4c79-8519-c29615a1ab53 tempest-VolumesGetTest-1157460799 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:24:01 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-1ecd88cd-5c6b-4c79-8519-c29615a1ab53 tempest-VolumesGetTest-1157460799 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:24:01 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1ecd88cd-5c6b-4c79-8519-c29615a1ab53 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-80a91bf0-b2a8-42f4-bb76-27ebe95c852e 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:01 devstack sudo[99150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-80a91bf0-b2a8-42f4-bb76-27ebe95c852e 1073741824 Sep 03 11:24:01 devstack sudo[99150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:01 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-feb06fc2-d239-4e0b-84b1-b50b683b9e02 tempest-CinderUnicodeTest-473464386 None] Acquiring lock "cinder-808c4c65-b276-4de1-8f76-2b31182ab0d6-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:01 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-feb06fc2-d239-4e0b-84b1-b50b683b9e02 tempest-CinderUnicodeTest-473464386 None] Lock "cinder-808c4c65-b276-4de1-8f76-2b31182ab0d6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:01 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-feb06fc2-d239-4e0b-84b1-b50b683b9e02 tempest-CinderUnicodeTest-473464386 None] Acquiring lock "cinder-quobyte-5764b322-f91b-49b2-964f-f507c474c9e6" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:01 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-feb06fc2-d239-4e0b-84b1-b50b683b9e02 tempest-CinderUnicodeTest-473464386 None] Lock "cinder-quobyte-5764b322-f91b-49b2-964f-f507c474c9e6" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:01 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-feb06fc2-d239-4e0b-84b1-b50b683b9e02 tempest-CinderUnicodeTest-473464386 None] Acquiring lock "cinder-quobyte-808c4c65-b276-4de1-8f76-2b31182ab0d6" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:01 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-feb06fc2-d239-4e0b-84b1-b50b683b9e02 tempest-CinderUnicodeTest-473464386 None] Lock "cinder-quobyte-808c4c65-b276-4de1-8f76-2b31182ab0d6" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:01 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-feb06fc2-d239-4e0b-84b1-b50b683b9e02 tempest-CinderUnicodeTest-473464386 None] Deleting offline snapshot 808c4c65-b276-4de1-8f76-2b31182ab0d6 of volume 5764b322-f91b-49b2-964f-f507c474c9e6 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:24:01 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-feb06fc2-d239-4e0b-84b1-b50b683b9e02 tempest-CinderUnicodeTest-473464386 None] snapshot_file for this snap is: volume-5764b322-f91b-49b2-964f-f507c474c9e6.808c4c65-b276-4de1-8f76-2b31182ab0d6 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:24:01 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e67175-5a12-4169-925f-94e19e34a833]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:24:01 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-feb06fc2-d239-4e0b-84b1-b50b683b9e02 tempest-CinderUnicodeTest-473464386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6.808c4c65-b276-4de1-8f76-2b31182ab0d6 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:01 devstack sudo[99155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6.808c4c65-b276-4de1-8f76-2b31182ab0d6 Sep 03 11:24:01 devstack sudo[99155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:01 devstack sudo[99150]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:01 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1ecd88cd-5c6b-4c79-8519-c29615a1ab53 tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-80a91bf0-b2a8-42f4-bb76-27ebe95c852e 1073741824" returned: 0 in 0.540s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:01 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1ecd88cd-5c6b-4c79-8519-c29615a1ab53 tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-80a91bf0-b2a8-42f4-bb76-27ebe95c852e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:02 devstack sudo[99158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-80a91bf0-b2a8-42f4-bb76-27ebe95c852e Sep 03 11:24:02 devstack sudo[99158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:02 devstack sudo[99155]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-feb06fc2-d239-4e0b-84b1-b50b683b9e02 tempest-CinderUnicodeTest-473464386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6.808c4c65-b276-4de1-8f76-2b31182ab0d6" returned: 0 in 0.521s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:02 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-feb06fc2-d239-4e0b-84b1-b50b683b9e02 tempest-CinderUnicodeTest-473464386 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5764b322-f91b-49b2-964f-f507c474c9e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:24:02 devstack sudo[99158]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1ecd88cd-5c6b-4c79-8519-c29615a1ab53 tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-80a91bf0-b2a8-42f4-bb76-27ebe95c852e" returned: 0 in 0.323s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:02 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1ecd88cd-5c6b-4c79-8519-c29615a1ab53 tempest-VolumesGetTest-1157460799 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:24:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1ecd88cd-5c6b-4c79-8519-c29615a1ab53 tempest-VolumesGetTest-1157460799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:02 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1ecd88cd-5c6b-4c79-8519-c29615a1ab53 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47c15fdb-2bd1-4eaf-a3ba-5f7ff0e1f527) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-80a91bf0-b2a8-42f4-bb76-27ebe95c852e', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:02 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1ecd88cd-5c6b-4c79-8519-c29615a1ab53 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94e4ed7e-c6ec-462c-9437-3a67f418cb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:02 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc33931b-f2c9-48ee-9950-847c2f746844]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:24:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-feb06fc2-d239-4e0b-84b1-b50b683b9e02 tempest-CinderUnicodeTest-473464386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:02 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-1ecd88cd-5c6b-4c79-8519-c29615a1ab53 tempest-VolumesGetTest-1157460799 None] Volume volume-80a91bf0-b2a8-42f4-bb76-27ebe95c852e (80a91bf0-b2a8-42f4-bb76-27ebe95c852e): created successfully Sep 03 11:24:02 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1ecd88cd-5c6b-4c79-8519-c29615a1ab53 tempest-VolumesGetTest-1157460799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94e4ed7e-c6ec-462c-9437-3a67f418cb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:02 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1ecd88cd-5c6b-4c79-8519-c29615a1ab53 tempest-VolumesGetTest-1157460799 None] Flow 'volume_create_manager' (faf0c3f4-53ba-4113-972d-968fd14cc31f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:24:02 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-1ecd88cd-5c6b-4c79-8519-c29615a1ab53 tempest-VolumesGetTest-1157460799 None] Created volume successfully. Sep 03 11:24:02 devstack sudo[99164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6 Sep 03 11:24:02 devstack sudo[99164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:02 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-660a745c-de5f-4068-8c8e-5863b79bb9b6 tempest-VolumesNegativeTest-491497304 None] Acquiring lock "cinder-ac3f20dc-e6ff-4a90-be8b-f34d5cbfc4df-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:02 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-660a745c-de5f-4068-8c8e-5863b79bb9b6 tempest-VolumesNegativeTest-491497304 None] Lock "cinder-ac3f20dc-e6ff-4a90-be8b-f34d5cbfc4df-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:02 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-660a745c-de5f-4068-8c8e-5863b79bb9b6 tempest-VolumesNegativeTest-491497304 None] Acquiring lock "cinder-quobyte-ac3f20dc-e6ff-4a90-be8b-f34d5cbfc4df" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:02 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-660a745c-de5f-4068-8c8e-5863b79bb9b6 tempest-VolumesNegativeTest-491497304 None] Lock "cinder-quobyte-ac3f20dc-e6ff-4a90-be8b-f34d5cbfc4df" acquired by "delete_volume" :: waited 0.019s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:02 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[773dbdb8-6c21-4197-9c6f-b90152f682a1]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:24:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-660a745c-de5f-4068-8c8e-5863b79bb9b6 tempest-VolumesNegativeTest-491497304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac3f20dc-e6ff-4a90-be8b-f34d5cbfc4df {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:02 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac3f20dc-e6ff-4a90-be8b-f34d5cbfc4df Sep 03 11:24:02 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:02 devstack sudo[99164]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-feb06fc2-d239-4e0b-84b1-b50b683b9e02 tempest-CinderUnicodeTest-473464386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6" returned: 0 in 0.440s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-feb06fc2-d239-4e0b-84b1-b50b683b9e02 tempest-CinderUnicodeTest-473464386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6.808c4c65-b276-4de1-8f76-2b31182ab0d6 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:02 devstack sudo[99172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6.808c4c65-b276-4de1-8f76-2b31182ab0d6 Sep 03 11:24:02 devstack sudo[99172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:02 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-660a745c-de5f-4068-8c8e-5863b79bb9b6 tempest-VolumesNegativeTest-491497304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac3f20dc-e6ff-4a90-be8b-f34d5cbfc4df" returned: 0 in 0.406s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-660a745c-de5f-4068-8c8e-5863b79bb9b6 tempest-VolumesNegativeTest-491497304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac3f20dc-e6ff-4a90-be8b-f34d5cbfc4df {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:03 devstack sudo[99177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac3f20dc-e6ff-4a90-be8b-f34d5cbfc4df Sep 03 11:24:03 devstack sudo[99177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:03 devstack sudo[99172]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-feb06fc2-d239-4e0b-84b1-b50b683b9e02 tempest-CinderUnicodeTest-473464386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6.808c4c65-b276-4de1-8f76-2b31182ab0d6" returned: 0 in 0.435s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-feb06fc2-d239-4e0b-84b1-b50b683b9e02 tempest-CinderUnicodeTest-473464386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6.808c4c65-b276-4de1-8f76-2b31182ab0d6 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:03 devstack sudo[99184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6.808c4c65-b276-4de1-8f76-2b31182ab0d6 Sep 03 11:24:03 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:03 devstack sudo[99177]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-660a745c-de5f-4068-8c8e-5863b79bb9b6 tempest-VolumesNegativeTest-491497304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ac3f20dc-e6ff-4a90-be8b-f34d5cbfc4df" returned: 0 in 0.335s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:03 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-660a745c-de5f-4068-8c8e-5863b79bb9b6 tempest-VolumesNegativeTest-491497304 None] Lock "cinder-quobyte-ac3f20dc-e6ff-4a90-be8b-f34d5cbfc4df" released by "delete_volume" :: held 0.788s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:03 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-660a745c-de5f-4068-8c8e-5863b79bb9b6 tempest-VolumesNegativeTest-491497304 None] Created reservations ['905801ee-ebce-4328-ae38-54bfb4cb2271', '3fefd4fe-34a3-435d-843b-9d6eaa3df836', 'd57c86f8-5ec9-4e87-bc79-728f25645894', 'aa68769e-febf-429b-9900-029548d94313'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:24:03 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-feb06fc2-d239-4e0b-84b1-b50b683b9e02 tempest-CinderUnicodeTest-473464386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6.808c4c65-b276-4de1-8f76-2b31182ab0d6" returned: 0 in 0.302s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:03 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-feb06fc2-d239-4e0b-84b1-b50b683b9e02 tempest-CinderUnicodeTest-473464386 None] Lock "cinder-quobyte-808c4c65-b276-4de1-8f76-2b31182ab0d6" released by "_delete_snapshot" :: held 1.893s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:03 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-feb06fc2-d239-4e0b-84b1-b50b683b9e02 tempest-CinderUnicodeTest-473464386 None] Lock "cinder-quobyte-5764b322-f91b-49b2-964f-f507c474c9e6" released by "delete_snapshot" :: held 1.926s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-660a745c-de5f-4068-8c8e-5863b79bb9b6 tempest-VolumesNegativeTest-491497304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-660a745c-de5f-4068-8c8e-5863b79bb9b6 tempest-VolumesNegativeTest-491497304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:03 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-660a745c-de5f-4068-8c8e-5863b79bb9b6 tempest-VolumesNegativeTest-491497304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:24:03 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-660a745c-de5f-4068-8c8e-5863b79bb9b6 tempest-VolumesNegativeTest-491497304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:24:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-660a745c-de5f-4068-8c8e-5863b79bb9b6 tempest-VolumesNegativeTest-491497304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-660a745c-de5f-4068-8c8e-5863b79bb9b6 tempest-VolumesNegativeTest-491497304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:03 devstack sudo[99189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:24:03 devstack sudo[99189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:03 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-feb06fc2-d239-4e0b-84b1-b50b683b9e02 tempest-CinderUnicodeTest-473464386 None] Created reservations ['daf388be-1aa2-43f3-a701-f24706e7c159', '1404088e-59d5-4f62-90f6-9962d585e6cc', 'ca079872-1d6d-41f3-8ac3-a38a131f26d9', '6102c612-2664-4175-b91d-da15351c1073'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:24:03 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1084f4c0-bf9e-4201-9550-72068e9e59ad tempest-VolumesGetTest-1157460799 None] Acquiring lock "cinder-80a91bf0-b2a8-42f4-bb76-27ebe95c852e-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:03 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1084f4c0-bf9e-4201-9550-72068e9e59ad tempest-VolumesGetTest-1157460799 None] Lock "cinder-80a91bf0-b2a8-42f4-bb76-27ebe95c852e-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:03 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1084f4c0-bf9e-4201-9550-72068e9e59ad tempest-VolumesGetTest-1157460799 None] Acquiring lock "cinder-quobyte-80a91bf0-b2a8-42f4-bb76-27ebe95c852e" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:03 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-feb06fc2-d239-4e0b-84b1-b50b683b9e02 tempest-CinderUnicodeTest-473464386 None] Delete snapshot completed successfully. Sep 03 11:24:03 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1084f4c0-bf9e-4201-9550-72068e9e59ad tempest-VolumesGetTest-1157460799 None] Lock "cinder-quobyte-80a91bf0-b2a8-42f4-bb76-27ebe95c852e" acquired by "delete_volume" :: waited 0.035s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:03 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-feb06fc2-d239-4e0b-84b1-b50b683b9e02 tempest-CinderUnicodeTest-473464386 None] Lock "cinder-808c4c65-b276-4de1-8f76-2b31182ab0d6-delete_snapshot" released by "delete_snapshot" :: held 2.344s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:04 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea753533-d24d-4ab5-9ad9-5cdb9ba355a6]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:24:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1084f4c0-bf9e-4201-9550-72068e9e59ad tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-80a91bf0-b2a8-42f4-bb76-27ebe95c852e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:04 devstack sudo[99189]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-660a745c-de5f-4068-8c8e-5863b79bb9b6 tempest-VolumesNegativeTest-491497304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.378s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:04 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-660a745c-de5f-4068-8c8e-5863b79bb9b6 tempest-VolumesNegativeTest-491497304 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:24:04 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-660a745c-de5f-4068-8c8e-5863b79bb9b6 tempest-VolumesNegativeTest-491497304 None] Deleted volume successfully. Sep 03 11:24:04 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-660a745c-de5f-4068-8c8e-5863b79bb9b6 tempest-VolumesNegativeTest-491497304 None] Lock "cinder-ac3f20dc-e6ff-4a90-be8b-f34d5cbfc4df-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:04 devstack sudo[99192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-80a91bf0-b2a8-42f4-bb76-27ebe95c852e Sep 03 11:24:04 devstack sudo[99192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:04 devstack sudo[99192]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1084f4c0-bf9e-4201-9550-72068e9e59ad tempest-VolumesGetTest-1157460799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-80a91bf0-b2a8-42f4-bb76-27ebe95c852e" returned: 0 in 0.458s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1084f4c0-bf9e-4201-9550-72068e9e59ad tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-80a91bf0-b2a8-42f4-bb76-27ebe95c852e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:04 devstack sudo[99197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-80a91bf0-b2a8-42f4-bb76-27ebe95c852e Sep 03 11:24:04 devstack sudo[99197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:04 devstack sudo[99197]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1084f4c0-bf9e-4201-9550-72068e9e59ad tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-80a91bf0-b2a8-42f4-bb76-27ebe95c852e" returned: 0 in 0.308s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:04 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1084f4c0-bf9e-4201-9550-72068e9e59ad tempest-VolumesGetTest-1157460799 None] Lock "cinder-quobyte-80a91bf0-b2a8-42f4-bb76-27ebe95c852e" released by "delete_volume" :: held 0.841s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:04 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-1084f4c0-bf9e-4201-9550-72068e9e59ad tempest-VolumesGetTest-1157460799 None] Created reservations ['212c35bf-508e-463b-98ba-71d1bc1e2f0b', 'f969a904-08be-40a0-8c67-ae41960cf149', '4f9d263f-d15e-413d-b995-1af63410d50f', '8008d617-877e-4e5e-89c7-ff3f9c713744'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:24:04 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-840a0b23-5f01-44b8-99d5-5e921a177100 tempest-CinderUnicodeTest-473464386 None] Acquiring lock "cinder-5764b322-f91b-49b2-964f-f507c474c9e6-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1084f4c0-bf9e-4201-9550-72068e9e59ad tempest-VolumesGetTest-1157460799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1084f4c0-bf9e-4201-9550-72068e9e59ad tempest-VolumesGetTest-1157460799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:04 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1084f4c0-bf9e-4201-9550-72068e9e59ad tempest-VolumesGetTest-1157460799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:24:05 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1084f4c0-bf9e-4201-9550-72068e9e59ad tempest-VolumesGetTest-1157460799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:24:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1084f4c0-bf9e-4201-9550-72068e9e59ad tempest-VolumesGetTest-1157460799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1084f4c0-bf9e-4201-9550-72068e9e59ad tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:05 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-840a0b23-5f01-44b8-99d5-5e921a177100 tempest-CinderUnicodeTest-473464386 None] Lock "cinder-5764b322-f91b-49b2-964f-f507c474c9e6-delete_volume" acquired by "delete_volume" :: waited 0.078s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:05 devstack sudo[99200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:24:05 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:05 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-840a0b23-5f01-44b8-99d5-5e921a177100 tempest-CinderUnicodeTest-473464386 None] Acquiring lock "cinder-quobyte-5764b322-f91b-49b2-964f-f507c474c9e6" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:05 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-208793cb-8eab-4465-9c88-dd9cce24d9ba tempest-VolumesGetTest-1157460799 None] Acquiring lock "cinder-21286997-5644-48a6-982c-6b196ba9a1cd-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:05 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-840a0b23-5f01-44b8-99d5-5e921a177100 tempest-CinderUnicodeTest-473464386 None] Lock "cinder-quobyte-5764b322-f91b-49b2-964f-f507c474c9e6" acquired by "delete_volume" :: waited 0.042s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:05 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[57abac8e-c135-4bf7-857a-68f4945cc867]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:24:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-840a0b23-5f01-44b8-99d5-5e921a177100 tempest-CinderUnicodeTest-473464386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:05 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-208793cb-8eab-4465-9c88-dd9cce24d9ba tempest-VolumesGetTest-1157460799 None] Lock "cinder-21286997-5644-48a6-982c-6b196ba9a1cd-delete_volume" acquired by "delete_volume" :: waited 0.128s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:05 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=168,cinder:UPDATE=222,cinder:INSERT=58,cinder:DELETE=14 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:24:05 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:UPDATE=194,cinder:SELECT=188,cinder:DELETE=13,cinder:INSERT=62 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:24:05 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-208793cb-8eab-4465-9c88-dd9cce24d9ba tempest-VolumesGetTest-1157460799 None] Acquiring lock "cinder-quobyte-21286997-5644-48a6-982c-6b196ba9a1cd" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:05 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1084f4c0-bf9e-4201-9550-72068e9e59ad tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.378s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:05 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-1084f4c0-bf9e-4201-9550-72068e9e59ad tempest-VolumesGetTest-1157460799 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:24:05 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-208793cb-8eab-4465-9c88-dd9cce24d9ba tempest-VolumesGetTest-1157460799 None] Lock "cinder-quobyte-21286997-5644-48a6-982c-6b196ba9a1cd" acquired by "delete_volume" :: waited 0.026s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:05 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-1084f4c0-bf9e-4201-9550-72068e9e59ad tempest-VolumesGetTest-1157460799 None] Deleted volume successfully. Sep 03 11:24:05 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b819d5-67b4-4eaa-ae7d-e96d7cba3f58]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:24:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-208793cb-8eab-4465-9c88-dd9cce24d9ba tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-21286997-5644-48a6-982c-6b196ba9a1cd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:05 devstack sudo[99202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6 Sep 03 11:24:05 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:05 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1084f4c0-bf9e-4201-9550-72068e9e59ad tempest-VolumesGetTest-1157460799 None] Lock "cinder-80a91bf0-b2a8-42f4-bb76-27ebe95c852e-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:05 devstack sudo[99204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-21286997-5644-48a6-982c-6b196ba9a1cd Sep 03 11:24:05 devstack sudo[99204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:05 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-840a0b23-5f01-44b8-99d5-5e921a177100 tempest-CinderUnicodeTest-473464386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6" returned: 0 in 0.524s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-840a0b23-5f01-44b8-99d5-5e921a177100 tempest-CinderUnicodeTest-473464386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:05 devstack sudo[99210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6 Sep 03 11:24:05 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:05 devstack sudo[99204]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-208793cb-8eab-4465-9c88-dd9cce24d9ba tempest-VolumesGetTest-1157460799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-21286997-5644-48a6-982c-6b196ba9a1cd" returned: 0 in 0.501s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-208793cb-8eab-4465-9c88-dd9cce24d9ba tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-21286997-5644-48a6-982c-6b196ba9a1cd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:05 devstack sudo[99215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-21286997-5644-48a6-982c-6b196ba9a1cd Sep 03 11:24:05 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:06 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-840a0b23-5f01-44b8-99d5-5e921a177100 tempest-CinderUnicodeTest-473464386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5764b322-f91b-49b2-964f-f507c474c9e6" returned: 0 in 0.296s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:06 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-840a0b23-5f01-44b8-99d5-5e921a177100 tempest-CinderUnicodeTest-473464386 None] Lock "cinder-quobyte-5764b322-f91b-49b2-964f-f507c474c9e6" released by "delete_volume" :: held 0.951s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:06 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-840a0b23-5f01-44b8-99d5-5e921a177100 tempest-CinderUnicodeTest-473464386 None] Created reservations ['63d3f4e7-739a-4e52-8b96-b31c6e4057b1', '03ae8f0b-4b1c-4735-91fd-84083c5b9db5', '9a1a09b9-5d9c-40f4-a9d0-ecb313686f97', 'cb492065-7bc6-4ecb-8009-54bde9b44ea3'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:24:06 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-208793cb-8eab-4465-9c88-dd9cce24d9ba tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-21286997-5644-48a6-982c-6b196ba9a1cd" returned: 0 in 0.326s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:06 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-208793cb-8eab-4465-9c88-dd9cce24d9ba tempest-VolumesGetTest-1157460799 None] Lock "cinder-quobyte-21286997-5644-48a6-982c-6b196ba9a1cd" released by "delete_volume" :: held 0.902s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-840a0b23-5f01-44b8-99d5-5e921a177100 tempest-CinderUnicodeTest-473464386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-840a0b23-5f01-44b8-99d5-5e921a177100 tempest-CinderUnicodeTest-473464386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:06 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-840a0b23-5f01-44b8-99d5-5e921a177100 tempest-CinderUnicodeTest-473464386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:24:06 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-840a0b23-5f01-44b8-99d5-5e921a177100 tempest-CinderUnicodeTest-473464386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:24:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-840a0b23-5f01-44b8-99d5-5e921a177100 tempest-CinderUnicodeTest-473464386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-840a0b23-5f01-44b8-99d5-5e921a177100 tempest-CinderUnicodeTest-473464386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:06 devstack sudo[99219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:24:06 devstack sudo[99219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:06 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-208793cb-8eab-4465-9c88-dd9cce24d9ba tempest-VolumesGetTest-1157460799 None] Created reservations ['6c5ea91c-1f01-4276-820d-6bdf3fb9bac5', '052632b1-0599-40c1-9f0b-90bbcddfcbc0', '0213e218-b461-42c1-b848-15946052f40e', '458ef0ab-63b1-4745-9259-184de5731bb0'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:24:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-208793cb-8eab-4465-9c88-dd9cce24d9ba tempest-VolumesGetTest-1157460799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-208793cb-8eab-4465-9c88-dd9cce24d9ba tempest-VolumesGetTest-1157460799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:06 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-208793cb-8eab-4465-9c88-dd9cce24d9ba tempest-VolumesGetTest-1157460799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:24:06 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-208793cb-8eab-4465-9c88-dd9cce24d9ba tempest-VolumesGetTest-1157460799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:24:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-208793cb-8eab-4465-9c88-dd9cce24d9ba tempest-VolumesGetTest-1157460799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-208793cb-8eab-4465-9c88-dd9cce24d9ba tempest-VolumesGetTest-1157460799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:06 devstack sudo[99221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:24:06 devstack sudo[99221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:06 devstack sudo[99219]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-840a0b23-5f01-44b8-99d5-5e921a177100 tempest-CinderUnicodeTest-473464386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.316s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:06 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-840a0b23-5f01-44b8-99d5-5e921a177100 tempest-CinderUnicodeTest-473464386 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:24:06 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-840a0b23-5f01-44b8-99d5-5e921a177100 tempest-CinderUnicodeTest-473464386 None] Deleted volume successfully. Sep 03 11:24:06 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-840a0b23-5f01-44b8-99d5-5e921a177100 tempest-CinderUnicodeTest-473464386 None] Lock "cinder-5764b322-f91b-49b2-964f-f507c474c9e6-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:06 devstack sudo[99221]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-208793cb-8eab-4465-9c88-dd9cce24d9ba tempest-VolumesGetTest-1157460799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.321s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:06 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-208793cb-8eab-4465-9c88-dd9cce24d9ba tempest-VolumesGetTest-1157460799 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:24:06 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-208793cb-8eab-4465-9c88-dd9cce24d9ba tempest-VolumesGetTest-1157460799 None] Deleted volume successfully. Sep 03 11:24:06 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-208793cb-8eab-4465-9c88-dd9cce24d9ba tempest-VolumesGetTest-1157460799 None] Lock "cinder-21286997-5644-48a6-982c-6b196ba9a1cd-delete_volume" released by "delete_volume" :: held 1.618s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:07 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-85fe68fa-a3ed-43ea-8dce-fe82650372bd tempest-CinderUnicodeTest-473464386 None] Acquiring lock "cinder-f89c1b24-b114-4552-893c-dbac7a2b6aea-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:07 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-85fe68fa-a3ed-43ea-8dce-fe82650372bd tempest-CinderUnicodeTest-473464386 None] Lock "cinder-f89c1b24-b114-4552-893c-dbac7a2b6aea-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:07 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-85fe68fa-a3ed-43ea-8dce-fe82650372bd tempest-CinderUnicodeTest-473464386 None] Acquiring lock "cinder-quobyte-f89c1b24-b114-4552-893c-dbac7a2b6aea" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:07 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-85fe68fa-a3ed-43ea-8dce-fe82650372bd tempest-CinderUnicodeTest-473464386 None] Lock "cinder-quobyte-f89c1b24-b114-4552-893c-dbac7a2b6aea" acquired by "delete_volume" :: waited 0.036s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:07 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f47ca4-77cf-4138-a63e-25d64a602d3b]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:24:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-85fe68fa-a3ed-43ea-8dce-fe82650372bd tempest-CinderUnicodeTest-473464386 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f89c1b24-b114-4552-893c-dbac7a2b6aea {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:07 devstack sudo[99225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f89c1b24-b114-4552-893c-dbac7a2b6aea Sep 03 11:24:07 devstack sudo[99225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:08 devstack sudo[99225]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-85fe68fa-a3ed-43ea-8dce-fe82650372bd tempest-CinderUnicodeTest-473464386 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f89c1b24-b114-4552-893c-dbac7a2b6aea" returned: 0 in 0.550s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-85fe68fa-a3ed-43ea-8dce-fe82650372bd tempest-CinderUnicodeTest-473464386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f89c1b24-b114-4552-893c-dbac7a2b6aea {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:08 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f89c1b24-b114-4552-893c-dbac7a2b6aea Sep 03 11:24:08 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:08 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-85fe68fa-a3ed-43ea-8dce-fe82650372bd tempest-CinderUnicodeTest-473464386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f89c1b24-b114-4552-893c-dbac7a2b6aea" returned: 0 in 0.365s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-85fe68fa-a3ed-43ea-8dce-fe82650372bd tempest-CinderUnicodeTest-473464386 None] Lock "cinder-quobyte-f89c1b24-b114-4552-893c-dbac7a2b6aea" released by "delete_volume" :: held 0.966s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:08 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-85fe68fa-a3ed-43ea-8dce-fe82650372bd tempest-CinderUnicodeTest-473464386 None] Created reservations ['2eedaf8c-233c-4abb-b43a-0c7b3c953802', '19419523-67ef-4ed8-8402-c5410d34187b', '151cee6d-07d6-4120-9c9c-f99e0cc3de5b', 'c625261a-7aba-49c5-b47d-8682f37ca258'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:24:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-85fe68fa-a3ed-43ea-8dce-fe82650372bd tempest-CinderUnicodeTest-473464386 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-85fe68fa-a3ed-43ea-8dce-fe82650372bd tempest-CinderUnicodeTest-473464386 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-85fe68fa-a3ed-43ea-8dce-fe82650372bd tempest-CinderUnicodeTest-473464386 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:24:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-85fe68fa-a3ed-43ea-8dce-fe82650372bd tempest-CinderUnicodeTest-473464386 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:24:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-85fe68fa-a3ed-43ea-8dce-fe82650372bd tempest-CinderUnicodeTest-473464386 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-85fe68fa-a3ed-43ea-8dce-fe82650372bd tempest-CinderUnicodeTest-473464386 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:08 devstack sudo[99234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:24:08 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:08 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-85fe68fa-a3ed-43ea-8dce-fe82650372bd tempest-CinderUnicodeTest-473464386 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.341s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:08 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-85fe68fa-a3ed-43ea-8dce-fe82650372bd tempest-CinderUnicodeTest-473464386 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:24:08 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-8b20e019-223c-4f79-a0b6-c10e791e06e0 tempest-GroupsTest-1650119900 None] Group tempest-Group1-573923540: creating Sep 03 11:24:08 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-85fe68fa-a3ed-43ea-8dce-fe82650372bd tempest-CinderUnicodeTest-473464386 None] Deleted volume successfully. Sep 03 11:24:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-85fe68fa-a3ed-43ea-8dce-fe82650372bd tempest-CinderUnicodeTest-473464386 None] Lock "cinder-f89c1b24-b114-4552-893c-dbac7a2b6aea-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:08 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-8b20e019-223c-4f79-a0b6-c10e791e06e0 tempest-GroupsTest-1650119900 None] Group tempest-Group1-573923540: created successfully Sep 03 11:24:09 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-8b20e019-223c-4f79-a0b6-c10e791e06e0 tempest-GroupsTest-1650119900 None] Create group completed successfully. Sep 03 11:24:10 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-cf1992df-9906-4fbc-8644-99f88e449311 tempest-GroupsTest-1650119900 None] Group tempest-Group2-1099172897: creating Sep 03 11:24:10 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-cf1992df-9906-4fbc-8644-99f88e449311 tempest-GroupsTest-1650119900 None] Group tempest-Group2-1099172897: created successfully Sep 03 11:24:10 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-cf1992df-9906-4fbc-8644-99f88e449311 tempest-GroupsTest-1650119900 None] Create group completed successfully. Sep 03 11:24:11 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-c58e85e1-f41f-4333-b0fb-fd8ca4ddebb0 tempest-VolumesSnapshotListTestJSON-83446071 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:24:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c58e85e1-f41f-4333-b0fb-fd8ca4ddebb0 tempest-VolumesSnapshotListTestJSON-83446071 None] Flow 'volume_create_manager' (03a673d2-4191-42f9-b9cf-ab7db54dbdb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:24:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c58e85e1-f41f-4333-b0fb-fd8ca4ddebb0 tempest-VolumesSnapshotListTestJSON-83446071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d9a825-a5f3-40a9-aaba-bb3410ac3fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c58e85e1-f41f-4333-b0fb-fd8ca4ddebb0 tempest-VolumesSnapshotListTestJSON-83446071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d9a825-a5f3-40a9-aaba-bb3410ac3fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1489265665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45dd0e57-740f-49b8-96eb-88fe00a8b98f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='222e8fab18724f74a9d4e2e4391365ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:24:11Z,use_quota=True,user_id='45bf6fb33c2e43f8a29e086abf6541f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c58e85e1-f41f-4333-b0fb-fd8ca4ddebb0 tempest-VolumesSnapshotListTestJSON-83446071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f57c20ac-4584-49a5-bad5-4eaeffe50c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c58e85e1-f41f-4333-b0fb-fd8ca4ddebb0 tempest-VolumesSnapshotListTestJSON-83446071 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f57c20ac-4584-49a5-bad5-4eaeffe50c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c58e85e1-f41f-4333-b0fb-fd8ca4ddebb0 tempest-VolumesSnapshotListTestJSON-83446071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcdc8114-bb72-4914-8ec3-0d2c5a722acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c58e85e1-f41f-4333-b0fb-fd8ca4ddebb0 tempest-VolumesSnapshotListTestJSON-83446071 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcdc8114-bb72-4914-8ec3-0d2c5a722acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45dd0e57-740f-49b8-96eb-88fe00a8b98f', 'volume_name': 'volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c58e85e1-f41f-4333-b0fb-fd8ca4ddebb0 tempest-VolumesSnapshotListTestJSON-83446071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e8a592e-383d-46cc-a1d0-9cfb95145d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c58e85e1-f41f-4333-b0fb-fd8ca4ddebb0 tempest-VolumesSnapshotListTestJSON-83446071 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e8a592e-383d-46cc-a1d0-9cfb95145d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c58e85e1-f41f-4333-b0fb-fd8ca4ddebb0 tempest-VolumesSnapshotListTestJSON-83446071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (866aee07-6cf9-4110-adf2-04f3bb396dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:11 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-c58e85e1-f41f-4333-b0fb-fd8ca4ddebb0 tempest-VolumesSnapshotListTestJSON-83446071 None] Volume 45dd0e57-740f-49b8-96eb-88fe00a8b98f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f', 'volume_size': 1} Sep 03 11:24:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-c58e85e1-f41f-4333-b0fb-fd8ca4ddebb0 tempest-VolumesSnapshotListTestJSON-83446071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-c58e85e1-f41f-4333-b0fb-fd8ca4ddebb0 tempest-VolumesSnapshotListTestJSON-83446071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-c58e85e1-f41f-4333-b0fb-fd8ca4ddebb0 tempest-VolumesSnapshotListTestJSON-83446071 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:24:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1489265665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45dd0e57-740f-49b8-96eb-88fe00a8b98f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='222e8fab18724f74a9d4e2e4391365ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:24:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:24:11Z,use_quota=True,user_id='45bf6fb33c2e43f8a29e086abf6541f1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:24:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-c58e85e1-f41f-4333-b0fb-fd8ca4ddebb0 tempest-VolumesSnapshotListTestJSON-83446071 None] Creating volume 45dd0e57-740f-49b8-96eb-88fe00a8b98f {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:24:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-c58e85e1-f41f-4333-b0fb-fd8ca4ddebb0 tempest-VolumesSnapshotListTestJSON-83446071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-c58e85e1-f41f-4333-b0fb-fd8ca4ddebb0 tempest-VolumesSnapshotListTestJSON-83446071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-c58e85e1-f41f-4333-b0fb-fd8ca4ddebb0 tempest-VolumesSnapshotListTestJSON-83446071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:24:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-c58e85e1-f41f-4333-b0fb-fd8ca4ddebb0 tempest-VolumesSnapshotListTestJSON-83446071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:24:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-c58e85e1-f41f-4333-b0fb-fd8ca4ddebb0 tempest-VolumesSnapshotListTestJSON-83446071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-c58e85e1-f41f-4333-b0fb-fd8ca4ddebb0 tempest-VolumesSnapshotListTestJSON-83446071 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:24:11 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-c58e85e1-f41f-4333-b0fb-fd8ca4ddebb0 tempest-VolumesSnapshotListTestJSON-83446071 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:24:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c58e85e1-f41f-4333-b0fb-fd8ca4ddebb0 tempest-VolumesSnapshotListTestJSON-83446071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:11 devstack sudo[99237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f 1073741824 Sep 03 11:24:11 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:12 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-05dce0b3-2d68-4a31-a3af-2565b9948cdb tempest-GroupsTest-1650119900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:24:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-05dce0b3-2d68-4a31-a3af-2565b9948cdb tempest-GroupsTest-1650119900 None] Flow 'volume_create_manager' (68323881-83d4-44f5-9401-cca7876c78dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:24:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-05dce0b3-2d68-4a31-a3af-2565b9948cdb tempest-GroupsTest-1650119900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad488639-2b3b-4dfd-abe0-51f60136e59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-05dce0b3-2d68-4a31-a3af-2565b9948cdb tempest-GroupsTest-1650119900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad488639-2b3b-4dfd-abe0-51f60136e59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-611390764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a91a49d4-7cbd-4682-9bd1-6a3c2572845a,host='devstack@QuobyteHD#QuobyteHD',id=407954d6-6ce7-468c-9b4c-6d5ec19f5551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee01a3549311419ebc3b8f8d64197416',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:24:12Z,use_quota=True,user_id='39d7f26e72c2456194cff88709b05598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea73bc6a-151c-4d5f-ac7b-99ccb3e874a9),volume_type_id=ea73bc6a-151c-4d5f-ac7b-99ccb3e874a9)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-05dce0b3-2d68-4a31-a3af-2565b9948cdb tempest-GroupsTest-1650119900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (365c8988-40c4-4493-b9e4-68dbcca8f955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-05dce0b3-2d68-4a31-a3af-2565b9948cdb tempest-GroupsTest-1650119900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (365c8988-40c4-4493-b9e4-68dbcca8f955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-05dce0b3-2d68-4a31-a3af-2565b9948cdb tempest-GroupsTest-1650119900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b45afe4-0912-46ce-8aaa-3dbf16aa164d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-05dce0b3-2d68-4a31-a3af-2565b9948cdb tempest-GroupsTest-1650119900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b45afe4-0912-46ce-8aaa-3dbf16aa164d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '407954d6-6ce7-468c-9b4c-6d5ec19f5551', 'volume_name': 'volume-407954d6-6ce7-468c-9b4c-6d5ec19f5551', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-05dce0b3-2d68-4a31-a3af-2565b9948cdb tempest-GroupsTest-1650119900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b4cfd4d-257d-47e2-a58a-59efc7b161fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-05dce0b3-2d68-4a31-a3af-2565b9948cdb tempest-GroupsTest-1650119900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b4cfd4d-257d-47e2-a58a-59efc7b161fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-05dce0b3-2d68-4a31-a3af-2565b9948cdb tempest-GroupsTest-1650119900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a079dd-f902-4366-83fc-55d00de2ba0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:12 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-05dce0b3-2d68-4a31-a3af-2565b9948cdb tempest-GroupsTest-1650119900 None] Volume 407954d6-6ce7-468c-9b4c-6d5ec19f5551: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-407954d6-6ce7-468c-9b4c-6d5ec19f5551', 'volume_size': 1} Sep 03 11:24:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-05dce0b3-2d68-4a31-a3af-2565b9948cdb tempest-GroupsTest-1650119900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:12 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c58e85e1-f41f-4333-b0fb-fd8ca4ddebb0 tempest-VolumesSnapshotListTestJSON-83446071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f 1073741824" returned: 0 in 0.870s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c58e85e1-f41f-4333-b0fb-fd8ca4ddebb0 tempest-VolumesSnapshotListTestJSON-83446071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:12 devstack sudo[99243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f Sep 03 11:24:12 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:12 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c58e85e1-f41f-4333-b0fb-fd8ca4ddebb0 tempest-VolumesSnapshotListTestJSON-83446071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f" returned: 0 in 0.293s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-c58e85e1-f41f-4333-b0fb-fd8ca4ddebb0 tempest-VolumesSnapshotListTestJSON-83446071 None] <== create_volume: return (1211ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:24:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-c58e85e1-f41f-4333-b0fb-fd8ca4ddebb0 tempest-VolumesSnapshotListTestJSON-83446071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.214s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-05dce0b3-2d68-4a31-a3af-2565b9948cdb tempest-GroupsTest-1650119900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.345s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-05dce0b3-2d68-4a31-a3af-2565b9948cdb tempest-GroupsTest-1650119900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a91a49d4-7cbd-4682-9bd1-6a3c2572845a,created_at=2026-09-03T09:24:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-611390764',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a91a49d4-7cbd-4682-9bd1-6a3c2572845a,host='devstack@QuobyteHD#QuobyteHD',id=407954d6-6ce7-468c-9b4c-6d5ec19f5551,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee01a3549311419ebc3b8f8d64197416',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:24:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:24:12Z,use_quota=True,user_id='39d7f26e72c2456194cff88709b05598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea73bc6a-151c-4d5f-ac7b-99ccb3e874a9),volume_type_id=ea73bc6a-151c-4d5f-ac7b-99ccb3e874a9)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:24:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-05dce0b3-2d68-4a31-a3af-2565b9948cdb tempest-GroupsTest-1650119900 None] Creating volume 407954d6-6ce7-468c-9b4c-6d5ec19f5551 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:24:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-05dce0b3-2d68-4a31-a3af-2565b9948cdb tempest-GroupsTest-1650119900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-05dce0b3-2d68-4a31-a3af-2565b9948cdb tempest-GroupsTest-1650119900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-05dce0b3-2d68-4a31-a3af-2565b9948cdb tempest-GroupsTest-1650119900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:24:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-05dce0b3-2d68-4a31-a3af-2565b9948cdb tempest-GroupsTest-1650119900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:24:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-05dce0b3-2d68-4a31-a3af-2565b9948cdb tempest-GroupsTest-1650119900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-05dce0b3-2d68-4a31-a3af-2565b9948cdb tempest-GroupsTest-1650119900 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:24:12 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-05dce0b3-2d68-4a31-a3af-2565b9948cdb tempest-GroupsTest-1650119900 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:24:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-05dce0b3-2d68-4a31-a3af-2565b9948cdb tempest-GroupsTest-1650119900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-407954d6-6ce7-468c-9b4c-6d5ec19f5551 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c58e85e1-f41f-4333-b0fb-fd8ca4ddebb0 tempest-VolumesSnapshotListTestJSON-83446071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (866aee07-6cf9-4110-adf2-04f3bb396dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c58e85e1-f41f-4333-b0fb-fd8ca4ddebb0 tempest-VolumesSnapshotListTestJSON-83446071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e24f61-6810-4fc2-876a-13876651a1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:12 devstack sudo[99246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-407954d6-6ce7-468c-9b4c-6d5ec19f5551 1073741824 Sep 03 11:24:12 devstack sudo[99246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:12 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-c58e85e1-f41f-4333-b0fb-fd8ca4ddebb0 tempest-VolumesSnapshotListTestJSON-83446071 None] Volume volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f (45dd0e57-740f-49b8-96eb-88fe00a8b98f): created successfully Sep 03 11:24:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c58e85e1-f41f-4333-b0fb-fd8ca4ddebb0 tempest-VolumesSnapshotListTestJSON-83446071 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e24f61-6810-4fc2-876a-13876651a1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c58e85e1-f41f-4333-b0fb-fd8ca4ddebb0 tempest-VolumesSnapshotListTestJSON-83446071 None] Flow 'volume_create_manager' (03a673d2-4191-42f9-b9cf-ab7db54dbdb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:24:12 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-c58e85e1-f41f-4333-b0fb-fd8ca4ddebb0 tempest-VolumesSnapshotListTestJSON-83446071 None] Created volume successfully. Sep 03 11:24:13 devstack sudo[99246]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-05dce0b3-2d68-4a31-a3af-2565b9948cdb tempest-GroupsTest-1650119900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-407954d6-6ce7-468c-9b4c-6d5ec19f5551 1073741824" returned: 0 in 0.616s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-05dce0b3-2d68-4a31-a3af-2565b9948cdb tempest-GroupsTest-1650119900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-407954d6-6ce7-468c-9b4c-6d5ec19f5551 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:13 devstack sudo[99253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-407954d6-6ce7-468c-9b4c-6d5ec19f5551 Sep 03 11:24:13 devstack sudo[99253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-cd7f4224-02ab-4125-bf80-3e7c43c1cb00 tempest-VolumesSnapshotListTestJSON-83446071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:13 devstack sudo[99253]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-05dce0b3-2d68-4a31-a3af-2565b9948cdb tempest-GroupsTest-1650119900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-407954d6-6ce7-468c-9b4c-6d5ec19f5551" returned: 0 in 0.378s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:13 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-05dce0b3-2d68-4a31-a3af-2565b9948cdb tempest-GroupsTest-1650119900 None] <== create_volume: return (1075ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:24:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-05dce0b3-2d68-4a31-a3af-2565b9948cdb tempest-GroupsTest-1650119900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-cd7f4224-02ab-4125-bf80-3e7c43c1cb00 tempest-VolumesSnapshotListTestJSON-83446071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.040s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:13 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-05dce0b3-2d68-4a31-a3af-2565b9948cdb tempest-GroupsTest-1650119900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8a079dd-f902-4366-83fc-55d00de2ba0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-407954d6-6ce7-468c-9b4c-6d5ec19f5551', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:13 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-05dce0b3-2d68-4a31-a3af-2565b9948cdb tempest-GroupsTest-1650119900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b69236a-af20-44b9-8b5e-79eb2c567ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:13 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-cd7f4224-02ab-4125-bf80-3e7c43c1cb00 tempest-VolumesSnapshotListTestJSON-83446071 None] Creating offline snapshot 03f1f028-f107-4127-88f1-4c52b028d00f of volume 45dd0e57-740f-49b8-96eb-88fe00a8b98f {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:24:13 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-05dce0b3-2d68-4a31-a3af-2565b9948cdb tempest-GroupsTest-1650119900 None] Volume volume-407954d6-6ce7-468c-9b4c-6d5ec19f5551 (407954d6-6ce7-468c-9b4c-6d5ec19f5551): created successfully Sep 03 11:24:13 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-05dce0b3-2d68-4a31-a3af-2565b9948cdb tempest-GroupsTest-1650119900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b69236a-af20-44b9-8b5e-79eb2c567ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:13 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-05dce0b3-2d68-4a31-a3af-2565b9948cdb tempest-GroupsTest-1650119900 None] Flow 'volume_create_manager' (68323881-83d4-44f5-9401-cca7876c78dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:24:14 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[b219bb11-322e-46f7-8812-cd75b11ee99f]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:24:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cd7f4224-02ab-4125-bf80-3e7c43c1cb00 tempest-VolumesSnapshotListTestJSON-83446071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:14 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-05dce0b3-2d68-4a31-a3af-2565b9948cdb tempest-GroupsTest-1650119900 None] Created volume successfully. Sep 03 11:24:14 devstack sudo[99256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f Sep 03 11:24:14 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:14 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cd7f4224-02ab-4125-bf80-3e7c43c1cb00 tempest-VolumesSnapshotListTestJSON-83446071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f" returned: 0 in 0.472s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cd7f4224-02ab-4125-bf80-3e7c43c1cb00 tempest-VolumesSnapshotListTestJSON-83446071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.03f1f028-f107-4127-88f1-4c52b028d00f 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:14 devstack sudo[99261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.03f1f028-f107-4127-88f1-4c52b028d00f 1G Sep 03 11:24:14 devstack sudo[99261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:15 devstack sudo[99261]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cd7f4224-02ab-4125-bf80-3e7c43c1cb00 tempest-VolumesSnapshotListTestJSON-83446071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.03f1f028-f107-4127-88f1-4c52b028d00f 1G" returned: 0 in 0.716s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cd7f4224-02ab-4125-bf80-3e7c43c1cb00 tempest-VolumesSnapshotListTestJSON-83446071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.03f1f028-f107-4127-88f1-4c52b028d00f {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:15 devstack sudo[99267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.03f1f028-f107-4127-88f1-4c52b028d00f Sep 03 11:24:15 devstack sudo[99267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:15 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-90c86ef0-bac5-4d42-8267-9d68e4fb8b8a tempest-GroupsTest-1650119900 None] Acquiring lock "cinder-quobyte-407954d6-6ce7-468c-9b4c-6d5ec19f5551" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:15 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-90c86ef0-bac5-4d42-8267-9d68e4fb8b8a tempest-GroupsTest-1650119900 None] Lock "cinder-quobyte-407954d6-6ce7-468c-9b4c-6d5ec19f5551" acquired by "delete_volume" :: waited 0.033s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:15 devstack sudo[99267]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cd7f4224-02ab-4125-bf80-3e7c43c1cb00 tempest-VolumesSnapshotListTestJSON-83446071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.03f1f028-f107-4127-88f1-4c52b028d00f" returned: 0 in 0.497s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:15 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-cd7f4224-02ab-4125-bf80-3e7c43c1cb00 tempest-VolumesSnapshotListTestJSON-83446071 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.03f1f028-f107-4127-88f1-4c52b028d00f is being set with open permissions: ugo+rw Sep 03 11:24:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cd7f4224-02ab-4125-bf80-3e7c43c1cb00 tempest-VolumesSnapshotListTestJSON-83446071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.03f1f028-f107-4127-88f1-4c52b028d00f {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:15 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[b45e4abf-24ef-4f8f-90db-4da02a1e4a28]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:24:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90c86ef0-bac5-4d42-8267-9d68e4fb8b8a tempest-GroupsTest-1650119900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-407954d6-6ce7-468c-9b4c-6d5ec19f5551 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:15 devstack sudo[99273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.03f1f028-f107-4127-88f1-4c52b028d00f Sep 03 11:24:15 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:15 devstack sudo[99274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-407954d6-6ce7-468c-9b4c-6d5ec19f5551 Sep 03 11:24:15 devstack sudo[99274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:16 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cd7f4224-02ab-4125-bf80-3e7c43c1cb00 tempest-VolumesSnapshotListTestJSON-83446071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.03f1f028-f107-4127-88f1-4c52b028d00f" returned: 0 in 0.369s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cd7f4224-02ab-4125-bf80-3e7c43c1cb00 tempest-VolumesSnapshotListTestJSON-83446071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:16 devstack sudo[99280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.info Sep 03 11:24:16 devstack sudo[99280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:16 devstack sudo[99274]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90c86ef0-bac5-4d42-8267-9d68e4fb8b8a tempest-GroupsTest-1650119900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-407954d6-6ce7-468c-9b4c-6d5ec19f5551" returned: 0 in 0.492s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90c86ef0-bac5-4d42-8267-9d68e4fb8b8a tempest-GroupsTest-1650119900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-407954d6-6ce7-468c-9b4c-6d5ec19f5551 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:16 devstack sudo[99284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-407954d6-6ce7-468c-9b4c-6d5ec19f5551 Sep 03 11:24:16 devstack sudo[99284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:16 devstack sudo[99280]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cd7f4224-02ab-4125-bf80-3e7c43c1cb00 tempest-VolumesSnapshotListTestJSON-83446071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.info" returned: 0 in 0.404s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:16 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-cd7f4224-02ab-4125-bf80-3e7c43c1cb00 tempest-VolumesSnapshotListTestJSON-83446071 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.info is being set with open permissions: ugo+rw Sep 03 11:24:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cd7f4224-02ab-4125-bf80-3e7c43c1cb00 tempest-VolumesSnapshotListTestJSON-83446071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:16 devstack sudo[99321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.info Sep 03 11:24:16 devstack sudo[99321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:16 devstack sudo[99284]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90c86ef0-bac5-4d42-8267-9d68e4fb8b8a tempest-GroupsTest-1650119900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-407954d6-6ce7-468c-9b4c-6d5ec19f5551" returned: 0 in 0.481s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:16 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-90c86ef0-bac5-4d42-8267-9d68e4fb8b8a tempest-GroupsTest-1650119900 None] Lock "cinder-quobyte-407954d6-6ce7-468c-9b4c-6d5ec19f5551" released by "delete_volume" :: held 1.041s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:16 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-90c86ef0-bac5-4d42-8267-9d68e4fb8b8a tempest-GroupsTest-1650119900 None] Created reservations ['a5329848-0590-442e-b806-90aa68d6fd84'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:24:16 devstack cinder-volume[87038]: WARNING cinder.quota [None req-90c86ef0-bac5-4d42-8267-9d68e4fb8b8a tempest-GroupsTest-1650119900 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-992109348 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-992109348, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:24:16 devstack cinder-volume[87038]: WARNING cinder.quota [None req-90c86ef0-bac5-4d42-8267-9d68e4fb8b8a tempest-GroupsTest-1650119900 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-992109348 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-992109348, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:24:16 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-90c86ef0-bac5-4d42-8267-9d68e4fb8b8a tempest-GroupsTest-1650119900 None] Created reservations ['06ba1fd5-32ab-4044-843b-a78219361581', '147481a0-9676-472a-87d4-07aadaebb384', 'aa34bc19-f9d9-4fa2-bbca-f6243559d4ab', '1e06f175-fd2b-4177-ae69-21313d571b71'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:24:16 devstack sudo[99321]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cd7f4224-02ab-4125-bf80-3e7c43c1cb00 tempest-VolumesSnapshotListTestJSON-83446071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.info" returned: 0 in 0.446s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-cd7f4224-02ab-4125-bf80-3e7c43c1cb00 tempest-VolumesSnapshotListTestJSON-83446071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.085s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:17 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-cd7f4224-02ab-4125-bf80-3e7c43c1cb00 tempest-VolumesSnapshotListTestJSON-83446071 None] Create snapshot completed successfully Sep 03 11:24:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-90c86ef0-bac5-4d42-8267-9d68e4fb8b8a tempest-GroupsTest-1650119900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-90c86ef0-bac5-4d42-8267-9d68e4fb8b8a tempest-GroupsTest-1650119900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-90c86ef0-bac5-4d42-8267-9d68e4fb8b8a tempest-GroupsTest-1650119900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:24:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-90c86ef0-bac5-4d42-8267-9d68e4fb8b8a tempest-GroupsTest-1650119900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:24:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-90c86ef0-bac5-4d42-8267-9d68e4fb8b8a tempest-GroupsTest-1650119900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90c86ef0-bac5-4d42-8267-9d68e4fb8b8a tempest-GroupsTest-1650119900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:17 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:24:17 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:17 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-0f2f8c84-5f71-414e-84f5-590faaea5e87 tempest-GroupsTest-1650119900 None] Created reservations ['5eef806f-eb25-48a3-af2c-e88bcbfc53b5'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:24:17 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0f2f8c84-5f71-414e-84f5-590faaea5e87 tempest-GroupsTest-1650119900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0f2f8c84-5f71-414e-84f5-590faaea5e87 tempest-GroupsTest-1650119900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0f2f8c84-5f71-414e-84f5-590faaea5e87 tempest-GroupsTest-1650119900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:24:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0f2f8c84-5f71-414e-84f5-590faaea5e87 tempest-GroupsTest-1650119900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:24:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0f2f8c84-5f71-414e-84f5-590faaea5e87 tempest-GroupsTest-1650119900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0f2f8c84-5f71-414e-84f5-590faaea5e87 tempest-GroupsTest-1650119900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-90c86ef0-bac5-4d42-8267-9d68e4fb8b8a tempest-GroupsTest-1650119900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.419s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:17 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-90c86ef0-bac5-4d42-8267-9d68e4fb8b8a tempest-GroupsTest-1650119900 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:24:17 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-90c86ef0-bac5-4d42-8267-9d68e4fb8b8a tempest-GroupsTest-1650119900 None] Delete group completed successfully. Sep 03 11:24:17 devstack sudo[99330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:24:17 devstack sudo[99330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:17 devstack sudo[99330]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0f2f8c84-5f71-414e-84f5-590faaea5e87 tempest-GroupsTest-1650119900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.334s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:17 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-0f2f8c84-5f71-414e-84f5-590faaea5e87 tempest-GroupsTest-1650119900 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:24:17 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-0f2f8c84-5f71-414e-84f5-590faaea5e87 tempest-GroupsTest-1650119900 None] Delete group completed successfully. Sep 03 11:24:17 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:24:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:24:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:24:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:17 devstack sudo[99333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:24:17 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:18 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.308s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:18 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:24:18 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:24:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread count: 28 {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:24:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread info: [<_MainThread(MainThread, started 139554943000704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:24:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1149e971-1b13-4acf-b9d8-c9e1eed42599 tempest-VolumesSnapshotListTestJSON-83446071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1149e971-1b13-4acf-b9d8-c9e1eed42599 tempest-VolumesSnapshotListTestJSON-83446071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:18 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-1149e971-1b13-4acf-b9d8-c9e1eed42599 tempest-VolumesSnapshotListTestJSON-83446071 None] Creating offline snapshot 1697372a-9c1c-464e-8dce-5312c10bb8f5 of volume 45dd0e57-740f-49b8-96eb-88fe00a8b98f {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:24:18 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[82384943-1e48-4c2a-ade9-fc8e7222c195]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:24:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1149e971-1b13-4acf-b9d8-c9e1eed42599 tempest-VolumesSnapshotListTestJSON-83446071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.03f1f028-f107-4127-88f1-4c52b028d00f {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:18 devstack sudo[99337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.03f1f028-f107-4127-88f1-4c52b028d00f Sep 03 11:24:18 devstack sudo[99337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:18 devstack sudo[99337]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1149e971-1b13-4acf-b9d8-c9e1eed42599 tempest-VolumesSnapshotListTestJSON-83446071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.03f1f028-f107-4127-88f1-4c52b028d00f" returned: 0 in 0.475s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:18 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-1149e971-1b13-4acf-b9d8-c9e1eed42599 tempest-VolumesSnapshotListTestJSON-83446071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:24:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1149e971-1b13-4acf-b9d8-c9e1eed42599 tempest-VolumesSnapshotListTestJSON-83446071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.03f1f028-f107-4127-88f1-4c52b028d00f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.1697372a-9c1c-464e-8dce-5312c10bb8f5 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:19 devstack sudo[99342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.03f1f028-f107-4127-88f1-4c52b028d00f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.1697372a-9c1c-464e-8dce-5312c10bb8f5 1G Sep 03 11:24:19 devstack sudo[99342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:19 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-eb869ba9-62fa-49e1-8168-eeb8607bd295 tempest-GroupsTest-1650119900 None] Group tempest-GroupsTest-Group-1502068993: creating Sep 03 11:24:19 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-eb869ba9-62fa-49e1-8168-eeb8607bd295 tempest-GroupsTest-1650119900 None] Group tempest-GroupsTest-Group-1502068993: created successfully Sep 03 11:24:19 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-eb869ba9-62fa-49e1-8168-eeb8607bd295 tempest-GroupsTest-1650119900 None] Create group completed successfully. Sep 03 11:24:19 devstack sudo[99342]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1149e971-1b13-4acf-b9d8-c9e1eed42599 tempest-VolumesSnapshotListTestJSON-83446071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.03f1f028-f107-4127-88f1-4c52b028d00f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.1697372a-9c1c-464e-8dce-5312c10bb8f5 1G" returned: 0 in 0.652s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1149e971-1b13-4acf-b9d8-c9e1eed42599 tempest-VolumesSnapshotListTestJSON-83446071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.03f1f028-f107-4127-88f1-4c52b028d00f -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.1697372a-9c1c-464e-8dce-5312c10bb8f5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:19 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.03f1f028-f107-4127-88f1-4c52b028d00f -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.1697372a-9c1c-464e-8dce-5312c10bb8f5 Sep 03 11:24:19 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:19 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1149e971-1b13-4acf-b9d8-c9e1eed42599 tempest-VolumesSnapshotListTestJSON-83446071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.03f1f028-f107-4127-88f1-4c52b028d00f -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.1697372a-9c1c-464e-8dce-5312c10bb8f5" returned: 0 in 0.342s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:19 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-1149e971-1b13-4acf-b9d8-c9e1eed42599 tempest-VolumesSnapshotListTestJSON-83446071 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.1697372a-9c1c-464e-8dce-5312c10bb8f5 is being set with open permissions: ugo+rw Sep 03 11:24:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1149e971-1b13-4acf-b9d8-c9e1eed42599 tempest-VolumesSnapshotListTestJSON-83446071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.1697372a-9c1c-464e-8dce-5312c10bb8f5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:20 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.1697372a-9c1c-464e-8dce-5312c10bb8f5 Sep 03 11:24:20 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:20 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1149e971-1b13-4acf-b9d8-c9e1eed42599 tempest-VolumesSnapshotListTestJSON-83446071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.1697372a-9c1c-464e-8dce-5312c10bb8f5" returned: 0 in 0.416s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1149e971-1b13-4acf-b9d8-c9e1eed42599 tempest-VolumesSnapshotListTestJSON-83446071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.028s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:20 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-1149e971-1b13-4acf-b9d8-c9e1eed42599 tempest-VolumesSnapshotListTestJSON-83446071 None] Create snapshot completed successfully Sep 03 11:24:20 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-6de918dc-aa3c-4164-ae62-7cacd9ef656c tempest-GroupsTest-1650119900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:24:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6de918dc-aa3c-4164-ae62-7cacd9ef656c tempest-GroupsTest-1650119900 None] Flow 'volume_create_manager' (3d8acbf0-e914-4275-bcd4-1f81034a6443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:24:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6de918dc-aa3c-4164-ae62-7cacd9ef656c tempest-GroupsTest-1650119900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d4f1d8-db9e-4101-9445-5530cbb1e9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6de918dc-aa3c-4164-ae62-7cacd9ef656c tempest-GroupsTest-1650119900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44d4f1d8-db9e-4101-9445-5530cbb1e9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1236832106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8aa440f1-44e0-4966-95e3-aafb11d0339d,host='devstack@QuobyteHD#QuobyteHD',id=c4d8e52e-1099-418f-be31-2f5536696f33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee01a3549311419ebc3b8f8d64197416',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:24:21Z,use_quota=True,user_id='39d7f26e72c2456194cff88709b05598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f752edd-2cd0-4df7-91f5-4a2f2a21ebc9),volume_type_id=7f752edd-2cd0-4df7-91f5-4a2f2a21ebc9)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6de918dc-aa3c-4164-ae62-7cacd9ef656c tempest-GroupsTest-1650119900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1511b2e7-0641-4bd0-8997-7dfbee5ca488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6de918dc-aa3c-4164-ae62-7cacd9ef656c tempest-GroupsTest-1650119900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1511b2e7-0641-4bd0-8997-7dfbee5ca488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6de918dc-aa3c-4164-ae62-7cacd9ef656c tempest-GroupsTest-1650119900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ee3137-147d-4f47-8363-ade293cff8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6de918dc-aa3c-4164-ae62-7cacd9ef656c tempest-GroupsTest-1650119900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ee3137-147d-4f47-8363-ade293cff8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4d8e52e-1099-418f-be31-2f5536696f33', 'volume_name': 'volume-c4d8e52e-1099-418f-be31-2f5536696f33', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6de918dc-aa3c-4164-ae62-7cacd9ef656c tempest-GroupsTest-1650119900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0a3f549-41af-4ef8-8eb0-2f52b63b5217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6de918dc-aa3c-4164-ae62-7cacd9ef656c tempest-GroupsTest-1650119900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0a3f549-41af-4ef8-8eb0-2f52b63b5217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6de918dc-aa3c-4164-ae62-7cacd9ef656c tempest-GroupsTest-1650119900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73ce0279-c470-4b55-af05-452dc3b1aa24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:21 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-6de918dc-aa3c-4164-ae62-7cacd9ef656c tempest-GroupsTest-1650119900 None] Volume c4d8e52e-1099-418f-be31-2f5536696f33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4d8e52e-1099-418f-be31-2f5536696f33', 'volume_size': 1} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6de918dc-aa3c-4164-ae62-7cacd9ef656c tempest-GroupsTest-1650119900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6de918dc-aa3c-4164-ae62-7cacd9ef656c tempest-GroupsTest-1650119900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6de918dc-aa3c-4164-ae62-7cacd9ef656c tempest-GroupsTest-1650119900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8aa440f1-44e0-4966-95e3-aafb11d0339d,created_at=2026-09-03T09:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1236832106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8aa440f1-44e0-4966-95e3-aafb11d0339d,host='devstack@QuobyteHD#QuobyteHD',id=c4d8e52e-1099-418f-be31-2f5536696f33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee01a3549311419ebc3b8f8d64197416',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:24:21Z,use_quota=True,user_id='39d7f26e72c2456194cff88709b05598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f752edd-2cd0-4df7-91f5-4a2f2a21ebc9),volume_type_id=7f752edd-2cd0-4df7-91f5-4a2f2a21ebc9)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-6de918dc-aa3c-4164-ae62-7cacd9ef656c tempest-GroupsTest-1650119900 None] Creating volume c4d8e52e-1099-418f-be31-2f5536696f33 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6de918dc-aa3c-4164-ae62-7cacd9ef656c tempest-GroupsTest-1650119900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6de918dc-aa3c-4164-ae62-7cacd9ef656c tempest-GroupsTest-1650119900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6de918dc-aa3c-4164-ae62-7cacd9ef656c tempest-GroupsTest-1650119900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6de918dc-aa3c-4164-ae62-7cacd9ef656c tempest-GroupsTest-1650119900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6de918dc-aa3c-4164-ae62-7cacd9ef656c tempest-GroupsTest-1650119900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6de918dc-aa3c-4164-ae62-7cacd9ef656c tempest-GroupsTest-1650119900 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:24:21 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-6de918dc-aa3c-4164-ae62-7cacd9ef656c tempest-GroupsTest-1650119900 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6de918dc-aa3c-4164-ae62-7cacd9ef656c tempest-GroupsTest-1650119900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c4d8e52e-1099-418f-be31-2f5536696f33 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:21 devstack sudo[99356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c4d8e52e-1099-418f-be31-2f5536696f33 1073741824 Sep 03 11:24:21 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ba9b77d-0948-49c1-8732-d2cb963624ef tempest-ProjectReaderTests-366065509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6ba9b77d-0948-49c1-8732-d2cb963624ef tempest-ProjectReaderTests-366065509 None] Flow 'volume_create_manager' (0be55198-e148-4527-9978-5cd99fd250af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6ba9b77d-0948-49c1-8732-d2cb963624ef tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a9c1037-a202-4f54-95d4-811828f8db1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b1c7a4b1-1368-4f75-9d1d-187059de5399 tempest-VolumesSnapshotListTestJSON-83446071 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6ba9b77d-0948-49c1-8732-d2cb963624ef tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a9c1037-a202-4f54-95d4-811828f8db1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1197782509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d8f69ef-a9e3-4d34-808e-b10031839618,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e0266a286845c09b90954957712518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:24:21Z,use_quota=True,user_id='68876a5fbdc8486c9de0de0a22bd31b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6ba9b77d-0948-49c1-8732-d2cb963624ef tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6170bc2f-20de-4790-828f-a149f7a87674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6ba9b77d-0948-49c1-8732-d2cb963624ef tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6170bc2f-20de-4790-828f-a149f7a87674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6ba9b77d-0948-49c1-8732-d2cb963624ef tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29dd88c4-b5c9-4844-90a9-9f95b6ec576b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6ba9b77d-0948-49c1-8732-d2cb963624ef tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29dd88c4-b5c9-4844-90a9-9f95b6ec576b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d8f69ef-a9e3-4d34-808e-b10031839618', 'volume_name': 'volume-1d8f69ef-a9e3-4d34-808e-b10031839618', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6ba9b77d-0948-49c1-8732-d2cb963624ef tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84353b33-dba8-42d5-98e9-c8732264848c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6ba9b77d-0948-49c1-8732-d2cb963624ef tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84353b33-dba8-42d5-98e9-c8732264848c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6ba9b77d-0948-49c1-8732-d2cb963624ef tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d69abd44-c14f-45ae-9941-c61a0ad9e7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:21 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-6ba9b77d-0948-49c1-8732-d2cb963624ef tempest-ProjectReaderTests-366065509 None] Volume 1d8f69ef-a9e3-4d34-808e-b10031839618: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d8f69ef-a9e3-4d34-808e-b10031839618', 'volume_size': 1} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6ba9b77d-0948-49c1-8732-d2cb963624ef tempest-ProjectReaderTests-366065509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:21 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6de918dc-aa3c-4164-ae62-7cacd9ef656c tempest-GroupsTest-1650119900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c4d8e52e-1099-418f-be31-2f5536696f33 1073741824" returned: 0 in 0.518s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6de918dc-aa3c-4164-ae62-7cacd9ef656c tempest-GroupsTest-1650119900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c4d8e52e-1099-418f-be31-2f5536696f33 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:21 devstack sudo[99362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c4d8e52e-1099-418f-be31-2f5536696f33 Sep 03 11:24:21 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:21 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6de918dc-aa3c-4164-ae62-7cacd9ef656c tempest-GroupsTest-1650119900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c4d8e52e-1099-418f-be31-2f5536696f33" returned: 0 in 0.253s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6de918dc-aa3c-4164-ae62-7cacd9ef656c tempest-GroupsTest-1650119900 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6de918dc-aa3c-4164-ae62-7cacd9ef656c tempest-GroupsTest-1650119900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b1c7a4b1-1368-4f75-9d1d-187059de5399 tempest-VolumesSnapshotListTestJSON-83446071 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.467s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6de918dc-aa3c-4164-ae62-7cacd9ef656c tempest-GroupsTest-1650119900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73ce0279-c470-4b55-af05-452dc3b1aa24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4d8e52e-1099-418f-be31-2f5536696f33', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6de918dc-aa3c-4164-ae62-7cacd9ef656c tempest-GroupsTest-1650119900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07d8424a-1aec-4337-b896-cdb410b171c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-b1c7a4b1-1368-4f75-9d1d-187059de5399 tempest-VolumesSnapshotListTestJSON-83446071 None] Creating offline snapshot f81ce69e-6144-4db1-9511-7a5f67cf742b of volume 45dd0e57-740f-49b8-96eb-88fe00a8b98f {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:24:21 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-6de918dc-aa3c-4164-ae62-7cacd9ef656c tempest-GroupsTest-1650119900 None] Volume volume-c4d8e52e-1099-418f-be31-2f5536696f33 (c4d8e52e-1099-418f-be31-2f5536696f33): created successfully Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6de918dc-aa3c-4164-ae62-7cacd9ef656c tempest-GroupsTest-1650119900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07d8424a-1aec-4337-b896-cdb410b171c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6de918dc-aa3c-4164-ae62-7cacd9ef656c tempest-GroupsTest-1650119900 None] Flow 'volume_create_manager' (3d8acbf0-e914-4275-bcd4-1f81034a6443) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfbf04a1-d48e-4656-a3f2-af98784de76e]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:24:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b1c7a4b1-1368-4f75-9d1d-187059de5399 tempest-VolumesSnapshotListTestJSON-83446071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.1697372a-9c1c-464e-8dce-5312c10bb8f5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:21 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-6de918dc-aa3c-4164-ae62-7cacd9ef656c tempest-GroupsTest-1650119900 None] Created volume successfully. Sep 03 11:24:22 devstack sudo[99365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.1697372a-9c1c-464e-8dce-5312c10bb8f5 Sep 03 11:24:22 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:22 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b1c7a4b1-1368-4f75-9d1d-187059de5399 tempest-VolumesSnapshotListTestJSON-83446071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.1697372a-9c1c-464e-8dce-5312c10bb8f5" returned: 0 in 0.426s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:22 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-b1c7a4b1-1368-4f75-9d1d-187059de5399 tempest-VolumesSnapshotListTestJSON-83446071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:24:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b1c7a4b1-1368-4f75-9d1d-187059de5399 tempest-VolumesSnapshotListTestJSON-83446071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.1697372a-9c1c-464e-8dce-5312c10bb8f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.f81ce69e-6144-4db1-9511-7a5f67cf742b 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:22 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.1697372a-9c1c-464e-8dce-5312c10bb8f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.f81ce69e-6144-4db1-9511-7a5f67cf742b 1G Sep 03 11:24:22 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:22 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1b5a1dc-4ad7-41fd-9297-f07e6998ea4e tempest-GroupsTest-1650119900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:24:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e1b5a1dc-4ad7-41fd-9297-f07e6998ea4e tempest-GroupsTest-1650119900 None] Flow 'volume_create_manager' (998c87d9-1a02-435b-b08a-14938edd7e6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:24:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e1b5a1dc-4ad7-41fd-9297-f07e6998ea4e tempest-GroupsTest-1650119900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef9d0f7-a052-4773-96f2-3341029d738f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e1b5a1dc-4ad7-41fd-9297-f07e6998ea4e tempest-GroupsTest-1650119900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef9d0f7-a052-4773-96f2-3341029d738f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-509681772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8aa440f1-44e0-4966-95e3-aafb11d0339d,host='devstack@QuobyteHD#QuobyteHD',id=ee88588a-2eef-4a99-a820-91ca0d3680f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee01a3549311419ebc3b8f8d64197416',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:24:23Z,use_quota=True,user_id='39d7f26e72c2456194cff88709b05598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f752edd-2cd0-4df7-91f5-4a2f2a21ebc9),volume_type_id=7f752edd-2cd0-4df7-91f5-4a2f2a21ebc9)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e1b5a1dc-4ad7-41fd-9297-f07e6998ea4e tempest-GroupsTest-1650119900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49a8d84b-0749-4fd0-8e27-7a58130e1a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e1b5a1dc-4ad7-41fd-9297-f07e6998ea4e tempest-GroupsTest-1650119900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49a8d84b-0749-4fd0-8e27-7a58130e1a94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e1b5a1dc-4ad7-41fd-9297-f07e6998ea4e tempest-GroupsTest-1650119900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (def261a2-5077-4cc6-a6d3-551854a10ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e1b5a1dc-4ad7-41fd-9297-f07e6998ea4e tempest-GroupsTest-1650119900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (def261a2-5077-4cc6-a6d3-551854a10ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee88588a-2eef-4a99-a820-91ca0d3680f7', 'volume_name': 'volume-ee88588a-2eef-4a99-a820-91ca0d3680f7', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e1b5a1dc-4ad7-41fd-9297-f07e6998ea4e tempest-GroupsTest-1650119900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b0756e-a354-4b06-a20d-f7adb0a4682d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e1b5a1dc-4ad7-41fd-9297-f07e6998ea4e tempest-GroupsTest-1650119900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1b0756e-a354-4b06-a20d-f7adb0a4682d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e1b5a1dc-4ad7-41fd-9297-f07e6998ea4e tempest-GroupsTest-1650119900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad174f1f-9804-456d-a9a2-b309edbab8cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:22 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-e1b5a1dc-4ad7-41fd-9297-f07e6998ea4e tempest-GroupsTest-1650119900 None] Volume ee88588a-2eef-4a99-a820-91ca0d3680f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee88588a-2eef-4a99-a820-91ca0d3680f7', 'volume_size': 1} Sep 03 11:24:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e1b5a1dc-4ad7-41fd-9297-f07e6998ea4e tempest-GroupsTest-1650119900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:23 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b1c7a4b1-1368-4f75-9d1d-187059de5399 tempest-VolumesSnapshotListTestJSON-83446071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.1697372a-9c1c-464e-8dce-5312c10bb8f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.f81ce69e-6144-4db1-9511-7a5f67cf742b 1G" returned: 0 in 0.660s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b1c7a4b1-1368-4f75-9d1d-187059de5399 tempest-VolumesSnapshotListTestJSON-83446071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.1697372a-9c1c-464e-8dce-5312c10bb8f5 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.f81ce69e-6144-4db1-9511-7a5f67cf742b {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:23 devstack sudo[99376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.1697372a-9c1c-464e-8dce-5312c10bb8f5 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.f81ce69e-6144-4db1-9511-7a5f67cf742b Sep 03 11:24:23 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:23 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b1c7a4b1-1368-4f75-9d1d-187059de5399 tempest-VolumesSnapshotListTestJSON-83446071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.1697372a-9c1c-464e-8dce-5312c10bb8f5 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.f81ce69e-6144-4db1-9511-7a5f67cf742b" returned: 0 in 0.323s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:23 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-b1c7a4b1-1368-4f75-9d1d-187059de5399 tempest-VolumesSnapshotListTestJSON-83446071 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.f81ce69e-6144-4db1-9511-7a5f67cf742b is being set with open permissions: ugo+rw Sep 03 11:24:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b1c7a4b1-1368-4f75-9d1d-187059de5399 tempest-VolumesSnapshotListTestJSON-83446071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.f81ce69e-6144-4db1-9511-7a5f67cf742b {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:23 devstack sudo[99381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.f81ce69e-6144-4db1-9511-7a5f67cf742b Sep 03 11:24:23 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:23 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b1c7a4b1-1368-4f75-9d1d-187059de5399 tempest-VolumesSnapshotListTestJSON-83446071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.f81ce69e-6144-4db1-9511-7a5f67cf742b" returned: 0 in 0.280s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b1c7a4b1-1368-4f75-9d1d-187059de5399 tempest-VolumesSnapshotListTestJSON-83446071 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.820s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6ba9b77d-0948-49c1-8732-d2cb963624ef tempest-ProjectReaderTests-366065509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.238s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:23 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6ba9b77d-0948-49c1-8732-d2cb963624ef tempest-ProjectReaderTests-366065509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:24:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1197782509',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d8f69ef-a9e3-4d34-808e-b10031839618,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e0266a286845c09b90954957712518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:24:21Z,use_quota=True,user_id='68876a5fbdc8486c9de0de0a22bd31b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:24:23 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-6ba9b77d-0948-49c1-8732-d2cb963624ef tempest-ProjectReaderTests-366065509 None] Creating volume 1d8f69ef-a9e3-4d34-808e-b10031839618 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:24:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6ba9b77d-0948-49c1-8732-d2cb963624ef tempest-ProjectReaderTests-366065509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6ba9b77d-0948-49c1-8732-d2cb963624ef tempest-ProjectReaderTests-366065509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:23 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6ba9b77d-0948-49c1-8732-d2cb963624ef tempest-ProjectReaderTests-366065509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:24:23 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6ba9b77d-0948-49c1-8732-d2cb963624ef tempest-ProjectReaderTests-366065509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:24:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6ba9b77d-0948-49c1-8732-d2cb963624ef tempest-ProjectReaderTests-366065509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:23 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6ba9b77d-0948-49c1-8732-d2cb963624ef tempest-ProjectReaderTests-366065509 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:24:23 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-6ba9b77d-0948-49c1-8732-d2cb963624ef tempest-ProjectReaderTests-366065509 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:24:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6ba9b77d-0948-49c1-8732-d2cb963624ef tempest-ProjectReaderTests-366065509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d8f69ef-a9e3-4d34-808e-b10031839618 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:23 devstack sudo[99384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d8f69ef-a9e3-4d34-808e-b10031839618 1073741824 Sep 03 11:24:23 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:23 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-b1c7a4b1-1368-4f75-9d1d-187059de5399 tempest-VolumesSnapshotListTestJSON-83446071 None] Create snapshot completed successfully Sep 03 11:24:24 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6ba9b77d-0948-49c1-8732-d2cb963624ef tempest-ProjectReaderTests-366065509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d8f69ef-a9e3-4d34-808e-b10031839618 1073741824" returned: 0 in 0.483s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6ba9b77d-0948-49c1-8732-d2cb963624ef tempest-ProjectReaderTests-366065509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d8f69ef-a9e3-4d34-808e-b10031839618 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:24 devstack sudo[99390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d8f69ef-a9e3-4d34-808e-b10031839618 Sep 03 11:24:24 devstack sudo[99390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:24 devstack sudo[99390]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6ba9b77d-0948-49c1-8732-d2cb963624ef tempest-ProjectReaderTests-366065509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d8f69ef-a9e3-4d34-808e-b10031839618" returned: 0 in 0.296s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6ba9b77d-0948-49c1-8732-d2cb963624ef tempest-ProjectReaderTests-366065509 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:24:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6ba9b77d-0948-49c1-8732-d2cb963624ef tempest-ProjectReaderTests-366065509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e1b5a1dc-4ad7-41fd-9297-f07e6998ea4e tempest-GroupsTest-1650119900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.536s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e1b5a1dc-4ad7-41fd-9297-f07e6998ea4e tempest-GroupsTest-1650119900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8aa440f1-44e0-4966-95e3-aafb11d0339d,created_at=2026-09-03T09:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-509681772',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8aa440f1-44e0-4966-95e3-aafb11d0339d,host='devstack@QuobyteHD#QuobyteHD',id=ee88588a-2eef-4a99-a820-91ca0d3680f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee01a3549311419ebc3b8f8d64197416',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:24:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:24:23Z,use_quota=True,user_id='39d7f26e72c2456194cff88709b05598',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7f752edd-2cd0-4df7-91f5-4a2f2a21ebc9),volume_type_id=7f752edd-2cd0-4df7-91f5-4a2f2a21ebc9)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:24:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-e1b5a1dc-4ad7-41fd-9297-f07e6998ea4e tempest-GroupsTest-1650119900 None] Creating volume ee88588a-2eef-4a99-a820-91ca0d3680f7 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:24:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e1b5a1dc-4ad7-41fd-9297-f07e6998ea4e tempest-GroupsTest-1650119900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e1b5a1dc-4ad7-41fd-9297-f07e6998ea4e tempest-GroupsTest-1650119900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e1b5a1dc-4ad7-41fd-9297-f07e6998ea4e tempest-GroupsTest-1650119900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:24:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e1b5a1dc-4ad7-41fd-9297-f07e6998ea4e tempest-GroupsTest-1650119900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:24:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e1b5a1dc-4ad7-41fd-9297-f07e6998ea4e tempest-GroupsTest-1650119900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e1b5a1dc-4ad7-41fd-9297-f07e6998ea4e tempest-GroupsTest-1650119900 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:24:24 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-e1b5a1dc-4ad7-41fd-9297-f07e6998ea4e tempest-GroupsTest-1650119900 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:24:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e1b5a1dc-4ad7-41fd-9297-f07e6998ea4e tempest-GroupsTest-1650119900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ee88588a-2eef-4a99-a820-91ca0d3680f7 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:24 devstack sudo[99393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ee88588a-2eef-4a99-a820-91ca0d3680f7 1073741824 Sep 03 11:24:24 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6ba9b77d-0948-49c1-8732-d2cb963624ef tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d69abd44-c14f-45ae-9941-c61a0ad9e7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d8f69ef-a9e3-4d34-808e-b10031839618', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6ba9b77d-0948-49c1-8732-d2cb963624ef tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d79eb93-bf02-47b6-b4ca-7f0c837c4ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:24 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-6ba9b77d-0948-49c1-8732-d2cb963624ef tempest-ProjectReaderTests-366065509 None] Volume volume-1d8f69ef-a9e3-4d34-808e-b10031839618 (1d8f69ef-a9e3-4d34-808e-b10031839618): created successfully Sep 03 11:24:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6ba9b77d-0948-49c1-8732-d2cb963624ef tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d79eb93-bf02-47b6-b4ca-7f0c837c4ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6ba9b77d-0948-49c1-8732-d2cb963624ef tempest-ProjectReaderTests-366065509 None] Flow 'volume_create_manager' (0be55198-e148-4527-9978-5cd99fd250af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:24:24 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-6ba9b77d-0948-49c1-8732-d2cb963624ef tempest-ProjectReaderTests-366065509 None] Created volume successfully. Sep 03 11:24:25 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e1b5a1dc-4ad7-41fd-9297-f07e6998ea4e tempest-GroupsTest-1650119900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ee88588a-2eef-4a99-a820-91ca0d3680f7 1073741824" returned: 0 in 0.539s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e1b5a1dc-4ad7-41fd-9297-f07e6998ea4e tempest-GroupsTest-1650119900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ee88588a-2eef-4a99-a820-91ca0d3680f7 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:25 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ee88588a-2eef-4a99-a820-91ca0d3680f7 Sep 03 11:24:25 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:25 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ef30b3a3-b7a1-4f0e-89ab-55321116d307 tempest-VolumesSnapshotListTestJSON-83446071 None] Acquiring lock "cinder-f81ce69e-6144-4db1-9511-7a5f67cf742b-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:25 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ef30b3a3-b7a1-4f0e-89ab-55321116d307 tempest-VolumesSnapshotListTestJSON-83446071 None] Lock "cinder-f81ce69e-6144-4db1-9511-7a5f67cf742b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:25 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ef30b3a3-b7a1-4f0e-89ab-55321116d307 tempest-VolumesSnapshotListTestJSON-83446071 None] Acquiring lock "cinder-quobyte-45dd0e57-740f-49b8-96eb-88fe00a8b98f" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:25 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ef30b3a3-b7a1-4f0e-89ab-55321116d307 tempest-VolumesSnapshotListTestJSON-83446071 None] Lock "cinder-quobyte-45dd0e57-740f-49b8-96eb-88fe00a8b98f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:25 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ef30b3a3-b7a1-4f0e-89ab-55321116d307 tempest-VolumesSnapshotListTestJSON-83446071 None] Acquiring lock "cinder-quobyte-f81ce69e-6144-4db1-9511-7a5f67cf742b" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:25 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e1b5a1dc-4ad7-41fd-9297-f07e6998ea4e tempest-GroupsTest-1650119900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ee88588a-2eef-4a99-a820-91ca0d3680f7" returned: 0 in 0.310s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:25 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e1b5a1dc-4ad7-41fd-9297-f07e6998ea4e tempest-GroupsTest-1650119900 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:24:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e1b5a1dc-4ad7-41fd-9297-f07e6998ea4e tempest-GroupsTest-1650119900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:25 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ef30b3a3-b7a1-4f0e-89ab-55321116d307 tempest-VolumesSnapshotListTestJSON-83446071 None] Lock "cinder-quobyte-f81ce69e-6144-4db1-9511-7a5f67cf742b" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:25 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-ef30b3a3-b7a1-4f0e-89ab-55321116d307 tempest-VolumesSnapshotListTestJSON-83446071 None] Deleting offline snapshot f81ce69e-6144-4db1-9511-7a5f67cf742b of volume 45dd0e57-740f-49b8-96eb-88fe00a8b98f {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:24:25 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-ef30b3a3-b7a1-4f0e-89ab-55321116d307 tempest-VolumesSnapshotListTestJSON-83446071 None] snapshot_file for this snap is: volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.f81ce69e-6144-4db1-9511-7a5f67cf742b {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:24:25 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e280abe-caaf-4626-9b4c-58d65294c9bb]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:24:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ef30b3a3-b7a1-4f0e-89ab-55321116d307 tempest-VolumesSnapshotListTestJSON-83446071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.f81ce69e-6144-4db1-9511-7a5f67cf742b {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e1b5a1dc-4ad7-41fd-9297-f07e6998ea4e tempest-GroupsTest-1650119900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad174f1f-9804-456d-a9a2-b309edbab8cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee88588a-2eef-4a99-a820-91ca0d3680f7', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e1b5a1dc-4ad7-41fd-9297-f07e6998ea4e tempest-GroupsTest-1650119900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c352687-39d9-4d17-aa2b-a96d0a640d2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:25 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-e1b5a1dc-4ad7-41fd-9297-f07e6998ea4e tempest-GroupsTest-1650119900 None] Volume volume-ee88588a-2eef-4a99-a820-91ca0d3680f7 (ee88588a-2eef-4a99-a820-91ca0d3680f7): created successfully Sep 03 11:24:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e1b5a1dc-4ad7-41fd-9297-f07e6998ea4e tempest-GroupsTest-1650119900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c352687-39d9-4d17-aa2b-a96d0a640d2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e1b5a1dc-4ad7-41fd-9297-f07e6998ea4e tempest-GroupsTest-1650119900 None] Flow 'volume_create_manager' (998c87d9-1a02-435b-b08a-14938edd7e6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:24:25 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-e1b5a1dc-4ad7-41fd-9297-f07e6998ea4e tempest-GroupsTest-1650119900 None] Created volume successfully. Sep 03 11:24:25 devstack sudo[99401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.f81ce69e-6144-4db1-9511-7a5f67cf742b Sep 03 11:24:25 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:25 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ef30b3a3-b7a1-4f0e-89ab-55321116d307 tempest-VolumesSnapshotListTestJSON-83446071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.f81ce69e-6144-4db1-9511-7a5f67cf742b" returned: 0 in 0.413s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:25 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-ef30b3a3-b7a1-4f0e-89ab-55321116d307 tempest-VolumesSnapshotListTestJSON-83446071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:24:25 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e0374ae8-7f53-4127-9f95-ac754a9bb746 tempest-ProjectReaderTests-366065509 None] Acquiring lock "cinder-1d8f69ef-a9e3-4d34-808e-b10031839618-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:25 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cbfc553-cad4-4e24-aa1e-cbc83e6b4041]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:24:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ef30b3a3-b7a1-4f0e-89ab-55321116d307 tempest-VolumesSnapshotListTestJSON-83446071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.1697372a-9c1c-464e-8dce-5312c10bb8f5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:25 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e0374ae8-7f53-4127-9f95-ac754a9bb746 tempest-ProjectReaderTests-366065509 None] Lock "cinder-1d8f69ef-a9e3-4d34-808e-b10031839618-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:26 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e0374ae8-7f53-4127-9f95-ac754a9bb746 tempest-ProjectReaderTests-366065509 None] Acquiring lock "cinder-quobyte-1d8f69ef-a9e3-4d34-808e-b10031839618" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:26 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e0374ae8-7f53-4127-9f95-ac754a9bb746 tempest-ProjectReaderTests-366065509 None] Lock "cinder-quobyte-1d8f69ef-a9e3-4d34-808e-b10031839618" acquired by "delete_volume" :: waited 0.017s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:26 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[5453dd3e-5a63-4fa8-b1ec-44253b55af00]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:24:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e0374ae8-7f53-4127-9f95-ac754a9bb746 tempest-ProjectReaderTests-366065509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d8f69ef-a9e3-4d34-808e-b10031839618 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:26 devstack sudo[99406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.1697372a-9c1c-464e-8dce-5312c10bb8f5 Sep 03 11:24:26 devstack sudo[99406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:26 devstack sudo[99407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d8f69ef-a9e3-4d34-808e-b10031839618 Sep 03 11:24:26 devstack sudo[99407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:26 devstack sudo[99406]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ef30b3a3-b7a1-4f0e-89ab-55321116d307 tempest-VolumesSnapshotListTestJSON-83446071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.1697372a-9c1c-464e-8dce-5312c10bb8f5" returned: 0 in 0.536s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:26 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-ef30b3a3-b7a1-4f0e-89ab-55321116d307 tempest-VolumesSnapshotListTestJSON-83446071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:24:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ef30b3a3-b7a1-4f0e-89ab-55321116d307 tempest-VolumesSnapshotListTestJSON-83446071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.f81ce69e-6144-4db1-9511-7a5f67cf742b {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:26 devstack sudo[99416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.f81ce69e-6144-4db1-9511-7a5f67cf742b Sep 03 11:24:26 devstack sudo[99416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:26 devstack sudo[99407]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e0374ae8-7f53-4127-9f95-ac754a9bb746 tempest-ProjectReaderTests-366065509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d8f69ef-a9e3-4d34-808e-b10031839618" returned: 0 in 0.511s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e0374ae8-7f53-4127-9f95-ac754a9bb746 tempest-ProjectReaderTests-366065509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d8f69ef-a9e3-4d34-808e-b10031839618 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:26 devstack sudo[99418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d8f69ef-a9e3-4d34-808e-b10031839618 Sep 03 11:24:26 devstack sudo[99418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:26 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-532a4ee7-d55e-4573-9043-bf2d0165fe91 tempest-GroupsTest-1650119900 None] Update group completed successfully. Sep 03 11:24:26 devstack sudo[99418]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e0374ae8-7f53-4127-9f95-ac754a9bb746 tempest-ProjectReaderTests-366065509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1d8f69ef-a9e3-4d34-808e-b10031839618" returned: 0 in 0.324s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:26 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e0374ae8-7f53-4127-9f95-ac754a9bb746 tempest-ProjectReaderTests-366065509 None] Lock "cinder-quobyte-1d8f69ef-a9e3-4d34-808e-b10031839618" released by "delete_volume" :: held 0.883s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:26 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-e0374ae8-7f53-4127-9f95-ac754a9bb746 tempest-ProjectReaderTests-366065509 None] Created reservations ['a37e2e44-da8c-43a4-bad1-09d4ebeeb62b', 'a07d1af7-3a87-4493-9a5d-c6b256868a12', '972fd51b-f4e4-4b76-9bb1-190969eb0770', 'd7399a7f-14cc-49da-acd4-efead852eca4'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e0374ae8-7f53-4127-9f95-ac754a9bb746 tempest-ProjectReaderTests-366065509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e0374ae8-7f53-4127-9f95-ac754a9bb746 tempest-ProjectReaderTests-366065509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e0374ae8-7f53-4127-9f95-ac754a9bb746 tempest-ProjectReaderTests-366065509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e0374ae8-7f53-4127-9f95-ac754a9bb746 tempest-ProjectReaderTests-366065509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e0374ae8-7f53-4127-9f95-ac754a9bb746 tempest-ProjectReaderTests-366065509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e0374ae8-7f53-4127-9f95-ac754a9bb746 tempest-ProjectReaderTests-366065509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:27 devstack sudo[99425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:24:27 devstack sudo[99425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:27 devstack sudo[99416]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ef30b3a3-b7a1-4f0e-89ab-55321116d307 tempest-VolumesSnapshotListTestJSON-83446071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.f81ce69e-6144-4db1-9511-7a5f67cf742b" returned: 0 in 0.645s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ef30b3a3-b7a1-4f0e-89ab-55321116d307 tempest-VolumesSnapshotListTestJSON-83446071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.f81ce69e-6144-4db1-9511-7a5f67cf742b {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:27 devstack sudo[99427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.f81ce69e-6144-4db1-9511-7a5f67cf742b Sep 03 11:24:27 devstack sudo[99427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:27 devstack sudo[99425]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e0374ae8-7f53-4127-9f95-ac754a9bb746 tempest-ProjectReaderTests-366065509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.371s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-e0374ae8-7f53-4127-9f95-ac754a9bb746 tempest-ProjectReaderTests-366065509 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:24:27 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-e0374ae8-7f53-4127-9f95-ac754a9bb746 tempest-ProjectReaderTests-366065509 None] Deleted volume successfully. Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e0374ae8-7f53-4127-9f95-ac754a9bb746 tempest-ProjectReaderTests-366065509 None] Lock "cinder-1d8f69ef-a9e3-4d34-808e-b10031839618-delete_volume" released by "delete_volume" :: held 1.533s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:27 devstack sudo[99427]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ef30b3a3-b7a1-4f0e-89ab-55321116d307 tempest-VolumesSnapshotListTestJSON-83446071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.f81ce69e-6144-4db1-9511-7a5f67cf742b" returned: 0 in 0.519s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ef30b3a3-b7a1-4f0e-89ab-55321116d307 tempest-VolumesSnapshotListTestJSON-83446071 None] Lock "cinder-quobyte-f81ce69e-6144-4db1-9511-7a5f67cf742b" released by "_delete_snapshot" :: held 2.259s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ef30b3a3-b7a1-4f0e-89ab-55321116d307 tempest-VolumesSnapshotListTestJSON-83446071 None] Lock "cinder-quobyte-45dd0e57-740f-49b8-96eb-88fe00a8b98f" released by "delete_snapshot" :: held 2.304s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d128f2c-f0b8-4484-88ae-d6eb0d60e68b tempest-ProjectReaderTests-366065509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0d128f2c-f0b8-4484-88ae-d6eb0d60e68b tempest-ProjectReaderTests-366065509 None] Flow 'volume_create_manager' (fb2ac1ba-5b67-45c1-bc0a-71764b9e46fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0d128f2c-f0b8-4484-88ae-d6eb0d60e68b tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4356c535-529d-4668-b9ea-dddd65491559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0d128f2c-f0b8-4484-88ae-d6eb0d60e68b tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4356c535-529d-4668-b9ea-dddd65491559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1540388064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c71f05c9-9744-4866-9c0c-0d79c9758e41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e0266a286845c09b90954957712518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:24:28Z,use_quota=True,user_id='68876a5fbdc8486c9de0de0a22bd31b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0d128f2c-f0b8-4484-88ae-d6eb0d60e68b tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec5fdecc-9fc0-4b71-be12-9d663113490e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0d128f2c-f0b8-4484-88ae-d6eb0d60e68b tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec5fdecc-9fc0-4b71-be12-9d663113490e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0d128f2c-f0b8-4484-88ae-d6eb0d60e68b tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49ef7c09-5097-46d3-898f-55069207210d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0d128f2c-f0b8-4484-88ae-d6eb0d60e68b tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49ef7c09-5097-46d3-898f-55069207210d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c71f05c9-9744-4866-9c0c-0d79c9758e41', 'volume_name': 'volume-c71f05c9-9744-4866-9c0c-0d79c9758e41', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0d128f2c-f0b8-4484-88ae-d6eb0d60e68b tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94f766db-09e1-46b8-ace4-0669dd1e073d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0d128f2c-f0b8-4484-88ae-d6eb0d60e68b tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94f766db-09e1-46b8-ace4-0669dd1e073d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0d128f2c-f0b8-4484-88ae-d6eb0d60e68b tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5308061b-498e-4f10-81cf-bc49389d4b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:27 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-0d128f2c-f0b8-4484-88ae-d6eb0d60e68b tempest-ProjectReaderTests-366065509 None] Volume c71f05c9-9744-4866-9c0c-0d79c9758e41: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c71f05c9-9744-4866-9c0c-0d79c9758e41', 'volume_size': 1} Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0d128f2c-f0b8-4484-88ae-d6eb0d60e68b tempest-ProjectReaderTests-366065509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0d128f2c-f0b8-4484-88ae-d6eb0d60e68b tempest-ProjectReaderTests-366065509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0d128f2c-f0b8-4484-88ae-d6eb0d60e68b tempest-ProjectReaderTests-366065509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1540388064',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c71f05c9-9744-4866-9c0c-0d79c9758e41,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e0266a286845c09b90954957712518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:24:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:24:28Z,use_quota=True,user_id='68876a5fbdc8486c9de0de0a22bd31b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-0d128f2c-f0b8-4484-88ae-d6eb0d60e68b tempest-ProjectReaderTests-366065509 None] Creating volume c71f05c9-9744-4866-9c0c-0d79c9758e41 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0d128f2c-f0b8-4484-88ae-d6eb0d60e68b tempest-ProjectReaderTests-366065509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0d128f2c-f0b8-4484-88ae-d6eb0d60e68b tempest-ProjectReaderTests-366065509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0d128f2c-f0b8-4484-88ae-d6eb0d60e68b tempest-ProjectReaderTests-366065509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0d128f2c-f0b8-4484-88ae-d6eb0d60e68b tempest-ProjectReaderTests-366065509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0d128f2c-f0b8-4484-88ae-d6eb0d60e68b tempest-ProjectReaderTests-366065509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0d128f2c-f0b8-4484-88ae-d6eb0d60e68b tempest-ProjectReaderTests-366065509 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:24:27 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-0d128f2c-f0b8-4484-88ae-d6eb0d60e68b tempest-ProjectReaderTests-366065509 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0d128f2c-f0b8-4484-88ae-d6eb0d60e68b tempest-ProjectReaderTests-366065509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c71f05c9-9744-4866-9c0c-0d79c9758e41 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:27 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-ef30b3a3-b7a1-4f0e-89ab-55321116d307 tempest-VolumesSnapshotListTestJSON-83446071 None] Created reservations ['1d93fe48-a9d2-4f05-ad09-a4897b57f46c', '5d05bf28-417f-4a3c-9204-fed3a573b49e', '60aa9a07-1ada-4eb8-9a06-947db2550e72', 'b89c90f9-55b4-4950-b3eb-e3fd3ac5910d'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:24:27 devstack sudo[99431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c71f05c9-9744-4866-9c0c-0d79c9758e41 1073741824 Sep 03 11:24:27 devstack sudo[99431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:28 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-ef30b3a3-b7a1-4f0e-89ab-55321116d307 tempest-VolumesSnapshotListTestJSON-83446071 None] Delete snapshot completed successfully. Sep 03 11:24:28 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ef30b3a3-b7a1-4f0e-89ab-55321116d307 tempest-VolumesSnapshotListTestJSON-83446071 None] Lock "cinder-f81ce69e-6144-4db1-9511-7a5f67cf742b-delete_snapshot" released by "delete_snapshot" :: held 2.672s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:28 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-74332784-2163-4d60-84ec-6dc6b29ef994 tempest-GroupsTest-1650119900 None] Update group completed successfully. Sep 03 11:24:28 devstack sudo[99431]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0d128f2c-f0b8-4484-88ae-d6eb0d60e68b tempest-ProjectReaderTests-366065509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c71f05c9-9744-4866-9c0c-0d79c9758e41 1073741824" returned: 0 in 0.652s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0d128f2c-f0b8-4484-88ae-d6eb0d60e68b tempest-ProjectReaderTests-366065509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c71f05c9-9744-4866-9c0c-0d79c9758e41 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:28 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8f7e1035-47d8-453b-b23b-b1ccc2f478a0 tempest-VolumesSnapshotListTestJSON-83446071 None] Acquiring lock "cinder-1697372a-9c1c-464e-8dce-5312c10bb8f5-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:28 devstack sudo[99438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c71f05c9-9744-4866-9c0c-0d79c9758e41 Sep 03 11:24:28 devstack sudo[99438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:28 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8f7e1035-47d8-453b-b23b-b1ccc2f478a0 tempest-VolumesSnapshotListTestJSON-83446071 None] Lock "cinder-1697372a-9c1c-464e-8dce-5312c10bb8f5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:28 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8f7e1035-47d8-453b-b23b-b1ccc2f478a0 tempest-VolumesSnapshotListTestJSON-83446071 None] Acquiring lock "cinder-quobyte-45dd0e57-740f-49b8-96eb-88fe00a8b98f" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:28 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8f7e1035-47d8-453b-b23b-b1ccc2f478a0 tempest-VolumesSnapshotListTestJSON-83446071 None] Lock "cinder-quobyte-45dd0e57-740f-49b8-96eb-88fe00a8b98f" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:28 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8f7e1035-47d8-453b-b23b-b1ccc2f478a0 tempest-VolumesSnapshotListTestJSON-83446071 None] Acquiring lock "cinder-quobyte-1697372a-9c1c-464e-8dce-5312c10bb8f5" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:28 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8f7e1035-47d8-453b-b23b-b1ccc2f478a0 tempest-VolumesSnapshotListTestJSON-83446071 None] Lock "cinder-quobyte-1697372a-9c1c-464e-8dce-5312c10bb8f5" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:28 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-8f7e1035-47d8-453b-b23b-b1ccc2f478a0 tempest-VolumesSnapshotListTestJSON-83446071 None] Deleting offline snapshot 1697372a-9c1c-464e-8dce-5312c10bb8f5 of volume 45dd0e57-740f-49b8-96eb-88fe00a8b98f {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:24:28 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-8f7e1035-47d8-453b-b23b-b1ccc2f478a0 tempest-VolumesSnapshotListTestJSON-83446071 None] snapshot_file for this snap is: volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.1697372a-9c1c-464e-8dce-5312c10bb8f5 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:24:28 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[0425e986-702a-44c9-8df5-e616ca3e9b14]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:24:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8f7e1035-47d8-453b-b23b-b1ccc2f478a0 tempest-VolumesSnapshotListTestJSON-83446071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.1697372a-9c1c-464e-8dce-5312c10bb8f5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:28 devstack sudo[99440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.1697372a-9c1c-464e-8dce-5312c10bb8f5 Sep 03 11:24:28 devstack sudo[99440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:29 devstack sudo[99438]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0d128f2c-f0b8-4484-88ae-d6eb0d60e68b tempest-ProjectReaderTests-366065509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c71f05c9-9744-4866-9c0c-0d79c9758e41" returned: 0 in 0.380s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:29 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0d128f2c-f0b8-4484-88ae-d6eb0d60e68b tempest-ProjectReaderTests-366065509 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:24:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0d128f2c-f0b8-4484-88ae-d6eb0d60e68b tempest-ProjectReaderTests-366065509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0d128f2c-f0b8-4484-88ae-d6eb0d60e68b tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5308061b-498e-4f10-81cf-bc49389d4b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c71f05c9-9744-4866-9c0c-0d79c9758e41', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0d128f2c-f0b8-4484-88ae-d6eb0d60e68b tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1193b620-12c7-47e4-8152-8cd7058d5a6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:29 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-0d128f2c-f0b8-4484-88ae-d6eb0d60e68b tempest-ProjectReaderTests-366065509 None] Volume volume-c71f05c9-9744-4866-9c0c-0d79c9758e41 (c71f05c9-9744-4866-9c0c-0d79c9758e41): created successfully Sep 03 11:24:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0d128f2c-f0b8-4484-88ae-d6eb0d60e68b tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1193b620-12c7-47e4-8152-8cd7058d5a6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0d128f2c-f0b8-4484-88ae-d6eb0d60e68b tempest-ProjectReaderTests-366065509 None] Flow 'volume_create_manager' (fb2ac1ba-5b67-45c1-bc0a-71764b9e46fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:24:29 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-0d128f2c-f0b8-4484-88ae-d6eb0d60e68b tempest-ProjectReaderTests-366065509 None] Created volume successfully. Sep 03 11:24:29 devstack sudo[99440]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8f7e1035-47d8-453b-b23b-b1ccc2f478a0 tempest-VolumesSnapshotListTestJSON-83446071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.1697372a-9c1c-464e-8dce-5312c10bb8f5" returned: 0 in 0.415s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:29 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-8f7e1035-47d8-453b-b23b-b1ccc2f478a0 tempest-VolumesSnapshotListTestJSON-83446071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:24:29 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4e4c851-8d86-4107-80a4-12d2488ef729]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:24:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8f7e1035-47d8-453b-b23b-b1ccc2f478a0 tempest-VolumesSnapshotListTestJSON-83446071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.03f1f028-f107-4127-88f1-4c52b028d00f {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:29 devstack sudo[99446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.03f1f028-f107-4127-88f1-4c52b028d00f Sep 03 11:24:29 devstack sudo[99446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:29 devstack sudo[99446]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8f7e1035-47d8-453b-b23b-b1ccc2f478a0 tempest-VolumesSnapshotListTestJSON-83446071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.03f1f028-f107-4127-88f1-4c52b028d00f" returned: 0 in 0.456s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:29 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-8f7e1035-47d8-453b-b23b-b1ccc2f478a0 tempest-VolumesSnapshotListTestJSON-83446071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:24:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8f7e1035-47d8-453b-b23b-b1ccc2f478a0 tempest-VolumesSnapshotListTestJSON-83446071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.1697372a-9c1c-464e-8dce-5312c10bb8f5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:29 devstack sudo[99451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.1697372a-9c1c-464e-8dce-5312c10bb8f5 Sep 03 11:24:29 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:29 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b825b963-8fb7-4d2f-95b8-da36be31e88a tempest-ProjectReaderTests-366065509 None] Acquiring lock "cinder-c71f05c9-9744-4866-9c0c-0d79c9758e41-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b825b963-8fb7-4d2f-95b8-da36be31e88a tempest-ProjectReaderTests-366065509 None] Lock "cinder-c71f05c9-9744-4866-9c0c-0d79c9758e41-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-115d231a-37cb-4908-bb97-4959fe47627d tempest-GroupsTest-1650119900 None] Acquiring lock "cinder-quobyte-c4d8e52e-1099-418f-be31-2f5536696f33" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b825b963-8fb7-4d2f-95b8-da36be31e88a tempest-ProjectReaderTests-366065509 None] Acquiring lock "cinder-quobyte-c71f05c9-9744-4866-9c0c-0d79c9758e41" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-115d231a-37cb-4908-bb97-4959fe47627d tempest-GroupsTest-1650119900 None] Lock "cinder-quobyte-c4d8e52e-1099-418f-be31-2f5536696f33" acquired by "delete_volume" :: waited 0.032s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b825b963-8fb7-4d2f-95b8-da36be31e88a tempest-ProjectReaderTests-366065509 None] Lock "cinder-quobyte-c71f05c9-9744-4866-9c0c-0d79c9758e41" acquired by "delete_volume" :: waited 0.048s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:30 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dd81354-baac-4b9a-8a20-43cc962afee5]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:24:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-115d231a-37cb-4908-bb97-4959fe47627d tempest-GroupsTest-1650119900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c4d8e52e-1099-418f-be31-2f5536696f33 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:30 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c866f0-524c-471d-a137-304b43e563c3]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:24:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b825b963-8fb7-4d2f-95b8-da36be31e88a tempest-ProjectReaderTests-366065509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c71f05c9-9744-4866-9c0c-0d79c9758e41 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:30 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8f7e1035-47d8-453b-b23b-b1ccc2f478a0 tempest-VolumesSnapshotListTestJSON-83446071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.1697372a-9c1c-464e-8dce-5312c10bb8f5" returned: 0 in 0.518s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8f7e1035-47d8-453b-b23b-b1ccc2f478a0 tempest-VolumesSnapshotListTestJSON-83446071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.1697372a-9c1c-464e-8dce-5312c10bb8f5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:30 devstack sudo[99458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.1697372a-9c1c-464e-8dce-5312c10bb8f5 Sep 03 11:24:30 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:30 devstack sudo[99456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c4d8e52e-1099-418f-be31-2f5536696f33 Sep 03 11:24:30 devstack sudo[99456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:30 devstack sudo[99457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c71f05c9-9744-4866-9c0c-0d79c9758e41 Sep 03 11:24:30 devstack sudo[99457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:30 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8f7e1035-47d8-453b-b23b-b1ccc2f478a0 tempest-VolumesSnapshotListTestJSON-83446071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.1697372a-9c1c-464e-8dce-5312c10bb8f5" returned: 0 in 0.311s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8f7e1035-47d8-453b-b23b-b1ccc2f478a0 tempest-VolumesSnapshotListTestJSON-83446071 None] Lock "cinder-quobyte-1697372a-9c1c-464e-8dce-5312c10bb8f5" released by "_delete_snapshot" :: held 1.837s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:30 devstack sudo[99456]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-115d231a-37cb-4908-bb97-4959fe47627d tempest-GroupsTest-1650119900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c4d8e52e-1099-418f-be31-2f5536696f33" returned: 0 in 0.432s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-115d231a-37cb-4908-bb97-4959fe47627d tempest-GroupsTest-1650119900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c4d8e52e-1099-418f-be31-2f5536696f33 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8f7e1035-47d8-453b-b23b-b1ccc2f478a0 tempest-VolumesSnapshotListTestJSON-83446071 None] Lock "cinder-quobyte-45dd0e57-740f-49b8-96eb-88fe00a8b98f" released by "delete_snapshot" :: held 1.886s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:30 devstack sudo[99469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c4d8e52e-1099-418f-be31-2f5536696f33 Sep 03 11:24:30 devstack sudo[99469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:30 devstack sudo[99457]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b825b963-8fb7-4d2f-95b8-da36be31e88a tempest-ProjectReaderTests-366065509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c71f05c9-9744-4866-9c0c-0d79c9758e41" returned: 0 in 0.483s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b825b963-8fb7-4d2f-95b8-da36be31e88a tempest-ProjectReaderTests-366065509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c71f05c9-9744-4866-9c0c-0d79c9758e41 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:30 devstack sudo[99471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c71f05c9-9744-4866-9c0c-0d79c9758e41 Sep 03 11:24:30 devstack sudo[99471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:30 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-8f7e1035-47d8-453b-b23b-b1ccc2f478a0 tempest-VolumesSnapshotListTestJSON-83446071 None] Created reservations ['a5b2c27b-37b3-40c0-a423-de771f6b5563', 'a7717171-6866-4deb-b48e-4a004acde3fa', '640c24d4-7323-4f34-80d8-431a69d1069e', '33a89b27-35dd-42f2-ac75-35d32b30b491'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:24:30 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-8f7e1035-47d8-453b-b23b-b1ccc2f478a0 tempest-VolumesSnapshotListTestJSON-83446071 None] Delete snapshot completed successfully. Sep 03 11:24:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8f7e1035-47d8-453b-b23b-b1ccc2f478a0 tempest-VolumesSnapshotListTestJSON-83446071 None] Lock "cinder-1697372a-9c1c-464e-8dce-5312c10bb8f5-delete_snapshot" released by "delete_snapshot" :: held 2.142s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:30 devstack sudo[99469]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-115d231a-37cb-4908-bb97-4959fe47627d tempest-GroupsTest-1650119900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c4d8e52e-1099-418f-be31-2f5536696f33" returned: 0 in 0.345s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-115d231a-37cb-4908-bb97-4959fe47627d tempest-GroupsTest-1650119900 None] Lock "cinder-quobyte-c4d8e52e-1099-418f-be31-2f5536696f33" released by "delete_volume" :: held 0.856s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-115d231a-37cb-4908-bb97-4959fe47627d tempest-GroupsTest-1650119900 None] Acquiring lock "cinder-quobyte-ee88588a-2eef-4a99-a820-91ca0d3680f7" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-115d231a-37cb-4908-bb97-4959fe47627d tempest-GroupsTest-1650119900 None] Lock "cinder-quobyte-ee88588a-2eef-4a99-a820-91ca0d3680f7" acquired by "delete_volume" :: waited 0.016s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:30 devstack sudo[99471]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b825b963-8fb7-4d2f-95b8-da36be31e88a tempest-ProjectReaderTests-366065509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c71f05c9-9744-4866-9c0c-0d79c9758e41" returned: 0 in 0.321s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:31 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b825b963-8fb7-4d2f-95b8-da36be31e88a tempest-ProjectReaderTests-366065509 None] Lock "cinder-quobyte-c71f05c9-9744-4866-9c0c-0d79c9758e41" released by "delete_volume" :: held 0.872s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:31 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d38ae36-3d21-4226-a5c1-b18b4c4324e5]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:24:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-115d231a-37cb-4908-bb97-4959fe47627d tempest-GroupsTest-1650119900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ee88588a-2eef-4a99-a820-91ca0d3680f7 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:31 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-b825b963-8fb7-4d2f-95b8-da36be31e88a tempest-ProjectReaderTests-366065509 None] Created reservations ['cb4251ce-95b9-498a-b92c-8ad77b9cef8f', 'a61536c5-715a-45b2-b6c3-0ddc83558912', '0dc22b89-c61b-4ad5-a452-169ca992ff89', 'b4b4ea3d-78fc-4b27-b3d1-2b938a7d7340'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:24:31 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ee88588a-2eef-4a99-a820-91ca0d3680f7 Sep 03 11:24:31 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b825b963-8fb7-4d2f-95b8-da36be31e88a tempest-ProjectReaderTests-366065509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b825b963-8fb7-4d2f-95b8-da36be31e88a tempest-ProjectReaderTests-366065509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-b825b963-8fb7-4d2f-95b8-da36be31e88a tempest-ProjectReaderTests-366065509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:24:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-b825b963-8fb7-4d2f-95b8-da36be31e88a tempest-ProjectReaderTests-366065509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:24:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b825b963-8fb7-4d2f-95b8-da36be31e88a tempest-ProjectReaderTests-366065509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b825b963-8fb7-4d2f-95b8-da36be31e88a tempest-ProjectReaderTests-366065509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:31 devstack sudo[99477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:24:31 devstack sudo[99477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:31 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-115d231a-37cb-4908-bb97-4959fe47627d tempest-GroupsTest-1650119900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ee88588a-2eef-4a99-a820-91ca0d3680f7" returned: 0 in 0.444s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-115d231a-37cb-4908-bb97-4959fe47627d tempest-GroupsTest-1650119900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ee88588a-2eef-4a99-a820-91ca0d3680f7 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:31 devstack sudo[99483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ee88588a-2eef-4a99-a820-91ca0d3680f7 Sep 03 11:24:31 devstack sudo[99483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:31 devstack sudo[99477]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b825b963-8fb7-4d2f-95b8-da36be31e88a tempest-ProjectReaderTests-366065509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.410s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:31 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-b825b963-8fb7-4d2f-95b8-da36be31e88a tempest-ProjectReaderTests-366065509 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:24:31 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-b825b963-8fb7-4d2f-95b8-da36be31e88a tempest-ProjectReaderTests-366065509 None] Deleted volume successfully. Sep 03 11:24:31 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b825b963-8fb7-4d2f-95b8-da36be31e88a tempest-ProjectReaderTests-366065509 None] Lock "cinder-c71f05c9-9744-4866-9c0c-0d79c9758e41-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:31 devstack sudo[99483]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-115d231a-37cb-4908-bb97-4959fe47627d tempest-GroupsTest-1650119900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ee88588a-2eef-4a99-a820-91ca0d3680f7" returned: 0 in 0.376s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:31 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-115d231a-37cb-4908-bb97-4959fe47627d tempest-GroupsTest-1650119900 None] Lock "cinder-quobyte-ee88588a-2eef-4a99-a820-91ca0d3680f7" released by "delete_volume" :: held 0.874s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:31 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-66898eeb-e728-452f-b625-990bf9416380 tempest-VolumesSnapshotListTestJSON-83446071 None] Acquiring lock "cinder-03f1f028-f107-4127-88f1-4c52b028d00f-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:31 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-66898eeb-e728-452f-b625-990bf9416380 tempest-VolumesSnapshotListTestJSON-83446071 None] Lock "cinder-03f1f028-f107-4127-88f1-4c52b028d00f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:31 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-66898eeb-e728-452f-b625-990bf9416380 tempest-VolumesSnapshotListTestJSON-83446071 None] Acquiring lock "cinder-quobyte-45dd0e57-740f-49b8-96eb-88fe00a8b98f" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:31 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-66898eeb-e728-452f-b625-990bf9416380 tempest-VolumesSnapshotListTestJSON-83446071 None] Lock "cinder-quobyte-45dd0e57-740f-49b8-96eb-88fe00a8b98f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:31 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-66898eeb-e728-452f-b625-990bf9416380 tempest-VolumesSnapshotListTestJSON-83446071 None] Acquiring lock "cinder-quobyte-03f1f028-f107-4127-88f1-4c52b028d00f" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:31 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-66898eeb-e728-452f-b625-990bf9416380 tempest-VolumesSnapshotListTestJSON-83446071 None] Lock "cinder-quobyte-03f1f028-f107-4127-88f1-4c52b028d00f" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-66898eeb-e728-452f-b625-990bf9416380 tempest-VolumesSnapshotListTestJSON-83446071 None] Deleting offline snapshot 03f1f028-f107-4127-88f1-4c52b028d00f of volume 45dd0e57-740f-49b8-96eb-88fe00a8b98f {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:24:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-66898eeb-e728-452f-b625-990bf9416380 tempest-VolumesSnapshotListTestJSON-83446071 None] snapshot_file for this snap is: volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.03f1f028-f107-4127-88f1-4c52b028d00f {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:24:31 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-115d231a-37cb-4908-bb97-4959fe47627d tempest-GroupsTest-1650119900 None] Created reservations ['10094c95-3053-4bfe-89f8-05518373a48f'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:24:32 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60b828b-7a1e-4036-bc5c-cf26b171fd75]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:24:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-66898eeb-e728-452f-b625-990bf9416380 tempest-VolumesSnapshotListTestJSON-83446071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.03f1f028-f107-4127-88f1-4c52b028d00f {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:32 devstack cinder-volume[87038]: WARNING cinder.quota [None req-115d231a-37cb-4908-bb97-4959fe47627d tempest-GroupsTest-1650119900 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-236978307 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-236978307, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:24:32 devstack cinder-volume[87038]: WARNING cinder.quota [None req-115d231a-37cb-4908-bb97-4959fe47627d tempest-GroupsTest-1650119900 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-236978307 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-236978307, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:24:32 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-115d231a-37cb-4908-bb97-4959fe47627d tempest-GroupsTest-1650119900 None] Created reservations ['d210068e-2f94-41cb-9d47-d28b6af924a2', '9711dd4b-15e3-4212-bede-8579cc032e6f', 'ce147a32-8e8b-452e-827d-4699e90f70dd', '5a92a0c3-c8ee-4a44-aac3-e72553fe48ed'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:24:32 devstack sudo[99487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.03f1f028-f107-4127-88f1-4c52b028d00f Sep 03 11:24:32 devstack sudo[99487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:32 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-115d231a-37cb-4908-bb97-4959fe47627d tempest-GroupsTest-1650119900 None] Created reservations ['0dbc8362-f428-498a-85d4-500eabe982ae', '75dfaccd-e8b9-46a4-8c1d-ec8281025e5d', '3b7bf51a-8fd0-491e-a61a-054da2568d01', '1b90883a-666b-43a9-bc7a-722d27e9d1d7'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:24:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-115d231a-37cb-4908-bb97-4959fe47627d tempest-GroupsTest-1650119900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-115d231a-37cb-4908-bb97-4959fe47627d tempest-GroupsTest-1650119900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-115d231a-37cb-4908-bb97-4959fe47627d tempest-GroupsTest-1650119900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:24:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-115d231a-37cb-4908-bb97-4959fe47627d tempest-GroupsTest-1650119900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:24:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-115d231a-37cb-4908-bb97-4959fe47627d tempest-GroupsTest-1650119900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-115d231a-37cb-4908-bb97-4959fe47627d tempest-GroupsTest-1650119900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:32 devstack sudo[99493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:24:32 devstack sudo[99493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:32 devstack sudo[99487]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-66898eeb-e728-452f-b625-990bf9416380 tempest-VolumesSnapshotListTestJSON-83446071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.03f1f028-f107-4127-88f1-4c52b028d00f" returned: 0 in 0.427s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-66898eeb-e728-452f-b625-990bf9416380 tempest-VolumesSnapshotListTestJSON-83446071 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:24:32 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[509873de-68c6-4773-b7f0-4bdf9182e24e]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:24:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-66898eeb-e728-452f-b625-990bf9416380 tempest-VolumesSnapshotListTestJSON-83446071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:32 devstack sudo[99495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f Sep 03 11:24:32 devstack sudo[99495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:32 devstack sudo[99493]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-115d231a-37cb-4908-bb97-4959fe47627d tempest-GroupsTest-1650119900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.346s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:32 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-115d231a-37cb-4908-bb97-4959fe47627d tempest-GroupsTest-1650119900 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:24:32 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-115d231a-37cb-4908-bb97-4959fe47627d tempest-GroupsTest-1650119900 None] Delete group completed successfully. Sep 03 11:24:32 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-c94bad02-90a3-4db6-999c-fe934729ed53 tempest-ProjectReaderTests-366065509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:24:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c94bad02-90a3-4db6-999c-fe934729ed53 tempest-ProjectReaderTests-366065509 None] Flow 'volume_create_manager' (7621e421-2fa9-4633-b10e-ae2f24aa2336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:24:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c94bad02-90a3-4db6-999c-fe934729ed53 tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfda3d38-57cd-4501-95cb-2f2fb56fee14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c94bad02-90a3-4db6-999c-fe934729ed53 tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfda3d38-57cd-4501-95cb-2f2fb56fee14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-613353032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77556eee-dacf-444a-8c2c-cd0168113646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e0266a286845c09b90954957712518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:24:33Z,use_quota=True,user_id='68876a5fbdc8486c9de0de0a22bd31b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c94bad02-90a3-4db6-999c-fe934729ed53 tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33d679d8-4a49-4242-9497-eb73fefbd194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c94bad02-90a3-4db6-999c-fe934729ed53 tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33d679d8-4a49-4242-9497-eb73fefbd194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c94bad02-90a3-4db6-999c-fe934729ed53 tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e59b107-6699-4126-bd59-a85c53339088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c94bad02-90a3-4db6-999c-fe934729ed53 tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e59b107-6699-4126-bd59-a85c53339088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77556eee-dacf-444a-8c2c-cd0168113646', 'volume_name': 'volume-77556eee-dacf-444a-8c2c-cd0168113646', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c94bad02-90a3-4db6-999c-fe934729ed53 tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d681d53f-07a1-48b4-b29c-c150d3cabcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c94bad02-90a3-4db6-999c-fe934729ed53 tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d681d53f-07a1-48b4-b29c-c150d3cabcbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c94bad02-90a3-4db6-999c-fe934729ed53 tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9ce630a-f5c9-47a0-bfe7-fce61ed36229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:32 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-c94bad02-90a3-4db6-999c-fe934729ed53 tempest-ProjectReaderTests-366065509 None] Volume 77556eee-dacf-444a-8c2c-cd0168113646: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77556eee-dacf-444a-8c2c-cd0168113646', 'volume_size': 1} Sep 03 11:24:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-c94bad02-90a3-4db6-999c-fe934729ed53 tempest-ProjectReaderTests-366065509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-c94bad02-90a3-4db6-999c-fe934729ed53 tempest-ProjectReaderTests-366065509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-c94bad02-90a3-4db6-999c-fe934729ed53 tempest-ProjectReaderTests-366065509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-613353032',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77556eee-dacf-444a-8c2c-cd0168113646,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e0266a286845c09b90954957712518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:24:33Z,use_quota=True,user_id='68876a5fbdc8486c9de0de0a22bd31b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:24:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-c94bad02-90a3-4db6-999c-fe934729ed53 tempest-ProjectReaderTests-366065509 None] Creating volume 77556eee-dacf-444a-8c2c-cd0168113646 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:24:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-c94bad02-90a3-4db6-999c-fe934729ed53 tempest-ProjectReaderTests-366065509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-c94bad02-90a3-4db6-999c-fe934729ed53 tempest-ProjectReaderTests-366065509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-c94bad02-90a3-4db6-999c-fe934729ed53 tempest-ProjectReaderTests-366065509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:24:33 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-c94bad02-90a3-4db6-999c-fe934729ed53 tempest-ProjectReaderTests-366065509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:24:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-c94bad02-90a3-4db6-999c-fe934729ed53 tempest-ProjectReaderTests-366065509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:33 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-c94bad02-90a3-4db6-999c-fe934729ed53 tempest-ProjectReaderTests-366065509 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:24:33 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-c94bad02-90a3-4db6-999c-fe934729ed53 tempest-ProjectReaderTests-366065509 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:24:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c94bad02-90a3-4db6-999c-fe934729ed53 tempest-ProjectReaderTests-366065509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-77556eee-dacf-444a-8c2c-cd0168113646 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:33 devstack sudo[99500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-77556eee-dacf-444a-8c2c-cd0168113646 1073741824 Sep 03 11:24:33 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:33 devstack sudo[99495]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-66898eeb-e728-452f-b625-990bf9416380 tempest-VolumesSnapshotListTestJSON-83446071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f" returned: 0 in 0.614s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-66898eeb-e728-452f-b625-990bf9416380 tempest-VolumesSnapshotListTestJSON-83446071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.03f1f028-f107-4127-88f1-4c52b028d00f {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:33 devstack sudo[99503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.03f1f028-f107-4127-88f1-4c52b028d00f Sep 03 11:24:33 devstack sudo[99503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:33 devstack sudo[99503]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-66898eeb-e728-452f-b625-990bf9416380 tempest-VolumesSnapshotListTestJSON-83446071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.03f1f028-f107-4127-88f1-4c52b028d00f" returned: 0 in 0.485s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:33 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-66898eeb-e728-452f-b625-990bf9416380 tempest-VolumesSnapshotListTestJSON-83446071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.03f1f028-f107-4127-88f1-4c52b028d00f {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c94bad02-90a3-4db6-999c-fe934729ed53 tempest-ProjectReaderTests-366065509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-77556eee-dacf-444a-8c2c-cd0168113646 1073741824" returned: 0 in 0.613s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:33 devstack sudo[99512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.03f1f028-f107-4127-88f1-4c52b028d00f Sep 03 11:24:33 devstack sudo[99512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c94bad02-90a3-4db6-999c-fe934729ed53 tempest-ProjectReaderTests-366065509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-77556eee-dacf-444a-8c2c-cd0168113646 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:33 devstack sudo[99514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-77556eee-dacf-444a-8c2c-cd0168113646 Sep 03 11:24:33 devstack sudo[99514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:33 devstack sudo[99512]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-66898eeb-e728-452f-b625-990bf9416380 tempest-VolumesSnapshotListTestJSON-83446071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f.03f1f028-f107-4127-88f1-4c52b028d00f" returned: 0 in 0.322s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:33 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-66898eeb-e728-452f-b625-990bf9416380 tempest-VolumesSnapshotListTestJSON-83446071 None] Lock "cinder-quobyte-03f1f028-f107-4127-88f1-4c52b028d00f" released by "_delete_snapshot" :: held 2.016s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:33 devstack sudo[99514]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c94bad02-90a3-4db6-999c-fe934729ed53 tempest-ProjectReaderTests-366065509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-77556eee-dacf-444a-8c2c-cd0168113646" returned: 0 in 0.332s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:33 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-c94bad02-90a3-4db6-999c-fe934729ed53 tempest-ProjectReaderTests-366065509 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:24:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-c94bad02-90a3-4db6-999c-fe934729ed53 tempest-ProjectReaderTests-366065509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:34 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-66898eeb-e728-452f-b625-990bf9416380 tempest-VolumesSnapshotListTestJSON-83446071 None] Lock "cinder-quobyte-45dd0e57-740f-49b8-96eb-88fe00a8b98f" released by "delete_snapshot" :: held 2.064s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:34 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c94bad02-90a3-4db6-999c-fe934729ed53 tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9ce630a-f5c9-47a0-bfe7-fce61ed36229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77556eee-dacf-444a-8c2c-cd0168113646', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:34 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c94bad02-90a3-4db6-999c-fe934729ed53 tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea991ebb-751b-4a9c-bf84-c7b392d849f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:34 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-c94bad02-90a3-4db6-999c-fe934729ed53 tempest-ProjectReaderTests-366065509 None] Volume volume-77556eee-dacf-444a-8c2c-cd0168113646 (77556eee-dacf-444a-8c2c-cd0168113646): created successfully Sep 03 11:24:34 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c94bad02-90a3-4db6-999c-fe934729ed53 tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea991ebb-751b-4a9c-bf84-c7b392d849f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:34 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c94bad02-90a3-4db6-999c-fe934729ed53 tempest-ProjectReaderTests-366065509 None] Flow 'volume_create_manager' (7621e421-2fa9-4633-b10e-ae2f24aa2336) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:24:34 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-c94bad02-90a3-4db6-999c-fe934729ed53 tempest-ProjectReaderTests-366065509 None] Created volume successfully. Sep 03 11:24:34 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-66898eeb-e728-452f-b625-990bf9416380 tempest-VolumesSnapshotListTestJSON-83446071 None] Created reservations ['36fe0622-e098-4e52-85a8-04701a119713', '07c7e928-a6a5-44a6-8617-cf9d85602983', '0705d482-fa90-4eb7-841c-71a1c1b22621', 'b3237e95-2aec-408f-8d60-7b16d9c55b36'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:24:34 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-66898eeb-e728-452f-b625-990bf9416380 tempest-VolumesSnapshotListTestJSON-83446071 None] Delete snapshot completed successfully. Sep 03 11:24:34 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-66898eeb-e728-452f-b625-990bf9416380 tempest-VolumesSnapshotListTestJSON-83446071 None] Lock "cinder-03f1f028-f107-4127-88f1-4c52b028d00f-delete_snapshot" released by "delete_snapshot" :: held 2.300s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b9d5e5b0-15e0-453b-9d95-ac1ec4ba9e18 tempest-ProjectReaderTests-366065509 None] Acquiring lock "cinder-77556eee-dacf-444a-8c2c-cd0168113646-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b9d5e5b0-15e0-453b-9d95-ac1ec4ba9e18 tempest-ProjectReaderTests-366065509 None] Lock "cinder-77556eee-dacf-444a-8c2c-cd0168113646-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b9d5e5b0-15e0-453b-9d95-ac1ec4ba9e18 tempest-ProjectReaderTests-366065509 None] Acquiring lock "cinder-quobyte-77556eee-dacf-444a-8c2c-cd0168113646" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b9d5e5b0-15e0-453b-9d95-ac1ec4ba9e18 tempest-ProjectReaderTests-366065509 None] Lock "cinder-quobyte-77556eee-dacf-444a-8c2c-cd0168113646" acquired by "delete_volume" :: waited 0.020s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:35 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc36b54f-bd90-41c0-878b-3d3251701ead]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:24:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b9d5e5b0-15e0-453b-9d95-ac1ec4ba9e18 tempest-ProjectReaderTests-366065509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-77556eee-dacf-444a-8c2c-cd0168113646 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-951416c5-c352-44c0-8994-820e75e93bbb tempest-VolumesSnapshotListTestJSON-83446071 None] Acquiring lock "cinder-45dd0e57-740f-49b8-96eb-88fe00a8b98f-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-951416c5-c352-44c0-8994-820e75e93bbb tempest-VolumesSnapshotListTestJSON-83446071 None] Lock "cinder-45dd0e57-740f-49b8-96eb-88fe00a8b98f-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-951416c5-c352-44c0-8994-820e75e93bbb tempest-VolumesSnapshotListTestJSON-83446071 None] Acquiring lock "cinder-quobyte-45dd0e57-740f-49b8-96eb-88fe00a8b98f" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:35 devstack sudo[99520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-77556eee-dacf-444a-8c2c-cd0168113646 Sep 03 11:24:35 devstack sudo[99520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-951416c5-c352-44c0-8994-820e75e93bbb tempest-VolumesSnapshotListTestJSON-83446071 None] Lock "cinder-quobyte-45dd0e57-740f-49b8-96eb-88fe00a8b98f" acquired by "delete_volume" :: waited 0.036s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:35 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[816e8be3-3145-4603-bb62-d414d0c07547]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:24:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-951416c5-c352-44c0-8994-820e75e93bbb tempest-VolumesSnapshotListTestJSON-83446071 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:35 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f Sep 03 11:24:35 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:35 devstack sudo[99520]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b9d5e5b0-15e0-453b-9d95-ac1ec4ba9e18 tempest-ProjectReaderTests-366065509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-77556eee-dacf-444a-8c2c-cd0168113646" returned: 0 in 0.516s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b9d5e5b0-15e0-453b-9d95-ac1ec4ba9e18 tempest-ProjectReaderTests-366065509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-77556eee-dacf-444a-8c2c-cd0168113646 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:35 devstack sudo[99534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-77556eee-dacf-444a-8c2c-cd0168113646 Sep 03 11:24:35 devstack sudo[99534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:36 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-951416c5-c352-44c0-8994-820e75e93bbb tempest-VolumesSnapshotListTestJSON-83446071 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f" returned: 0 in 0.527s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-951416c5-c352-44c0-8994-820e75e93bbb tempest-VolumesSnapshotListTestJSON-83446071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:36 devstack sudo[99540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f Sep 03 11:24:36 devstack sudo[99540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:36 devstack sudo[99534]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b9d5e5b0-15e0-453b-9d95-ac1ec4ba9e18 tempest-ProjectReaderTests-366065509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-77556eee-dacf-444a-8c2c-cd0168113646" returned: 0 in 0.365s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b9d5e5b0-15e0-453b-9d95-ac1ec4ba9e18 tempest-ProjectReaderTests-366065509 None] Lock "cinder-quobyte-77556eee-dacf-444a-8c2c-cd0168113646" released by "delete_volume" :: held 0.947s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:36 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-b9d5e5b0-15e0-453b-9d95-ac1ec4ba9e18 tempest-ProjectReaderTests-366065509 None] Created reservations ['6f7567bc-1813-4fd1-a8ea-62f3ac7b4e6e', '878a3533-c0a1-4435-9e12-9c78403322fc', '5747e0ea-18bc-419c-a267-9c95ad99bc34', 'ac9b91ab-ef78-4d13-b608-e8cda3a74828'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:24:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b9d5e5b0-15e0-453b-9d95-ac1ec4ba9e18 tempest-ProjectReaderTests-366065509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b9d5e5b0-15e0-453b-9d95-ac1ec4ba9e18 tempest-ProjectReaderTests-366065509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:36 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-b9d5e5b0-15e0-453b-9d95-ac1ec4ba9e18 tempest-ProjectReaderTests-366065509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:24:36 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-b9d5e5b0-15e0-453b-9d95-ac1ec4ba9e18 tempest-ProjectReaderTests-366065509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:24:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b9d5e5b0-15e0-453b-9d95-ac1ec4ba9e18 tempest-ProjectReaderTests-366065509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b9d5e5b0-15e0-453b-9d95-ac1ec4ba9e18 tempest-ProjectReaderTests-366065509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:36 devstack sudo[99544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:24:36 devstack sudo[99540]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:36 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-951416c5-c352-44c0-8994-820e75e93bbb tempest-VolumesSnapshotListTestJSON-83446071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-45dd0e57-740f-49b8-96eb-88fe00a8b98f" returned: 0 in 0.373s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-951416c5-c352-44c0-8994-820e75e93bbb tempest-VolumesSnapshotListTestJSON-83446071 None] Lock "cinder-quobyte-45dd0e57-740f-49b8-96eb-88fe00a8b98f" released by "delete_volume" :: held 0.982s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:36 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-951416c5-c352-44c0-8994-820e75e93bbb tempest-VolumesSnapshotListTestJSON-83446071 None] Created reservations ['210b17e9-8299-492c-be59-9869c92623db', '52183221-b085-4a8e-8fbb-0cd2aadff30b', '0e3d4c31-466e-4c42-9642-3d615b959f10', 'af01ba5e-aa17-4ae1-b7de-61b86f258828'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:24:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-951416c5-c352-44c0-8994-820e75e93bbb tempest-VolumesSnapshotListTestJSON-83446071 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-951416c5-c352-44c0-8994-820e75e93bbb tempest-VolumesSnapshotListTestJSON-83446071 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:36 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-951416c5-c352-44c0-8994-820e75e93bbb tempest-VolumesSnapshotListTestJSON-83446071 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:24:36 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-951416c5-c352-44c0-8994-820e75e93bbb tempest-VolumesSnapshotListTestJSON-83446071 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:24:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-951416c5-c352-44c0-8994-820e75e93bbb tempest-VolumesSnapshotListTestJSON-83446071 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-951416c5-c352-44c0-8994-820e75e93bbb tempest-VolumesSnapshotListTestJSON-83446071 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:36 devstack sudo[99546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:24:36 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:36 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b9d5e5b0-15e0-453b-9d95-ac1ec4ba9e18 tempest-ProjectReaderTests-366065509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.402s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:36 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-b9d5e5b0-15e0-453b-9d95-ac1ec4ba9e18 tempest-ProjectReaderTests-366065509 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:24:36 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-b9d5e5b0-15e0-453b-9d95-ac1ec4ba9e18 tempest-ProjectReaderTests-366065509 None] Deleted volume successfully. Sep 03 11:24:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b9d5e5b0-15e0-453b-9d95-ac1ec4ba9e18 tempest-ProjectReaderTests-366065509 None] Lock "cinder-77556eee-dacf-444a-8c2c-cd0168113646-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:36 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-951416c5-c352-44c0-8994-820e75e93bbb tempest-VolumesSnapshotListTestJSON-83446071 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.312s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:36 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-951416c5-c352-44c0-8994-820e75e93bbb tempest-VolumesSnapshotListTestJSON-83446071 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:24:36 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-951416c5-c352-44c0-8994-820e75e93bbb tempest-VolumesSnapshotListTestJSON-83446071 None] Deleted volume successfully. Sep 03 11:24:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-951416c5-c352-44c0-8994-820e75e93bbb tempest-VolumesSnapshotListTestJSON-83446071 None] Lock "cinder-45dd0e57-740f-49b8-96eb-88fe00a8b98f-delete_volume" released by "delete_volume" :: held 1.567s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:38 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5212ad0-9072-4d71-8eff-4b57611935c1 tempest-ProjectReaderTests-366065509 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:24:38 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e5212ad0-9072-4d71-8eff-4b57611935c1 tempest-ProjectReaderTests-366065509 None] Flow 'volume_create_manager' (828beeed-06c2-42ee-9d63-99d4b46d4403) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:24:38 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e5212ad0-9072-4d71-8eff-4b57611935c1 tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9aab035-3bc7-4aba-8e07-c1a71c6fea06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:38 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e5212ad0-9072-4d71-8eff-4b57611935c1 tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9aab035-3bc7-4aba-8e07-c1a71c6fea06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1645450693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3cc129a-e48a-49a1-a12d-cbcc4a56d769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e0266a286845c09b90954957712518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:24:38Z,use_quota=True,user_id='68876a5fbdc8486c9de0de0a22bd31b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:38 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e5212ad0-9072-4d71-8eff-4b57611935c1 tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (566bc237-d8b4-437d-b1b8-20e856c6cc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:38 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e5212ad0-9072-4d71-8eff-4b57611935c1 tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (566bc237-d8b4-437d-b1b8-20e856c6cc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:38 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e5212ad0-9072-4d71-8eff-4b57611935c1 tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3dbb887-d6cf-4567-b329-8421455f5969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:38 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e5212ad0-9072-4d71-8eff-4b57611935c1 tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f3dbb887-d6cf-4567-b329-8421455f5969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3cc129a-e48a-49a1-a12d-cbcc4a56d769', 'volume_name': 'volume-f3cc129a-e48a-49a1-a12d-cbcc4a56d769', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:38 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e5212ad0-9072-4d71-8eff-4b57611935c1 tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0943d94f-e0c7-4ef5-b68c-2fa6c0718bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:38 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e5212ad0-9072-4d71-8eff-4b57611935c1 tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0943d94f-e0c7-4ef5-b68c-2fa6c0718bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:38 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e5212ad0-9072-4d71-8eff-4b57611935c1 tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06c316a1-cd06-422f-9a86-dd78ed1a60d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:38 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-e5212ad0-9072-4d71-8eff-4b57611935c1 tempest-ProjectReaderTests-366065509 None] Volume f3cc129a-e48a-49a1-a12d-cbcc4a56d769: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3cc129a-e48a-49a1-a12d-cbcc4a56d769', 'volume_size': 1} Sep 03 11:24:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e5212ad0-9072-4d71-8eff-4b57611935c1 tempest-ProjectReaderTests-366065509 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e5212ad0-9072-4d71-8eff-4b57611935c1 tempest-ProjectReaderTests-366065509 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:38 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e5212ad0-9072-4d71-8eff-4b57611935c1 tempest-ProjectReaderTests-366065509 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1645450693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3cc129a-e48a-49a1-a12d-cbcc4a56d769,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='11e0266a286845c09b90954957712518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:24:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:24:38Z,use_quota=True,user_id='68876a5fbdc8486c9de0de0a22bd31b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:24:38 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-e5212ad0-9072-4d71-8eff-4b57611935c1 tempest-ProjectReaderTests-366065509 None] Creating volume f3cc129a-e48a-49a1-a12d-cbcc4a56d769 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:24:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e5212ad0-9072-4d71-8eff-4b57611935c1 tempest-ProjectReaderTests-366065509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e5212ad0-9072-4d71-8eff-4b57611935c1 tempest-ProjectReaderTests-366065509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:38 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e5212ad0-9072-4d71-8eff-4b57611935c1 tempest-ProjectReaderTests-366065509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:24:38 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e5212ad0-9072-4d71-8eff-4b57611935c1 tempest-ProjectReaderTests-366065509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:24:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e5212ad0-9072-4d71-8eff-4b57611935c1 tempest-ProjectReaderTests-366065509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:38 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e5212ad0-9072-4d71-8eff-4b57611935c1 tempest-ProjectReaderTests-366065509 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:24:38 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-e5212ad0-9072-4d71-8eff-4b57611935c1 tempest-ProjectReaderTests-366065509 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:24:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e5212ad0-9072-4d71-8eff-4b57611935c1 tempest-ProjectReaderTests-366065509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3cc129a-e48a-49a1-a12d-cbcc4a56d769 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:38 devstack sudo[99554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3cc129a-e48a-49a1-a12d-cbcc4a56d769 1073741824 Sep 03 11:24:38 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:38 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e5212ad0-9072-4d71-8eff-4b57611935c1 tempest-ProjectReaderTests-366065509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3cc129a-e48a-49a1-a12d-cbcc4a56d769 1073741824" returned: 0 in 0.732s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e5212ad0-9072-4d71-8eff-4b57611935c1 tempest-ProjectReaderTests-366065509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3cc129a-e48a-49a1-a12d-cbcc4a56d769 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:39 devstack sudo[99567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3cc129a-e48a-49a1-a12d-cbcc4a56d769 Sep 03 11:24:39 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:39 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e5212ad0-9072-4d71-8eff-4b57611935c1 tempest-ProjectReaderTests-366065509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3cc129a-e48a-49a1-a12d-cbcc4a56d769" returned: 0 in 0.533s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e5212ad0-9072-4d71-8eff-4b57611935c1 tempest-ProjectReaderTests-366065509 None] <== create_volume: return (1335ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:24:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e5212ad0-9072-4d71-8eff-4b57611935c1 tempest-ProjectReaderTests-366065509 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.339s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e5212ad0-9072-4d71-8eff-4b57611935c1 tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06c316a1-cd06-422f-9a86-dd78ed1a60d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3cc129a-e48a-49a1-a12d-cbcc4a56d769', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e5212ad0-9072-4d71-8eff-4b57611935c1 tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbdc9cef-03c5-4fe5-88f1-0e17408b52b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:39 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-e5212ad0-9072-4d71-8eff-4b57611935c1 tempest-ProjectReaderTests-366065509 None] Volume volume-f3cc129a-e48a-49a1-a12d-cbcc4a56d769 (f3cc129a-e48a-49a1-a12d-cbcc4a56d769): created successfully Sep 03 11:24:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e5212ad0-9072-4d71-8eff-4b57611935c1 tempest-ProjectReaderTests-366065509 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbdc9cef-03c5-4fe5-88f1-0e17408b52b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e5212ad0-9072-4d71-8eff-4b57611935c1 tempest-ProjectReaderTests-366065509 None] Flow 'volume_create_manager' (828beeed-06c2-42ee-9d63-99d4b46d4403) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:24:39 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-e5212ad0-9072-4d71-8eff-4b57611935c1 tempest-ProjectReaderTests-366065509 None] Created volume successfully. Sep 03 11:24:39 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-2877c815-20c7-4ef3-a876-cf7531742ba4 tempest-SnapshotsActionsTest-887629224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:24:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2877c815-20c7-4ef3-a876-cf7531742ba4 tempest-SnapshotsActionsTest-887629224 None] Flow 'volume_create_manager' (58177c06-3d3f-4583-9008-14e324ee2db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:24:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2877c815-20c7-4ef3-a876-cf7531742ba4 tempest-SnapshotsActionsTest-887629224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aedb1839-9173-49af-9d6a-e098a11c97ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2877c815-20c7-4ef3-a876-cf7531742ba4 tempest-SnapshotsActionsTest-887629224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aedb1839-9173-49af-9d6a-e098a11c97ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-176360434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e039c8d5-c256-4c95-902c-b5e3359ffca9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4715d606e2f480f9746e03f599fb064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:24:40Z,use_quota=True,user_id='7a68ff40b1624518bec852ad8b64fcc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2877c815-20c7-4ef3-a876-cf7531742ba4 tempest-SnapshotsActionsTest-887629224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2d9d382-afca-4e89-b29a-d2d0281056e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2877c815-20c7-4ef3-a876-cf7531742ba4 tempest-SnapshotsActionsTest-887629224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2d9d382-afca-4e89-b29a-d2d0281056e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2877c815-20c7-4ef3-a876-cf7531742ba4 tempest-SnapshotsActionsTest-887629224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bf65a5a-2273-436b-a77a-61e278650299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2877c815-20c7-4ef3-a876-cf7531742ba4 tempest-SnapshotsActionsTest-887629224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bf65a5a-2273-436b-a77a-61e278650299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e039c8d5-c256-4c95-902c-b5e3359ffca9', 'volume_name': 'volume-e039c8d5-c256-4c95-902c-b5e3359ffca9', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2877c815-20c7-4ef3-a876-cf7531742ba4 tempest-SnapshotsActionsTest-887629224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0439f5c-c651-4f4f-919d-aabfc9afb3eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2877c815-20c7-4ef3-a876-cf7531742ba4 tempest-SnapshotsActionsTest-887629224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0439f5c-c651-4f4f-919d-aabfc9afb3eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2877c815-20c7-4ef3-a876-cf7531742ba4 tempest-SnapshotsActionsTest-887629224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69b3df73-16fa-4dec-8f2a-2dcfb149971d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:39 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-2877c815-20c7-4ef3-a876-cf7531742ba4 tempest-SnapshotsActionsTest-887629224 None] Volume e039c8d5-c256-4c95-902c-b5e3359ffca9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e039c8d5-c256-4c95-902c-b5e3359ffca9', 'volume_size': 1} Sep 03 11:24:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2877c815-20c7-4ef3-a876-cf7531742ba4 tempest-SnapshotsActionsTest-887629224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2877c815-20c7-4ef3-a876-cf7531742ba4 tempest-SnapshotsActionsTest-887629224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2877c815-20c7-4ef3-a876-cf7531742ba4 tempest-SnapshotsActionsTest-887629224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-176360434',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e039c8d5-c256-4c95-902c-b5e3359ffca9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4715d606e2f480f9746e03f599fb064',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:24:40Z,use_quota=True,user_id='7a68ff40b1624518bec852ad8b64fcc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:24:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-2877c815-20c7-4ef3-a876-cf7531742ba4 tempest-SnapshotsActionsTest-887629224 None] Creating volume e039c8d5-c256-4c95-902c-b5e3359ffca9 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:24:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2877c815-20c7-4ef3-a876-cf7531742ba4 tempest-SnapshotsActionsTest-887629224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2877c815-20c7-4ef3-a876-cf7531742ba4 tempest-SnapshotsActionsTest-887629224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2877c815-20c7-4ef3-a876-cf7531742ba4 tempest-SnapshotsActionsTest-887629224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:24:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2877c815-20c7-4ef3-a876-cf7531742ba4 tempest-SnapshotsActionsTest-887629224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:24:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2877c815-20c7-4ef3-a876-cf7531742ba4 tempest-SnapshotsActionsTest-887629224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2877c815-20c7-4ef3-a876-cf7531742ba4 tempest-SnapshotsActionsTest-887629224 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:24:39 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-2877c815-20c7-4ef3-a876-cf7531742ba4 tempest-SnapshotsActionsTest-887629224 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:24:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2877c815-20c7-4ef3-a876-cf7531742ba4 tempest-SnapshotsActionsTest-887629224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:39 devstack sudo[99578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9 1073741824 Sep 03 11:24:39 devstack sudo[99578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:40 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-9f274ef9-b7b0-430f-9172-919532b135a2 tempest-ProjectReaderTests-366065509 None] Acquiring lock "cinder-f3cc129a-e48a-49a1-a12d-cbcc4a56d769-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:40 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-9f274ef9-b7b0-430f-9172-919532b135a2 tempest-ProjectReaderTests-366065509 None] Lock "cinder-f3cc129a-e48a-49a1-a12d-cbcc4a56d769-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:40 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-9f274ef9-b7b0-430f-9172-919532b135a2 tempest-ProjectReaderTests-366065509 None] Acquiring lock "cinder-quobyte-f3cc129a-e48a-49a1-a12d-cbcc4a56d769" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:40 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-9f274ef9-b7b0-430f-9172-919532b135a2 tempest-ProjectReaderTests-366065509 None] Lock "cinder-quobyte-f3cc129a-e48a-49a1-a12d-cbcc4a56d769" acquired by "delete_volume" :: waited 0.015s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:40 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19ec8c9-490a-4e83-8c25-84533bab593e]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:24:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9f274ef9-b7b0-430f-9172-919532b135a2 tempest-ProjectReaderTests-366065509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3cc129a-e48a-49a1-a12d-cbcc4a56d769 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:40 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3cc129a-e48a-49a1-a12d-cbcc4a56d769 Sep 03 11:24:40 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:40 devstack sudo[99578]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2877c815-20c7-4ef3-a876-cf7531742ba4 tempest-SnapshotsActionsTest-887629224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9 1073741824" returned: 0 in 0.612s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2877c815-20c7-4ef3-a876-cf7531742ba4 tempest-SnapshotsActionsTest-887629224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:40 devstack sudo[99586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9 Sep 03 11:24:40 devstack sudo[99586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:40 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9f274ef9-b7b0-430f-9172-919532b135a2 tempest-ProjectReaderTests-366065509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3cc129a-e48a-49a1-a12d-cbcc4a56d769" returned: 0 in 0.454s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9f274ef9-b7b0-430f-9172-919532b135a2 tempest-ProjectReaderTests-366065509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3cc129a-e48a-49a1-a12d-cbcc4a56d769 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:40 devstack sudo[99591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3cc129a-e48a-49a1-a12d-cbcc4a56d769 Sep 03 11:24:40 devstack sudo[99591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:40 devstack sudo[99586]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2877c815-20c7-4ef3-a876-cf7531742ba4 tempest-SnapshotsActionsTest-887629224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9" returned: 0 in 0.318s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:40 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2877c815-20c7-4ef3-a876-cf7531742ba4 tempest-SnapshotsActionsTest-887629224 None] <== create_volume: return (985ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:24:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2877c815-20c7-4ef3-a876-cf7531742ba4 tempest-SnapshotsActionsTest-887629224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2877c815-20c7-4ef3-a876-cf7531742ba4 tempest-SnapshotsActionsTest-887629224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69b3df73-16fa-4dec-8f2a-2dcfb149971d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e039c8d5-c256-4c95-902c-b5e3359ffca9', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2877c815-20c7-4ef3-a876-cf7531742ba4 tempest-SnapshotsActionsTest-887629224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (453b3f2f-0e55-41ec-aced-7b1d5cab7788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:24:40 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-2877c815-20c7-4ef3-a876-cf7531742ba4 tempest-SnapshotsActionsTest-887629224 None] Volume volume-e039c8d5-c256-4c95-902c-b5e3359ffca9 (e039c8d5-c256-4c95-902c-b5e3359ffca9): created successfully Sep 03 11:24:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2877c815-20c7-4ef3-a876-cf7531742ba4 tempest-SnapshotsActionsTest-887629224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (453b3f2f-0e55-41ec-aced-7b1d5cab7788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:24:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2877c815-20c7-4ef3-a876-cf7531742ba4 tempest-SnapshotsActionsTest-887629224 None] Flow 'volume_create_manager' (58177c06-3d3f-4583-9008-14e324ee2db4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:24:40 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-2877c815-20c7-4ef3-a876-cf7531742ba4 tempest-SnapshotsActionsTest-887629224 None] Created volume successfully. Sep 03 11:24:41 devstack sudo[99591]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9f274ef9-b7b0-430f-9172-919532b135a2 tempest-ProjectReaderTests-366065509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f3cc129a-e48a-49a1-a12d-cbcc4a56d769" returned: 0 in 0.306s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-9f274ef9-b7b0-430f-9172-919532b135a2 tempest-ProjectReaderTests-366065509 None] Lock "cinder-quobyte-f3cc129a-e48a-49a1-a12d-cbcc4a56d769" released by "delete_volume" :: held 0.826s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:41 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-9f274ef9-b7b0-430f-9172-919532b135a2 tempest-ProjectReaderTests-366065509 None] Created reservations ['87abe2c4-0008-42f2-b6a6-12d99e67fd83', '47340b11-fcfe-4a9a-a132-c72f9a54b913', 'b722f959-28f1-4111-b853-273648935512', 'eae51cc3-c141-4b60-940d-f7dc42505639'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:24:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9f274ef9-b7b0-430f-9172-919532b135a2 tempest-ProjectReaderTests-366065509 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9f274ef9-b7b0-430f-9172-919532b135a2 tempest-ProjectReaderTests-366065509 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:41 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-9f274ef9-b7b0-430f-9172-919532b135a2 tempest-ProjectReaderTests-366065509 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:24:41 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-9f274ef9-b7b0-430f-9172-919532b135a2 tempest-ProjectReaderTests-366065509 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:24:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9f274ef9-b7b0-430f-9172-919532b135a2 tempest-ProjectReaderTests-366065509 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9f274ef9-b7b0-430f-9172-919532b135a2 tempest-ProjectReaderTests-366065509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:41 devstack sudo[99596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:24:41 devstack sudo[99596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:41 devstack sudo[99596]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9f274ef9-b7b0-430f-9172-919532b135a2 tempest-ProjectReaderTests-366065509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.315s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:41 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-9f274ef9-b7b0-430f-9172-919532b135a2 tempest-ProjectReaderTests-366065509 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:24:41 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-9f274ef9-b7b0-430f-9172-919532b135a2 tempest-ProjectReaderTests-366065509 None] Deleted volume successfully. Sep 03 11:24:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-9f274ef9-b7b0-430f-9172-919532b135a2 tempest-ProjectReaderTests-366065509 None] Lock "cinder-f3cc129a-e48a-49a1-a12d-cbcc4a56d769-delete_volume" released by "delete_volume" :: held 1.423s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-781ce0a5-bcb1-453e-a224-d5f5cbf82545 tempest-SnapshotsActionsTest-887629224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-781ce0a5-bcb1-453e-a224-d5f5cbf82545 tempest-SnapshotsActionsTest-887629224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:42 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-781ce0a5-bcb1-453e-a224-d5f5cbf82545 tempest-SnapshotsActionsTest-887629224 None] Creating offline snapshot c4b256ae-4507-428c-b54d-1fd6bdffe6c4 of volume e039c8d5-c256-4c95-902c-b5e3359ffca9 {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:24:42 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5785b2-6c6e-4ea1-bb29-b5cc75f4733f]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:24:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-781ce0a5-bcb1-453e-a224-d5f5cbf82545 tempest-SnapshotsActionsTest-887629224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:42 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9 Sep 03 11:24:42 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:43 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-781ce0a5-bcb1-453e-a224-d5f5cbf82545 tempest-SnapshotsActionsTest-887629224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9" returned: 0 in 0.831s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-781ce0a5-bcb1-453e-a224-d5f5cbf82545 tempest-SnapshotsActionsTest-887629224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:43 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 1G Sep 03 11:24:43 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:44 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-781ce0a5-bcb1-453e-a224-d5f5cbf82545 tempest-SnapshotsActionsTest-887629224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 1G" returned: 0 in 0.644s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-781ce0a5-bcb1-453e-a224-d5f5cbf82545 tempest-SnapshotsActionsTest-887629224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e039c8d5-c256-4c95-902c-b5e3359ffca9 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:44 devstack sudo[99679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e039c8d5-c256-4c95-902c-b5e3359ffca9 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 Sep 03 11:24:44 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:44 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-781ce0a5-bcb1-453e-a224-d5f5cbf82545 tempest-SnapshotsActionsTest-887629224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e039c8d5-c256-4c95-902c-b5e3359ffca9 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4" returned: 0 in 0.559s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:44 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-781ce0a5-bcb1-453e-a224-d5f5cbf82545 tempest-SnapshotsActionsTest-887629224 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 is being set with open permissions: ugo+rw Sep 03 11:24:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-781ce0a5-bcb1-453e-a224-d5f5cbf82545 tempest-SnapshotsActionsTest-887629224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:44 devstack sudo[99684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 Sep 03 11:24:44 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:44 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-781ce0a5-bcb1-453e-a224-d5f5cbf82545 tempest-SnapshotsActionsTest-887629224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4" returned: 0 in 0.388s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-781ce0a5-bcb1-453e-a224-d5f5cbf82545 tempest-SnapshotsActionsTest-887629224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:45 devstack sudo[99687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.info Sep 03 11:24:45 devstack sudo[99687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:45 devstack sudo[99687]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-781ce0a5-bcb1-453e-a224-d5f5cbf82545 tempest-SnapshotsActionsTest-887629224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.info" returned: 0 in 0.350s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:45 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-781ce0a5-bcb1-453e-a224-d5f5cbf82545 tempest-SnapshotsActionsTest-887629224 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.info is being set with open permissions: ugo+rw Sep 03 11:24:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-781ce0a5-bcb1-453e-a224-d5f5cbf82545 tempest-SnapshotsActionsTest-887629224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:45 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.info Sep 03 11:24:45 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:45 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-781ce0a5-bcb1-453e-a224-d5f5cbf82545 tempest-SnapshotsActionsTest-887629224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.info" returned: 0 in 0.308s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-781ce0a5-bcb1-453e-a224-d5f5cbf82545 tempest-SnapshotsActionsTest-887629224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.269s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:45 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-781ce0a5-bcb1-453e-a224-d5f5cbf82545 tempest-SnapshotsActionsTest-887629224 None] Create snapshot completed successfully Sep 03 11:24:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-23015f4b-05b6-4375-b1b6-430759ab29ec tempest-SnapshotsActionsTest-887629224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-23015f4b-05b6-4375-b1b6-430759ab29ec tempest-SnapshotsActionsTest-887629224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:47 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-23015f4b-05b6-4375-b1b6-430759ab29ec tempest-SnapshotsActionsTest-887629224 None] Creating offline snapshot 9231eeae-226d-4b32-b4b1-2bf2e89329d2 of volume e039c8d5-c256-4c95-902c-b5e3359ffca9 {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:24:48 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67347c2-d827-4826-a770-b20607f984bc]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:24:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23015f4b-05b6-4375-b1b6-430759ab29ec tempest-SnapshotsActionsTest-887629224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:48 devstack sudo[99700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 Sep 03 11:24:48 devstack sudo[99700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:48 devstack sudo[99700]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23015f4b-05b6-4375-b1b6-430759ab29ec tempest-SnapshotsActionsTest-887629224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4" returned: 0 in 0.569s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-23015f4b-05b6-4375-b1b6-430759ab29ec tempest-SnapshotsActionsTest-887629224 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e039c8d5-c256-4c95-902c-b5e3359ffca9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:24:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23015f4b-05b6-4375-b1b6-430759ab29ec tempest-SnapshotsActionsTest-887629224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.9231eeae-226d-4b32-b4b1-2bf2e89329d2 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:48 devstack sudo[99711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.9231eeae-226d-4b32-b4b1-2bf2e89329d2 1G Sep 03 11:24:48 devstack sudo[99711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:49 devstack sudo[99711]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23015f4b-05b6-4375-b1b6-430759ab29ec tempest-SnapshotsActionsTest-887629224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.9231eeae-226d-4b32-b4b1-2bf2e89329d2 1G" returned: 0 in 0.664s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23015f4b-05b6-4375-b1b6-430759ab29ec tempest-SnapshotsActionsTest-887629224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.9231eeae-226d-4b32-b4b1-2bf2e89329d2 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:49 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.9231eeae-226d-4b32-b4b1-2bf2e89329d2 Sep 03 11:24:49 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:49 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23015f4b-05b6-4375-b1b6-430759ab29ec tempest-SnapshotsActionsTest-887629224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.9231eeae-226d-4b32-b4b1-2bf2e89329d2" returned: 0 in 0.465s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:49 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-23015f4b-05b6-4375-b1b6-430759ab29ec tempest-SnapshotsActionsTest-887629224 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.9231eeae-226d-4b32-b4b1-2bf2e89329d2 is being set with open permissions: ugo+rw Sep 03 11:24:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23015f4b-05b6-4375-b1b6-430759ab29ec tempest-SnapshotsActionsTest-887629224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.9231eeae-226d-4b32-b4b1-2bf2e89329d2 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:49 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.9231eeae-226d-4b32-b4b1-2bf2e89329d2 Sep 03 11:24:49 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:49 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23015f4b-05b6-4375-b1b6-430759ab29ec tempest-SnapshotsActionsTest-887629224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.9231eeae-226d-4b32-b4b1-2bf2e89329d2" returned: 0 in 0.262s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-23015f4b-05b6-4375-b1b6-430759ab29ec tempest-SnapshotsActionsTest-887629224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.123s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:50 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-23015f4b-05b6-4375-b1b6-430759ab29ec tempest-SnapshotsActionsTest-887629224 None] Create snapshot completed successfully Sep 03 11:24:51 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2010c120-b9b7-4fae-b5dd-e41ef1a041b4 tempest-SnapshotsActionsTest-1516157241 None] Acquiring lock "cinder-9231eeae-226d-4b32-b4b1-2bf2e89329d2-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:51 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2010c120-b9b7-4fae-b5dd-e41ef1a041b4 tempest-SnapshotsActionsTest-1516157241 None] Lock "cinder-9231eeae-226d-4b32-b4b1-2bf2e89329d2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:51 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2010c120-b9b7-4fae-b5dd-e41ef1a041b4 tempest-SnapshotsActionsTest-1516157241 None] Acquiring lock "cinder-quobyte-e039c8d5-c256-4c95-902c-b5e3359ffca9" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:51 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2010c120-b9b7-4fae-b5dd-e41ef1a041b4 tempest-SnapshotsActionsTest-1516157241 None] Lock "cinder-quobyte-e039c8d5-c256-4c95-902c-b5e3359ffca9" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:51 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2010c120-b9b7-4fae-b5dd-e41ef1a041b4 tempest-SnapshotsActionsTest-1516157241 None] Acquiring lock "cinder-quobyte-9231eeae-226d-4b32-b4b1-2bf2e89329d2" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:51 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2010c120-b9b7-4fae-b5dd-e41ef1a041b4 tempest-SnapshotsActionsTest-1516157241 None] Lock "cinder-quobyte-9231eeae-226d-4b32-b4b1-2bf2e89329d2" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:51 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-2010c120-b9b7-4fae-b5dd-e41ef1a041b4 tempest-SnapshotsActionsTest-1516157241 None] Deleting offline snapshot 9231eeae-226d-4b32-b4b1-2bf2e89329d2 of volume e039c8d5-c256-4c95-902c-b5e3359ffca9 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:24:51 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-2010c120-b9b7-4fae-b5dd-e41ef1a041b4 tempest-SnapshotsActionsTest-1516157241 None] snapshot_file for this snap is: volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.9231eeae-226d-4b32-b4b1-2bf2e89329d2 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:24:51 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac7d58a7-9102-471e-bc8c-85b116e9d658]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:24:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2010c120-b9b7-4fae-b5dd-e41ef1a041b4 tempest-SnapshotsActionsTest-1516157241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.9231eeae-226d-4b32-b4b1-2bf2e89329d2 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:51 devstack sudo[99724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.9231eeae-226d-4b32-b4b1-2bf2e89329d2 Sep 03 11:24:51 devstack sudo[99724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:51 devstack sudo[99724]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2010c120-b9b7-4fae-b5dd-e41ef1a041b4 tempest-SnapshotsActionsTest-1516157241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.9231eeae-226d-4b32-b4b1-2bf2e89329d2" returned: 0 in 0.387s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:51 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-2010c120-b9b7-4fae-b5dd-e41ef1a041b4 tempest-SnapshotsActionsTest-1516157241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e039c8d5-c256-4c95-902c-b5e3359ffca9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:24:51 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0287658-3c95-479a-8ee1-580b6f849b19]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:24:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2010c120-b9b7-4fae-b5dd-e41ef1a041b4 tempest-SnapshotsActionsTest-1516157241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:51 devstack sudo[99730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 Sep 03 11:24:51 devstack sudo[99730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:52 devstack sudo[99730]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2010c120-b9b7-4fae-b5dd-e41ef1a041b4 tempest-SnapshotsActionsTest-1516157241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4" returned: 0 in 0.432s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:52 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-2010c120-b9b7-4fae-b5dd-e41ef1a041b4 tempest-SnapshotsActionsTest-1516157241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e039c8d5-c256-4c95-902c-b5e3359ffca9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:24:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2010c120-b9b7-4fae-b5dd-e41ef1a041b4 tempest-SnapshotsActionsTest-1516157241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.9231eeae-226d-4b32-b4b1-2bf2e89329d2 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:52 devstack sudo[99735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.9231eeae-226d-4b32-b4b1-2bf2e89329d2 Sep 03 11:24:52 devstack sudo[99735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:52 devstack sudo[99735]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2010c120-b9b7-4fae-b5dd-e41ef1a041b4 tempest-SnapshotsActionsTest-1516157241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.9231eeae-226d-4b32-b4b1-2bf2e89329d2" returned: 0 in 0.543s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2010c120-b9b7-4fae-b5dd-e41ef1a041b4 tempest-SnapshotsActionsTest-1516157241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.9231eeae-226d-4b32-b4b1-2bf2e89329d2 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:52 devstack sudo[99741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.9231eeae-226d-4b32-b4b1-2bf2e89329d2 Sep 03 11:24:52 devstack sudo[99741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:53 devstack sudo[99741]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2010c120-b9b7-4fae-b5dd-e41ef1a041b4 tempest-SnapshotsActionsTest-1516157241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.9231eeae-226d-4b32-b4b1-2bf2e89329d2" returned: 0 in 0.292s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:53 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2010c120-b9b7-4fae-b5dd-e41ef1a041b4 tempest-SnapshotsActionsTest-1516157241 None] Lock "cinder-quobyte-9231eeae-226d-4b32-b4b1-2bf2e89329d2" released by "_delete_snapshot" :: held 1.784s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:53 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2010c120-b9b7-4fae-b5dd-e41ef1a041b4 tempest-SnapshotsActionsTest-1516157241 None] Lock "cinder-quobyte-e039c8d5-c256-4c95-902c-b5e3359ffca9" released by "delete_snapshot" :: held 1.824s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:53 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-2010c120-b9b7-4fae-b5dd-e41ef1a041b4 tempest-SnapshotsActionsTest-1516157241 None] Created reservations ['41fc0d5b-ac47-4748-9d28-af22274489ac', '3e1dbb29-8db2-48cc-ac49-1e6b746ddf35', '974a7ea4-0121-4906-b0f5-bd3039a3c4a1', '32a0cb48-899b-47a5-ac84-908e95536fe7'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:24:53 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-2010c120-b9b7-4fae-b5dd-e41ef1a041b4 tempest-SnapshotsActionsTest-1516157241 None] Delete snapshot completed successfully. Sep 03 11:24:53 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2010c120-b9b7-4fae-b5dd-e41ef1a041b4 tempest-SnapshotsActionsTest-1516157241 None] Lock "cinder-9231eeae-226d-4b32-b4b1-2bf2e89329d2-delete_snapshot" released by "delete_snapshot" :: held 2.009s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f53d70d9-8ff2-4e53-b7aa-ec30ee197838 tempest-SnapshotsActionsTest-887629224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f53d70d9-8ff2-4e53-b7aa-ec30ee197838 tempest-SnapshotsActionsTest-887629224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:53 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-f53d70d9-8ff2-4e53-b7aa-ec30ee197838 tempest-SnapshotsActionsTest-887629224 None] Creating offline snapshot d24f6169-034e-4fd7-ac6c-ed57cfca96ef of volume e039c8d5-c256-4c95-902c-b5e3359ffca9 {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:24:53 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[c037272d-4585-4a30-99a2-85b327790be8]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:24:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f53d70d9-8ff2-4e53-b7aa-ec30ee197838 tempest-SnapshotsActionsTest-887629224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:53 devstack sudo[99744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 Sep 03 11:24:53 devstack sudo[99744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:54 devstack sudo[99744]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f53d70d9-8ff2-4e53-b7aa-ec30ee197838 tempest-SnapshotsActionsTest-887629224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4" returned: 0 in 0.388s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:54 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-f53d70d9-8ff2-4e53-b7aa-ec30ee197838 tempest-SnapshotsActionsTest-887629224 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e039c8d5-c256-4c95-902c-b5e3359ffca9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:24:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f53d70d9-8ff2-4e53-b7aa-ec30ee197838 tempest-SnapshotsActionsTest-887629224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.d24f6169-034e-4fd7-ac6c-ed57cfca96ef 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:54 devstack sudo[99749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.d24f6169-034e-4fd7-ac6c-ed57cfca96ef 1G Sep 03 11:24:54 devstack sudo[99749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:54 devstack sudo[99749]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f53d70d9-8ff2-4e53-b7aa-ec30ee197838 tempest-SnapshotsActionsTest-887629224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.d24f6169-034e-4fd7-ac6c-ed57cfca96ef 1G" returned: 0 in 0.673s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f53d70d9-8ff2-4e53-b7aa-ec30ee197838 tempest-SnapshotsActionsTest-887629224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.d24f6169-034e-4fd7-ac6c-ed57cfca96ef {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:54 devstack sudo[99755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.d24f6169-034e-4fd7-ac6c-ed57cfca96ef Sep 03 11:24:54 devstack sudo[99755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:55 devstack sudo[99755]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f53d70d9-8ff2-4e53-b7aa-ec30ee197838 tempest-SnapshotsActionsTest-887629224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.d24f6169-034e-4fd7-ac6c-ed57cfca96ef" returned: 0 in 0.373s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:55 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-f53d70d9-8ff2-4e53-b7aa-ec30ee197838 tempest-SnapshotsActionsTest-887629224 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.d24f6169-034e-4fd7-ac6c-ed57cfca96ef is being set with open permissions: ugo+rw Sep 03 11:24:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f53d70d9-8ff2-4e53-b7aa-ec30ee197838 tempest-SnapshotsActionsTest-887629224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.d24f6169-034e-4fd7-ac6c-ed57cfca96ef {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:55 devstack sudo[99760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.d24f6169-034e-4fd7-ac6c-ed57cfca96ef Sep 03 11:24:55 devstack sudo[99760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:55 devstack sudo[99760]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f53d70d9-8ff2-4e53-b7aa-ec30ee197838 tempest-SnapshotsActionsTest-887629224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.d24f6169-034e-4fd7-ac6c-ed57cfca96ef" returned: 0 in 0.413s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f53d70d9-8ff2-4e53-b7aa-ec30ee197838 tempest-SnapshotsActionsTest-887629224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.972s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:24:55 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-f53d70d9-8ff2-4e53-b7aa-ec30ee197838 tempest-SnapshotsActionsTest-887629224 None] Create snapshot completed successfully Sep 03 11:24:56 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b609b7af-a6bc-4ae6-87f9-a9cf87e097d8 tempest-SnapshotsActionsTest-1516157241 None] Acquiring lock "cinder-d24f6169-034e-4fd7-ac6c-ed57cfca96ef-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:56 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b609b7af-a6bc-4ae6-87f9-a9cf87e097d8 tempest-SnapshotsActionsTest-1516157241 None] Lock "cinder-d24f6169-034e-4fd7-ac6c-ed57cfca96ef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:56 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b609b7af-a6bc-4ae6-87f9-a9cf87e097d8 tempest-SnapshotsActionsTest-1516157241 None] Acquiring lock "cinder-quobyte-e039c8d5-c256-4c95-902c-b5e3359ffca9" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:56 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b609b7af-a6bc-4ae6-87f9-a9cf87e097d8 tempest-SnapshotsActionsTest-1516157241 None] Lock "cinder-quobyte-e039c8d5-c256-4c95-902c-b5e3359ffca9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:56 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b609b7af-a6bc-4ae6-87f9-a9cf87e097d8 tempest-SnapshotsActionsTest-1516157241 None] Acquiring lock "cinder-quobyte-d24f6169-034e-4fd7-ac6c-ed57cfca96ef" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:24:56 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b609b7af-a6bc-4ae6-87f9-a9cf87e097d8 tempest-SnapshotsActionsTest-1516157241 None] Lock "cinder-quobyte-d24f6169-034e-4fd7-ac6c-ed57cfca96ef" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:24:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-b609b7af-a6bc-4ae6-87f9-a9cf87e097d8 tempest-SnapshotsActionsTest-1516157241 None] Deleting offline snapshot d24f6169-034e-4fd7-ac6c-ed57cfca96ef of volume e039c8d5-c256-4c95-902c-b5e3359ffca9 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:24:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-b609b7af-a6bc-4ae6-87f9-a9cf87e097d8 tempest-SnapshotsActionsTest-1516157241 None] snapshot_file for this snap is: volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.d24f6169-034e-4fd7-ac6c-ed57cfca96ef {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:24:56 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc31bdf-48d1-4d75-ab67-e0b39f92801e]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:24:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b609b7af-a6bc-4ae6-87f9-a9cf87e097d8 tempest-SnapshotsActionsTest-1516157241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.d24f6169-034e-4fd7-ac6c-ed57cfca96ef {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:56 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.d24f6169-034e-4fd7-ac6c-ed57cfca96ef Sep 03 11:24:56 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:56 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b609b7af-a6bc-4ae6-87f9-a9cf87e097d8 tempest-SnapshotsActionsTest-1516157241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.d24f6169-034e-4fd7-ac6c-ed57cfca96ef" returned: 0 in 0.420s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-b609b7af-a6bc-4ae6-87f9-a9cf87e097d8 tempest-SnapshotsActionsTest-1516157241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e039c8d5-c256-4c95-902c-b5e3359ffca9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:24:56 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e3d36a-0c99-4fb0-8aaa-d94191bf4af6]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:24:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b609b7af-a6bc-4ae6-87f9-a9cf87e097d8 tempest-SnapshotsActionsTest-1516157241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:56 devstack sudo[99785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 Sep 03 11:24:56 devstack sudo[99785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:57 devstack sudo[99785]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b609b7af-a6bc-4ae6-87f9-a9cf87e097d8 tempest-SnapshotsActionsTest-1516157241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4" returned: 0 in 0.402s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:57 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-b609b7af-a6bc-4ae6-87f9-a9cf87e097d8 tempest-SnapshotsActionsTest-1516157241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e039c8d5-c256-4c95-902c-b5e3359ffca9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:24:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b609b7af-a6bc-4ae6-87f9-a9cf87e097d8 tempest-SnapshotsActionsTest-1516157241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.d24f6169-034e-4fd7-ac6c-ed57cfca96ef {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:57 devstack sudo[99790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.d24f6169-034e-4fd7-ac6c-ed57cfca96ef Sep 03 11:24:57 devstack sudo[99790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:57 devstack sudo[99790]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b609b7af-a6bc-4ae6-87f9-a9cf87e097d8 tempest-SnapshotsActionsTest-1516157241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.d24f6169-034e-4fd7-ac6c-ed57cfca96ef" returned: 0 in 0.416s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b609b7af-a6bc-4ae6-87f9-a9cf87e097d8 tempest-SnapshotsActionsTest-1516157241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.d24f6169-034e-4fd7-ac6c-ed57cfca96ef {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:57 devstack sudo[99795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.d24f6169-034e-4fd7-ac6c-ed57cfca96ef Sep 03 11:24:57 devstack sudo[99795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:57 devstack sudo[99795]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b609b7af-a6bc-4ae6-87f9-a9cf87e097d8 tempest-SnapshotsActionsTest-1516157241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.d24f6169-034e-4fd7-ac6c-ed57cfca96ef" returned: 0 in 0.257s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:57 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b609b7af-a6bc-4ae6-87f9-a9cf87e097d8 tempest-SnapshotsActionsTest-1516157241 None] Lock "cinder-quobyte-d24f6169-034e-4fd7-ac6c-ed57cfca96ef" released by "_delete_snapshot" :: held 1.616s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:57 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b609b7af-a6bc-4ae6-87f9-a9cf87e097d8 tempest-SnapshotsActionsTest-1516157241 None] Lock "cinder-quobyte-e039c8d5-c256-4c95-902c-b5e3359ffca9" released by "delete_snapshot" :: held 1.645s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:57 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-b609b7af-a6bc-4ae6-87f9-a9cf87e097d8 tempest-SnapshotsActionsTest-1516157241 None] Created reservations ['218f314d-88fa-43a7-9215-7b9ae4021881', '173bbe67-f833-49d7-a154-4de2f4db7a30', 'b62f949c-91c5-47e9-866a-a8b836384f25', '31904d40-a2cc-42e6-96d8-6ba15b3c0959'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:24:57 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-b609b7af-a6bc-4ae6-87f9-a9cf87e097d8 tempest-SnapshotsActionsTest-1516157241 None] Delete snapshot completed successfully. Sep 03 11:24:57 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b609b7af-a6bc-4ae6-87f9-a9cf87e097d8 tempest-SnapshotsActionsTest-1516157241 None] Lock "cinder-d24f6169-034e-4fd7-ac6c-ed57cfca96ef-delete_snapshot" released by "delete_snapshot" :: held 1.795s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:24:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3f4b304d-33b7-4b44-a1f7-23bcc3b5f1e8 tempest-SnapshotsActionsTest-887629224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:24:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3f4b304d-33b7-4b44-a1f7-23bcc3b5f1e8 tempest-SnapshotsActionsTest-887629224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:24:58 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-3f4b304d-33b7-4b44-a1f7-23bcc3b5f1e8 tempest-SnapshotsActionsTest-887629224 None] Creating offline snapshot bfc1a6ab-f266-4923-97ae-33843ef764b3 of volume e039c8d5-c256-4c95-902c-b5e3359ffca9 {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:24:58 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa713cef-55d0-4997-9669-5bae809379c3]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:24:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3f4b304d-33b7-4b44-a1f7-23bcc3b5f1e8 tempest-SnapshotsActionsTest-887629224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:58 devstack sudo[99799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 Sep 03 11:24:58 devstack sudo[99799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:59 devstack sudo[99799]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3f4b304d-33b7-4b44-a1f7-23bcc3b5f1e8 tempest-SnapshotsActionsTest-887629224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4" returned: 0 in 0.395s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:59 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-3f4b304d-33b7-4b44-a1f7-23bcc3b5f1e8 tempest-SnapshotsActionsTest-887629224 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e039c8d5-c256-4c95-902c-b5e3359ffca9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:24:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3f4b304d-33b7-4b44-a1f7-23bcc3b5f1e8 tempest-SnapshotsActionsTest-887629224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.bfc1a6ab-f266-4923-97ae-33843ef764b3 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:59 devstack sudo[99805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.bfc1a6ab-f266-4923-97ae-33843ef764b3 1G Sep 03 11:24:59 devstack sudo[99805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:59 devstack sudo[99805]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3f4b304d-33b7-4b44-a1f7-23bcc3b5f1e8 tempest-SnapshotsActionsTest-887629224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.bfc1a6ab-f266-4923-97ae-33843ef764b3 1G" returned: 0 in 0.481s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3f4b304d-33b7-4b44-a1f7-23bcc3b5f1e8 tempest-SnapshotsActionsTest-887629224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.bfc1a6ab-f266-4923-97ae-33843ef764b3 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:59 devstack sudo[99811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.bfc1a6ab-f266-4923-97ae-33843ef764b3 Sep 03 11:24:59 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:24:59 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root Sep 03 11:24:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3f4b304d-33b7-4b44-a1f7-23bcc3b5f1e8 tempest-SnapshotsActionsTest-887629224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.bfc1a6ab-f266-4923-97ae-33843ef764b3" returned: 0 in 0.292s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:24:59 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-3f4b304d-33b7-4b44-a1f7-23bcc3b5f1e8 tempest-SnapshotsActionsTest-887629224 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.bfc1a6ab-f266-4923-97ae-33843ef764b3 is being set with open permissions: ugo+rw Sep 03 11:24:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3f4b304d-33b7-4b44-a1f7-23bcc3b5f1e8 tempest-SnapshotsActionsTest-887629224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.bfc1a6ab-f266-4923-97ae-33843ef764b3 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:24:59 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.bfc1a6ab-f266-4923-97ae-33843ef764b3 Sep 03 11:24:59 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:00 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3f4b304d-33b7-4b44-a1f7-23bcc3b5f1e8 tempest-SnapshotsActionsTest-887629224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.bfc1a6ab-f266-4923-97ae-33843ef764b3" returned: 0 in 0.255s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3f4b304d-33b7-4b44-a1f7-23bcc3b5f1e8 tempest-SnapshotsActionsTest-887629224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.530s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:00 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-3f4b304d-33b7-4b44-a1f7-23bcc3b5f1e8 tempest-SnapshotsActionsTest-887629224 None] Create snapshot completed successfully Sep 03 11:25:00 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-77c1bf79-f6ce-4583-a998-6de0668b98ac tempest-SnapshotsActionsTest-1516157241 None] Acquiring lock "cinder-bfc1a6ab-f266-4923-97ae-33843ef764b3-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:25:00 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-77c1bf79-f6ce-4583-a998-6de0668b98ac tempest-SnapshotsActionsTest-1516157241 None] Lock "cinder-bfc1a6ab-f266-4923-97ae-33843ef764b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:25:00 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-77c1bf79-f6ce-4583-a998-6de0668b98ac tempest-SnapshotsActionsTest-1516157241 None] Acquiring lock "cinder-quobyte-e039c8d5-c256-4c95-902c-b5e3359ffca9" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:25:00 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-77c1bf79-f6ce-4583-a998-6de0668b98ac tempest-SnapshotsActionsTest-1516157241 None] Lock "cinder-quobyte-e039c8d5-c256-4c95-902c-b5e3359ffca9" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:25:00 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-77c1bf79-f6ce-4583-a998-6de0668b98ac tempest-SnapshotsActionsTest-1516157241 None] Acquiring lock "cinder-quobyte-bfc1a6ab-f266-4923-97ae-33843ef764b3" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:25:00 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-77c1bf79-f6ce-4583-a998-6de0668b98ac tempest-SnapshotsActionsTest-1516157241 None] Lock "cinder-quobyte-bfc1a6ab-f266-4923-97ae-33843ef764b3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:25:00 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-77c1bf79-f6ce-4583-a998-6de0668b98ac tempest-SnapshotsActionsTest-1516157241 None] Deleting offline snapshot bfc1a6ab-f266-4923-97ae-33843ef764b3 of volume e039c8d5-c256-4c95-902c-b5e3359ffca9 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:25:00 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-77c1bf79-f6ce-4583-a998-6de0668b98ac tempest-SnapshotsActionsTest-1516157241 None] snapshot_file for this snap is: volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.bfc1a6ab-f266-4923-97ae-33843ef764b3 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:25:00 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[102e85c0-a247-4418-84f0-f71e4f1d9548]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:25:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-77c1bf79-f6ce-4583-a998-6de0668b98ac tempest-SnapshotsActionsTest-1516157241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.bfc1a6ab-f266-4923-97ae-33843ef764b3 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:00 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.bfc1a6ab-f266-4923-97ae-33843ef764b3 Sep 03 11:25:00 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:01 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:01 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-77c1bf79-f6ce-4583-a998-6de0668b98ac tempest-SnapshotsActionsTest-1516157241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.bfc1a6ab-f266-4923-97ae-33843ef764b3" returned: 0 in 0.438s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:01 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-77c1bf79-f6ce-4583-a998-6de0668b98ac tempest-SnapshotsActionsTest-1516157241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e039c8d5-c256-4c95-902c-b5e3359ffca9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:25:01 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b29d1a-da00-45df-814e-90883fd72469]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:25:01 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-77c1bf79-f6ce-4583-a998-6de0668b98ac tempest-SnapshotsActionsTest-1516157241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:01 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 Sep 03 11:25:01 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:01 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:01 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-77c1bf79-f6ce-4583-a998-6de0668b98ac tempest-SnapshotsActionsTest-1516157241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4" returned: 0 in 0.372s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:01 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-77c1bf79-f6ce-4583-a998-6de0668b98ac tempest-SnapshotsActionsTest-1516157241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e039c8d5-c256-4c95-902c-b5e3359ffca9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:25:01 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-77c1bf79-f6ce-4583-a998-6de0668b98ac tempest-SnapshotsActionsTest-1516157241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.bfc1a6ab-f266-4923-97ae-33843ef764b3 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:01 devstack sudo[99833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.bfc1a6ab-f266-4923-97ae-33843ef764b3 Sep 03 11:25:01 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:02 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-77c1bf79-f6ce-4583-a998-6de0668b98ac tempest-SnapshotsActionsTest-1516157241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.bfc1a6ab-f266-4923-97ae-33843ef764b3" returned: 0 in 0.424s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-77c1bf79-f6ce-4583-a998-6de0668b98ac tempest-SnapshotsActionsTest-1516157241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.bfc1a6ab-f266-4923-97ae-33843ef764b3 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:02 devstack sudo[99840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.bfc1a6ab-f266-4923-97ae-33843ef764b3 Sep 03 11:25:02 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:02 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-77c1bf79-f6ce-4583-a998-6de0668b98ac tempest-SnapshotsActionsTest-1516157241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.bfc1a6ab-f266-4923-97ae-33843ef764b3" returned: 0 in 0.284s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:02 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-77c1bf79-f6ce-4583-a998-6de0668b98ac tempest-SnapshotsActionsTest-1516157241 None] Lock "cinder-quobyte-bfc1a6ab-f266-4923-97ae-33843ef764b3" released by "_delete_snapshot" :: held 1.627s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:25:02 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-77c1bf79-f6ce-4583-a998-6de0668b98ac tempest-SnapshotsActionsTest-1516157241 None] Lock "cinder-quobyte-e039c8d5-c256-4c95-902c-b5e3359ffca9" released by "delete_snapshot" :: held 1.653s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:25:02 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-77c1bf79-f6ce-4583-a998-6de0668b98ac tempest-SnapshotsActionsTest-1516157241 None] Created reservations ['5fc4ee23-4f3a-4154-b4f8-869614f0fd88', 'f5060584-4909-43a5-a99c-d9a77cc55cd1', 'dd642dac-4f8a-4c95-936d-9e4ac15b9c43', '6a93805e-13e4-467d-9cfd-5f9bc3804867'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:25:02 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-77c1bf79-f6ce-4583-a998-6de0668b98ac tempest-SnapshotsActionsTest-1516157241 None] Delete snapshot completed successfully. Sep 03 11:25:02 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-77c1bf79-f6ce-4583-a998-6de0668b98ac tempest-SnapshotsActionsTest-1516157241 None] Lock "cinder-bfc1a6ab-f266-4923-97ae-33843ef764b3-delete_snapshot" released by "delete_snapshot" :: held 1.829s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:25:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-894173f2-d269-41f8-b190-04335759aef4 tempest-SnapshotsActionsTest-887629224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-894173f2-d269-41f8-b190-04335759aef4 tempest-SnapshotsActionsTest-887629224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:03 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-894173f2-d269-41f8-b190-04335759aef4 tempest-SnapshotsActionsTest-887629224 None] Creating offline snapshot 7b325c31-bda6-4116-bedf-0b00d48418a4 of volume e039c8d5-c256-4c95-902c-b5e3359ffca9 {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:25:03 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6e0569-01f6-4dde-8347-268696e39fb7]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:25:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-894173f2-d269-41f8-b190-04335759aef4 tempest-SnapshotsActionsTest-887629224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:03 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 Sep 03 11:25:03 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:03 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-894173f2-d269-41f8-b190-04335759aef4 tempest-SnapshotsActionsTest-887629224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4" returned: 0 in 0.398s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:03 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-894173f2-d269-41f8-b190-04335759aef4 tempest-SnapshotsActionsTest-887629224 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e039c8d5-c256-4c95-902c-b5e3359ffca9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:25:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-894173f2-d269-41f8-b190-04335759aef4 tempest-SnapshotsActionsTest-887629224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.7b325c31-bda6-4116-bedf-0b00d48418a4 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:03 devstack sudo[99850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.7b325c31-bda6-4116-bedf-0b00d48418a4 1G Sep 03 11:25:03 devstack sudo[99850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:04 devstack sudo[99850]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-894173f2-d269-41f8-b190-04335759aef4 tempest-SnapshotsActionsTest-887629224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.7b325c31-bda6-4116-bedf-0b00d48418a4 1G" returned: 0 in 0.518s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-894173f2-d269-41f8-b190-04335759aef4 tempest-SnapshotsActionsTest-887629224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.7b325c31-bda6-4116-bedf-0b00d48418a4 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:04 devstack sudo[99856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.7b325c31-bda6-4116-bedf-0b00d48418a4 Sep 03 11:25:04 devstack sudo[99856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:04 devstack sudo[99856]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-894173f2-d269-41f8-b190-04335759aef4 tempest-SnapshotsActionsTest-887629224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.7b325c31-bda6-4116-bedf-0b00d48418a4" returned: 0 in 0.383s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:04 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-894173f2-d269-41f8-b190-04335759aef4 tempest-SnapshotsActionsTest-887629224 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.7b325c31-bda6-4116-bedf-0b00d48418a4 is being set with open permissions: ugo+rw Sep 03 11:25:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-894173f2-d269-41f8-b190-04335759aef4 tempest-SnapshotsActionsTest-887629224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.7b325c31-bda6-4116-bedf-0b00d48418a4 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:04 devstack sudo[99862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.7b325c31-bda6-4116-bedf-0b00d48418a4 Sep 03 11:25:04 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:04 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-894173f2-d269-41f8-b190-04335759aef4 tempest-SnapshotsActionsTest-887629224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.7b325c31-bda6-4116-bedf-0b00d48418a4" returned: 0 in 0.252s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-894173f2-d269-41f8-b190-04335759aef4 tempest-SnapshotsActionsTest-887629224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.673s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:04 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-894173f2-d269-41f8-b190-04335759aef4 tempest-SnapshotsActionsTest-887629224 None] Create snapshot completed successfully Sep 03 11:25:05 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-92c502e6-8865-4bd3-8a75-61393c5ded6a tempest-SnapshotsActionsTest-1516157241 None] Acquiring lock "cinder-7b325c31-bda6-4116-bedf-0b00d48418a4-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:25:05 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-92c502e6-8865-4bd3-8a75-61393c5ded6a tempest-SnapshotsActionsTest-1516157241 None] Lock "cinder-7b325c31-bda6-4116-bedf-0b00d48418a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:25:05 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-92c502e6-8865-4bd3-8a75-61393c5ded6a tempest-SnapshotsActionsTest-1516157241 None] Acquiring lock "cinder-quobyte-e039c8d5-c256-4c95-902c-b5e3359ffca9" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:25:05 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-92c502e6-8865-4bd3-8a75-61393c5ded6a tempest-SnapshotsActionsTest-1516157241 None] Lock "cinder-quobyte-e039c8d5-c256-4c95-902c-b5e3359ffca9" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:25:05 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-92c502e6-8865-4bd3-8a75-61393c5ded6a tempest-SnapshotsActionsTest-1516157241 None] Acquiring lock "cinder-quobyte-7b325c31-bda6-4116-bedf-0b00d48418a4" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:25:05 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-92c502e6-8865-4bd3-8a75-61393c5ded6a tempest-SnapshotsActionsTest-1516157241 None] Lock "cinder-quobyte-7b325c31-bda6-4116-bedf-0b00d48418a4" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:25:05 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-92c502e6-8865-4bd3-8a75-61393c5ded6a tempest-SnapshotsActionsTest-1516157241 None] Deleting offline snapshot 7b325c31-bda6-4116-bedf-0b00d48418a4 of volume e039c8d5-c256-4c95-902c-b5e3359ffca9 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:25:05 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-92c502e6-8865-4bd3-8a75-61393c5ded6a tempest-SnapshotsActionsTest-1516157241 None] snapshot_file for this snap is: volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.7b325c31-bda6-4116-bedf-0b00d48418a4 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:25:05 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee2651c7-dee3-434e-b5eb-981135175fd4]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:25:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-92c502e6-8865-4bd3-8a75-61393c5ded6a tempest-SnapshotsActionsTest-1516157241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.7b325c31-bda6-4116-bedf-0b00d48418a4 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:05 devstack sudo[99865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.7b325c31-bda6-4116-bedf-0b00d48418a4 Sep 03 11:25:05 devstack sudo[99865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:06 devstack sudo[99865]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-92c502e6-8865-4bd3-8a75-61393c5ded6a tempest-SnapshotsActionsTest-1516157241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.7b325c31-bda6-4116-bedf-0b00d48418a4" returned: 0 in 0.464s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:06 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-92c502e6-8865-4bd3-8a75-61393c5ded6a tempest-SnapshotsActionsTest-1516157241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e039c8d5-c256-4c95-902c-b5e3359ffca9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:25:06 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[da53546c-eebc-44a1-b645-18132ac3b067]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:25:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-92c502e6-8865-4bd3-8a75-61393c5ded6a tempest-SnapshotsActionsTest-1516157241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:06 devstack sudo[99870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 Sep 03 11:25:06 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:06 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-92c502e6-8865-4bd3-8a75-61393c5ded6a tempest-SnapshotsActionsTest-1516157241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4" returned: 0 in 0.374s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:06 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-92c502e6-8865-4bd3-8a75-61393c5ded6a tempest-SnapshotsActionsTest-1516157241 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e039c8d5-c256-4c95-902c-b5e3359ffca9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:25:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-92c502e6-8865-4bd3-8a75-61393c5ded6a tempest-SnapshotsActionsTest-1516157241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.7b325c31-bda6-4116-bedf-0b00d48418a4 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:06 devstack sudo[99875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.7b325c31-bda6-4116-bedf-0b00d48418a4 Sep 03 11:25:06 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:06 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-92c502e6-8865-4bd3-8a75-61393c5ded6a tempest-SnapshotsActionsTest-1516157241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.7b325c31-bda6-4116-bedf-0b00d48418a4" returned: 0 in 0.407s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-92c502e6-8865-4bd3-8a75-61393c5ded6a tempest-SnapshotsActionsTest-1516157241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.7b325c31-bda6-4116-bedf-0b00d48418a4 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:07 devstack sudo[99881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.7b325c31-bda6-4116-bedf-0b00d48418a4 Sep 03 11:25:07 devstack sudo[99881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:07 devstack sudo[99881]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-92c502e6-8865-4bd3-8a75-61393c5ded6a tempest-SnapshotsActionsTest-1516157241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.7b325c31-bda6-4116-bedf-0b00d48418a4" returned: 0 in 0.264s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:07 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-92c502e6-8865-4bd3-8a75-61393c5ded6a tempest-SnapshotsActionsTest-1516157241 None] Lock "cinder-quobyte-7b325c31-bda6-4116-bedf-0b00d48418a4" released by "_delete_snapshot" :: held 1.612s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:25:07 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-92c502e6-8865-4bd3-8a75-61393c5ded6a tempest-SnapshotsActionsTest-1516157241 None] Lock "cinder-quobyte-e039c8d5-c256-4c95-902c-b5e3359ffca9" released by "delete_snapshot" :: held 1.669s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:25:07 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=142,cinder:INSERT=37,cinder:UPDATE=180,cinder:DELETE=11 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:25:07 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=143,cinder:DELETE=15,cinder:INSERT=45,cinder:UPDATE=157 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:25:07 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-92c502e6-8865-4bd3-8a75-61393c5ded6a tempest-SnapshotsActionsTest-1516157241 None] Created reservations ['7d20785e-d0b1-421a-a8bd-6ce95a76c60b', '7a367d64-a3bd-4026-9238-e1135452a0f5', '8b89173f-a5ba-4282-855f-0b6e95daa798', '128e97bc-dbf3-4b5e-9e14-d9ca87992167'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:25:07 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-92c502e6-8865-4bd3-8a75-61393c5ded6a tempest-SnapshotsActionsTest-1516157241 None] Delete snapshot completed successfully. Sep 03 11:25:07 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-92c502e6-8865-4bd3-8a75-61393c5ded6a tempest-SnapshotsActionsTest-1516157241 None] Lock "cinder-7b325c31-bda6-4116-bedf-0b00d48418a4-delete_snapshot" released by "delete_snapshot" :: held 1.866s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:25:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-01636ba4-6a88-4df2-bc61-4eb35c2a2d8a tempest-SnapshotsActionsTest-887629224 None] Acquiring lock "cinder-c4b256ae-4507-428c-b54d-1fd6bdffe6c4-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:25:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-01636ba4-6a88-4df2-bc61-4eb35c2a2d8a tempest-SnapshotsActionsTest-887629224 None] Lock "cinder-c4b256ae-4507-428c-b54d-1fd6bdffe6c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:25:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-01636ba4-6a88-4df2-bc61-4eb35c2a2d8a tempest-SnapshotsActionsTest-887629224 None] Acquiring lock "cinder-quobyte-e039c8d5-c256-4c95-902c-b5e3359ffca9" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:25:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-01636ba4-6a88-4df2-bc61-4eb35c2a2d8a tempest-SnapshotsActionsTest-887629224 None] Lock "cinder-quobyte-e039c8d5-c256-4c95-902c-b5e3359ffca9" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:25:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-01636ba4-6a88-4df2-bc61-4eb35c2a2d8a tempest-SnapshotsActionsTest-887629224 None] Acquiring lock "cinder-quobyte-c4b256ae-4507-428c-b54d-1fd6bdffe6c4" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:25:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-01636ba4-6a88-4df2-bc61-4eb35c2a2d8a tempest-SnapshotsActionsTest-887629224 None] Lock "cinder-quobyte-c4b256ae-4507-428c-b54d-1fd6bdffe6c4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:25:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-01636ba4-6a88-4df2-bc61-4eb35c2a2d8a tempest-SnapshotsActionsTest-887629224 None] Deleting offline snapshot c4b256ae-4507-428c-b54d-1fd6bdffe6c4 of volume e039c8d5-c256-4c95-902c-b5e3359ffca9 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:25:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-01636ba4-6a88-4df2-bc61-4eb35c2a2d8a tempest-SnapshotsActionsTest-887629224 None] snapshot_file for this snap is: volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:25:08 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71d2f75-359f-44b5-9008-e002ac269e70]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:25:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-01636ba4-6a88-4df2-bc61-4eb35c2a2d8a tempest-SnapshotsActionsTest-887629224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:08 devstack sudo[99887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 Sep 03 11:25:08 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:08 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-01636ba4-6a88-4df2-bc61-4eb35c2a2d8a tempest-SnapshotsActionsTest-887629224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4" returned: 0 in 0.575s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-01636ba4-6a88-4df2-bc61-4eb35c2a2d8a tempest-SnapshotsActionsTest-887629224 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e039c8d5-c256-4c95-902c-b5e3359ffca9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:25:08 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d9a5ed-b220-49dc-b98a-18c81e9bc6dd]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:25:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-01636ba4-6a88-4df2-bc61-4eb35c2a2d8a tempest-SnapshotsActionsTest-887629224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:08 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-bedccebf-8b1d-4cb6-922c-d595f1754e8a tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:25:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bedccebf-8b1d-4cb6-922c-d595f1754e8a tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Flow 'volume_create_manager' (745aa629-6a47-48cc-bdba-87c58a53d41a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:25:08 devstack sudo[99892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9 Sep 03 11:25:08 devstack sudo[99892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bedccebf-8b1d-4cb6-922c-d595f1754e8a tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0b47b95-cb57-4ab8-a77b-daeebd59b812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bedccebf-8b1d-4cb6-922c-d595f1754e8a tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0b47b95-cb57-4ab8-a77b-daeebd59b812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-437954159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f2ddf26-2d37-42a3-a499-8dc1e81228eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bed46b278ef7471e86926bab515a4219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:25:09Z,use_quota=True,user_id='cdcf248b7f7744e39ab27ef2800cf8a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bedccebf-8b1d-4cb6-922c-d595f1754e8a tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9784000b-0240-49fc-b2de-2a9a4f6edefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bedccebf-8b1d-4cb6-922c-d595f1754e8a tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9784000b-0240-49fc-b2de-2a9a4f6edefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bedccebf-8b1d-4cb6-922c-d595f1754e8a tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e09668-b052-45d7-adc7-4203eb40e952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bedccebf-8b1d-4cb6-922c-d595f1754e8a tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08e09668-b052-45d7-adc7-4203eb40e952) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f2ddf26-2d37-42a3-a499-8dc1e81228eb', 'volume_name': 'volume-2f2ddf26-2d37-42a3-a499-8dc1e81228eb', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bedccebf-8b1d-4cb6-922c-d595f1754e8a tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd049ad-eeb5-4747-b681-3e6d79e4a26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bedccebf-8b1d-4cb6-922c-d595f1754e8a tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cdd049ad-eeb5-4747-b681-3e6d79e4a26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bedccebf-8b1d-4cb6-922c-d595f1754e8a tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78137827-4021-4b2d-8d85-33e876604c09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:09 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-bedccebf-8b1d-4cb6-922c-d595f1754e8a tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Volume 2f2ddf26-2d37-42a3-a499-8dc1e81228eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f2ddf26-2d37-42a3-a499-8dc1e81228eb', 'volume_size': 1} Sep 03 11:25:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bedccebf-8b1d-4cb6-922c-d595f1754e8a tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bedccebf-8b1d-4cb6-922c-d595f1754e8a tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-bedccebf-8b1d-4cb6-922c-d595f1754e8a tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:25:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-437954159',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f2ddf26-2d37-42a3-a499-8dc1e81228eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bed46b278ef7471e86926bab515a4219',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:25:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:25:09Z,use_quota=True,user_id='cdcf248b7f7744e39ab27ef2800cf8a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:25:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-bedccebf-8b1d-4cb6-922c-d595f1754e8a tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Creating volume 2f2ddf26-2d37-42a3-a499-8dc1e81228eb {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:25:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bedccebf-8b1d-4cb6-922c-d595f1754e8a tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bedccebf-8b1d-4cb6-922c-d595f1754e8a tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-bedccebf-8b1d-4cb6-922c-d595f1754e8a tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:25:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-bedccebf-8b1d-4cb6-922c-d595f1754e8a tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:25:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bedccebf-8b1d-4cb6-922c-d595f1754e8a tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-bedccebf-8b1d-4cb6-922c-d595f1754e8a tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:25:09 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-bedccebf-8b1d-4cb6-922c-d595f1754e8a tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:25:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bedccebf-8b1d-4cb6-922c-d595f1754e8a tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2f2ddf26-2d37-42a3-a499-8dc1e81228eb 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:09 devstack sudo[99894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2f2ddf26-2d37-42a3-a499-8dc1e81228eb 1073741824 Sep 03 11:25:09 devstack sudo[99894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:09 devstack sudo[99892]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-01636ba4-6a88-4df2-bc61-4eb35c2a2d8a tempest-SnapshotsActionsTest-887629224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9" returned: 0 in 0.405s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-01636ba4-6a88-4df2-bc61-4eb35c2a2d8a tempest-SnapshotsActionsTest-887629224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:09 devstack sudo[99899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 Sep 03 11:25:09 devstack sudo[99899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:09 devstack sudo[99894]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bedccebf-8b1d-4cb6-922c-d595f1754e8a tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2f2ddf26-2d37-42a3-a499-8dc1e81228eb 1073741824" returned: 0 in 0.508s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bedccebf-8b1d-4cb6-922c-d595f1754e8a tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2f2ddf26-2d37-42a3-a499-8dc1e81228eb {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:09 devstack sudo[99909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2f2ddf26-2d37-42a3-a499-8dc1e81228eb Sep 03 11:25:09 devstack sudo[99909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:09 devstack sudo[99899]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-01636ba4-6a88-4df2-bc61-4eb35c2a2d8a tempest-SnapshotsActionsTest-887629224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4" returned: 0 in 0.387s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-01636ba4-6a88-4df2-bc61-4eb35c2a2d8a tempest-SnapshotsActionsTest-887629224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:09 devstack sudo[99911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4 Sep 03 11:25:09 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:09 devstack sudo[99909]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bedccebf-8b1d-4cb6-922c-d595f1754e8a tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2f2ddf26-2d37-42a3-a499-8dc1e81228eb" returned: 0 in 0.278s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-bedccebf-8b1d-4cb6-922c-d595f1754e8a tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] <== create_volume: return (838ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:25:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bedccebf-8b1d-4cb6-922c-d595f1754e8a tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.840s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bedccebf-8b1d-4cb6-922c-d595f1754e8a tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78137827-4021-4b2d-8d85-33e876604c09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f2ddf26-2d37-42a3-a499-8dc1e81228eb', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bedccebf-8b1d-4cb6-922c-d595f1754e8a tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87cc86df-e533-48cb-a3ff-f0a29a27da66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:09 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-bedccebf-8b1d-4cb6-922c-d595f1754e8a tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Volume volume-2f2ddf26-2d37-42a3-a499-8dc1e81228eb (2f2ddf26-2d37-42a3-a499-8dc1e81228eb): created successfully Sep 03 11:25:09 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bedccebf-8b1d-4cb6-922c-d595f1754e8a tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87cc86df-e533-48cb-a3ff-f0a29a27da66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bedccebf-8b1d-4cb6-922c-d595f1754e8a tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Flow 'volume_create_manager' (745aa629-6a47-48cc-bdba-87c58a53d41a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:25:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-01636ba4-6a88-4df2-bc61-4eb35c2a2d8a tempest-SnapshotsActionsTest-887629224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9.c4b256ae-4507-428c-b54d-1fd6bdffe6c4" returned: 0 in 0.293s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:09 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-bedccebf-8b1d-4cb6-922c-d595f1754e8a tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Created volume successfully. Sep 03 11:25:09 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-01636ba4-6a88-4df2-bc61-4eb35c2a2d8a tempest-SnapshotsActionsTest-887629224 None] Lock "cinder-quobyte-c4b256ae-4507-428c-b54d-1fd6bdffe6c4" released by "_delete_snapshot" :: held 1.779s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:25:09 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-01636ba4-6a88-4df2-bc61-4eb35c2a2d8a tempest-SnapshotsActionsTest-887629224 None] Lock "cinder-quobyte-e039c8d5-c256-4c95-902c-b5e3359ffca9" released by "delete_snapshot" :: held 1.809s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:25:10 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-01636ba4-6a88-4df2-bc61-4eb35c2a2d8a tempest-SnapshotsActionsTest-887629224 None] Created reservations ['b591b595-9f5d-419c-b577-181ca7413e11', '6be6b5df-9525-464e-aa73-00f8b1d2955d', '7b0490d2-473c-4bc5-bde6-79d7df4338d6', '63deb6ec-ab71-4132-9803-29cb7b97afeb'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:25:10 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-01636ba4-6a88-4df2-bc61-4eb35c2a2d8a tempest-SnapshotsActionsTest-887629224 None] Delete snapshot completed successfully. Sep 03 11:25:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-01636ba4-6a88-4df2-bc61-4eb35c2a2d8a tempest-SnapshotsActionsTest-887629224 None] Lock "cinder-c4b256ae-4507-428c-b54d-1fd6bdffe6c4-delete_snapshot" released by "delete_snapshot" :: held 1.963s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:25:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-6cc1c8b7-b12f-4eeb-abf2-265553043414 tempest-SnapshotsActionsTest-887629224 None] Acquiring lock "cinder-e039c8d5-c256-4c95-902c-b5e3359ffca9-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:25:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-6cc1c8b7-b12f-4eeb-abf2-265553043414 tempest-SnapshotsActionsTest-887629224 None] Lock "cinder-e039c8d5-c256-4c95-902c-b5e3359ffca9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:25:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-6cc1c8b7-b12f-4eeb-abf2-265553043414 tempest-SnapshotsActionsTest-887629224 None] Acquiring lock "cinder-quobyte-e039c8d5-c256-4c95-902c-b5e3359ffca9" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:25:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-6cc1c8b7-b12f-4eeb-abf2-265553043414 tempest-SnapshotsActionsTest-887629224 None] Lock "cinder-quobyte-e039c8d5-c256-4c95-902c-b5e3359ffca9" acquired by "delete_volume" :: waited 0.018s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:25:10 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41b76de-0771-4a3e-9350-c41af3b5bac3]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:25:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6cc1c8b7-b12f-4eeb-abf2-265553043414 tempest-SnapshotsActionsTest-887629224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:10 devstack sudo[99918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9 Sep 03 11:25:10 devstack sudo[99918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:10 devstack sudo[99918]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6cc1c8b7-b12f-4eeb-abf2-265553043414 tempest-SnapshotsActionsTest-887629224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9" returned: 0 in 0.360s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6cc1c8b7-b12f-4eeb-abf2-265553043414 tempest-SnapshotsActionsTest-887629224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:10 devstack sudo[99923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9 Sep 03 11:25:10 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:11 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6cc1c8b7-b12f-4eeb-abf2-265553043414 tempest-SnapshotsActionsTest-887629224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e039c8d5-c256-4c95-902c-b5e3359ffca9" returned: 0 in 0.332s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:11 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-6cc1c8b7-b12f-4eeb-abf2-265553043414 tempest-SnapshotsActionsTest-887629224 None] Lock "cinder-quobyte-e039c8d5-c256-4c95-902c-b5e3359ffca9" released by "delete_volume" :: held 0.750s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:25:11 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-6cc1c8b7-b12f-4eeb-abf2-265553043414 tempest-SnapshotsActionsTest-887629224 None] Created reservations ['f6c1170c-ba90-46e9-add5-341c648aefa8', 'ad946aa9-34b9-4e65-a0ec-62b5ad87249b', '703152e2-0465-4113-afc5-75d9f0078d40', '5ac6d6a7-9b33-4fbb-997d-2ca90735e7cb'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:25:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6cc1c8b7-b12f-4eeb-abf2-265553043414 tempest-SnapshotsActionsTest-887629224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6cc1c8b7-b12f-4eeb-abf2-265553043414 tempest-SnapshotsActionsTest-887629224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6cc1c8b7-b12f-4eeb-abf2-265553043414 tempest-SnapshotsActionsTest-887629224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:25:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6cc1c8b7-b12f-4eeb-abf2-265553043414 tempest-SnapshotsActionsTest-887629224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:25:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6cc1c8b7-b12f-4eeb-abf2-265553043414 tempest-SnapshotsActionsTest-887629224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6cc1c8b7-b12f-4eeb-abf2-265553043414 tempest-SnapshotsActionsTest-887629224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:11 devstack sudo[99929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:25:11 devstack sudo[99929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:11 devstack sudo[99929]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6cc1c8b7-b12f-4eeb-abf2-265553043414 tempest-SnapshotsActionsTest-887629224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.518s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:11 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-6cc1c8b7-b12f-4eeb-abf2-265553043414 tempest-SnapshotsActionsTest-887629224 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:25:11 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-6cc1c8b7-b12f-4eeb-abf2-265553043414 tempest-SnapshotsActionsTest-887629224 None] Deleted volume successfully. Sep 03 11:25:12 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-6cc1c8b7-b12f-4eeb-abf2-265553043414 tempest-SnapshotsActionsTest-887629224 None] Lock "cinder-e039c8d5-c256-4c95-902c-b5e3359ffca9-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:25:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-cc58a18d-7573-4886-a28d-3e0c3ee6d6ca req-78e70431-575e-42b3-b4f8-a3140ab94a9c tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-cc58a18d-7573-4886-a28d-3e0c3ee6d6ca req-78e70431-575e-42b3-b4f8-a3140ab94a9c tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-cc58a18d-7573-4886-a28d-3e0c3ee6d6ca req-78e70431-575e-42b3-b4f8-a3140ab94a9c tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-cc58a18d-7573-4886-a28d-3e0c3ee6d6ca req-78e70431-575e-42b3-b4f8-a3140ab94a9c tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912', 'name': 'volume-2f2ddf26-2d37-42a3-a499-8dc1e81228eb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '646fdfd2-a82d-486b-b83f-68f0bc842f91', 'enforce_multipath': True} {{(pid=87038) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:25:12 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-cc58a18d-7573-4886-a28d-3e0c3ee6d6ca req-78e70431-575e-42b3-b4f8-a3140ab94a9c tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] attachment_update completed successfully. Sep 03 11:25:17 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-1f50083c-cd7b-4280-b790-9fe525a63613 req-6d5cb6e9-3f62-4742-bf00-3061a5703798 tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Terminate volume connection completed successfully. Sep 03 11:25:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-1f50083c-cd7b-4280-b790-9fe525a63613 req-6d5cb6e9-3f62-4742-bf00-3061a5703798 tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Deleting attachment 646fdfd2-a82d-486b-b83f-68f0bc842f91. {{(pid=87038) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:25:17 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-27dde9c0-17d5-4dc5-b7c3-a9f4964cf1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Acquiring lock "cinder-2f2ddf26-2d37-42a3-a499-8dc1e81228eb-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:25:17 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-27dde9c0-17d5-4dc5-b7c3-a9f4964cf1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Lock "cinder-2f2ddf26-2d37-42a3-a499-8dc1e81228eb-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:25:17 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:25:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:25:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:25:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:18 devstack sudo[100899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:25:18 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:18 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-27dde9c0-17d5-4dc5-b7c3-a9f4964cf1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Acquiring lock "cinder-quobyte-2f2ddf26-2d37-42a3-a499-8dc1e81228eb" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:25:18 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-27dde9c0-17d5-4dc5-b7c3-a9f4964cf1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Lock "cinder-quobyte-2f2ddf26-2d37-42a3-a499-8dc1e81228eb" acquired by "delete_volume" :: waited 0.039s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:25:18 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[1687fa96-95e6-414d-990e-9a11fbf1176f]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:25:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-27dde9c0-17d5-4dc5-b7c3-a9f4964cf1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2f2ddf26-2d37-42a3-a499-8dc1e81228eb {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:18 devstack sudo[100902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2f2ddf26-2d37-42a3-a499-8dc1e81228eb Sep 03 11:25:18 devstack sudo[100902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:18 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.469s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:18 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:25:18 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:25:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread count: 28 {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:25:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread info: [<_MainThread(MainThread, started 139554943000704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:25:18 devstack sudo[100902]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-27dde9c0-17d5-4dc5-b7c3-a9f4964cf1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2f2ddf26-2d37-42a3-a499-8dc1e81228eb" returned: 0 in 0.666s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-27dde9c0-17d5-4dc5-b7c3-a9f4964cf1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2f2ddf26-2d37-42a3-a499-8dc1e81228eb {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:18 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2f2ddf26-2d37-42a3-a499-8dc1e81228eb Sep 03 11:25:18 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:19 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-27dde9c0-17d5-4dc5-b7c3-a9f4964cf1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2f2ddf26-2d37-42a3-a499-8dc1e81228eb" returned: 0 in 0.394s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:19 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-27dde9c0-17d5-4dc5-b7c3-a9f4964cf1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Lock "cinder-quobyte-2f2ddf26-2d37-42a3-a499-8dc1e81228eb" released by "delete_volume" :: held 1.138s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:25:19 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-27dde9c0-17d5-4dc5-b7c3-a9f4964cf1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Created reservations ['f6935225-db87-4597-a29f-75bce02f3422', '5c47c536-7c42-4f75-a5a2-038c7a700111', 'ba000a55-85ee-4468-9a22-7ba871a0c0cc', 'e03b50c2-7e2a-498f-bac7-19daa55c8bf5'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:25:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-27dde9c0-17d5-4dc5-b7c3-a9f4964cf1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-27dde9c0-17d5-4dc5-b7c3-a9f4964cf1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:19 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-27dde9c0-17d5-4dc5-b7c3-a9f4964cf1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:25:19 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-27dde9c0-17d5-4dc5-b7c3-a9f4964cf1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:25:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-27dde9c0-17d5-4dc5-b7c3-a9f4964cf1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-27dde9c0-17d5-4dc5-b7c3-a9f4964cf1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:19 devstack sudo[100911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:25:19 devstack sudo[100911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:19 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aaeea0a-37f0-49df-82a9-5175ffca4acf tempest-TestMinimumBasicScenario-1793377207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:25:19 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5aaeea0a-37f0-49df-82a9-5175ffca4acf tempest-TestMinimumBasicScenario-1793377207 None] Flow 'volume_create_manager' (62113768-1db3-4c56-ba70-67495f8b6e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:25:19 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5aaeea0a-37f0-49df-82a9-5175ffca4acf tempest-TestMinimumBasicScenario-1793377207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c7c9709-1a42-4801-bba6-4945cc7f9436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:19 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5aaeea0a-37f0-49df-82a9-5175ffca4acf tempest-TestMinimumBasicScenario-1793377207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c7c9709-1a42-4801-bba6-4945cc7f9436) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-331869212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e82fa0-cc62-47f5-8033-d2cd0a24ccb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='039eb1406f984bae9423b0f8144ee7ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:25:20Z,use_quota=True,user_id='b49d3b21114c4e65a3f2c6e2d7f2e90e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:19 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5aaeea0a-37f0-49df-82a9-5175ffca4acf tempest-TestMinimumBasicScenario-1793377207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c72e98-bfcc-416b-9ded-45f16abde701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:19 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5aaeea0a-37f0-49df-82a9-5175ffca4acf tempest-TestMinimumBasicScenario-1793377207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c72e98-bfcc-416b-9ded-45f16abde701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:19 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5aaeea0a-37f0-49df-82a9-5175ffca4acf tempest-TestMinimumBasicScenario-1793377207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e675d98-ba1f-4b53-ad56-83daf557abe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:19 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5aaeea0a-37f0-49df-82a9-5175ffca4acf tempest-TestMinimumBasicScenario-1793377207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e675d98-ba1f-4b53-ad56-83daf557abe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17e82fa0-cc62-47f5-8033-d2cd0a24ccb8', 'volume_name': 'volume-17e82fa0-cc62-47f5-8033-d2cd0a24ccb8', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:19 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5aaeea0a-37f0-49df-82a9-5175ffca4acf tempest-TestMinimumBasicScenario-1793377207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (264e1cb0-ed85-4d71-99c3-411e7395e8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:19 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5aaeea0a-37f0-49df-82a9-5175ffca4acf tempest-TestMinimumBasicScenario-1793377207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (264e1cb0-ed85-4d71-99c3-411e7395e8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:19 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5aaeea0a-37f0-49df-82a9-5175ffca4acf tempest-TestMinimumBasicScenario-1793377207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12dc3032-99e4-4f5a-8aed-0108238fc544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:19 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-5aaeea0a-37f0-49df-82a9-5175ffca4acf tempest-TestMinimumBasicScenario-1793377207 None] Volume 17e82fa0-cc62-47f5-8033-d2cd0a24ccb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17e82fa0-cc62-47f5-8033-d2cd0a24ccb8', 'volume_size': 1} Sep 03 11:25:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5aaeea0a-37f0-49df-82a9-5175ffca4acf tempest-TestMinimumBasicScenario-1793377207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5aaeea0a-37f0-49df-82a9-5175ffca4acf tempest-TestMinimumBasicScenario-1793377207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:19 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5aaeea0a-37f0-49df-82a9-5175ffca4acf tempest-TestMinimumBasicScenario-1793377207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:25:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-331869212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17e82fa0-cc62-47f5-8033-d2cd0a24ccb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='039eb1406f984bae9423b0f8144ee7ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:25:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:25:20Z,use_quota=True,user_id='b49d3b21114c4e65a3f2c6e2d7f2e90e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:25:19 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-5aaeea0a-37f0-49df-82a9-5175ffca4acf tempest-TestMinimumBasicScenario-1793377207 None] Creating volume 17e82fa0-cc62-47f5-8033-d2cd0a24ccb8 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:25:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5aaeea0a-37f0-49df-82a9-5175ffca4acf tempest-TestMinimumBasicScenario-1793377207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5aaeea0a-37f0-49df-82a9-5175ffca4acf tempest-TestMinimumBasicScenario-1793377207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:19 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5aaeea0a-37f0-49df-82a9-5175ffca4acf tempest-TestMinimumBasicScenario-1793377207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:25:19 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5aaeea0a-37f0-49df-82a9-5175ffca4acf tempest-TestMinimumBasicScenario-1793377207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:25:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5aaeea0a-37f0-49df-82a9-5175ffca4acf tempest-TestMinimumBasicScenario-1793377207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:19 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5aaeea0a-37f0-49df-82a9-5175ffca4acf tempest-TestMinimumBasicScenario-1793377207 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:25:19 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-5aaeea0a-37f0-49df-82a9-5175ffca4acf tempest-TestMinimumBasicScenario-1793377207 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:25:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5aaeea0a-37f0-49df-82a9-5175ffca4acf tempest-TestMinimumBasicScenario-1793377207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-17e82fa0-cc62-47f5-8033-d2cd0a24ccb8 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:19 devstack sudo[100911]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-27dde9c0-17d5-4dc5-b7c3-a9f4964cf1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.328s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:19 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-27dde9c0-17d5-4dc5-b7c3-a9f4964cf1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:25:19 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-27dde9c0-17d5-4dc5-b7c3-a9f4964cf1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Deleted volume successfully. Sep 03 11:25:19 devstack sudo[100914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-17e82fa0-cc62-47f5-8033-d2cd0a24ccb8 1073741824 Sep 03 11:25:19 devstack sudo[100914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:19 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-27dde9c0-17d5-4dc5-b7c3-a9f4964cf1e0 tempest-TestServerVolumeAttachScenarioOldVersion-1902195300 None] Lock "cinder-2f2ddf26-2d37-42a3-a499-8dc1e81228eb-delete_volume" released by "delete_volume" :: held 1.920s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:25:20 devstack sudo[100914]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5aaeea0a-37f0-49df-82a9-5175ffca4acf tempest-TestMinimumBasicScenario-1793377207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-17e82fa0-cc62-47f5-8033-d2cd0a24ccb8 1073741824" returned: 0 in 0.565s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5aaeea0a-37f0-49df-82a9-5175ffca4acf tempest-TestMinimumBasicScenario-1793377207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-17e82fa0-cc62-47f5-8033-d2cd0a24ccb8 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:20 devstack sudo[100920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-17e82fa0-cc62-47f5-8033-d2cd0a24ccb8 Sep 03 11:25:20 devstack sudo[100920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:20 devstack sudo[100920]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5aaeea0a-37f0-49df-82a9-5175ffca4acf tempest-TestMinimumBasicScenario-1793377207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-17e82fa0-cc62-47f5-8033-d2cd0a24ccb8" returned: 0 in 0.466s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5aaeea0a-37f0-49df-82a9-5175ffca4acf tempest-TestMinimumBasicScenario-1793377207 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:25:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5aaeea0a-37f0-49df-82a9-5175ffca4acf tempest-TestMinimumBasicScenario-1793377207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.123s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5aaeea0a-37f0-49df-82a9-5175ffca4acf tempest-TestMinimumBasicScenario-1793377207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12dc3032-99e4-4f5a-8aed-0108238fc544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17e82fa0-cc62-47f5-8033-d2cd0a24ccb8', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5aaeea0a-37f0-49df-82a9-5175ffca4acf tempest-TestMinimumBasicScenario-1793377207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68ddce84-39e5-4f73-92a1-95abe6e9cc44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:20 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-5aaeea0a-37f0-49df-82a9-5175ffca4acf tempest-TestMinimumBasicScenario-1793377207 None] Volume volume-17e82fa0-cc62-47f5-8033-d2cd0a24ccb8 (17e82fa0-cc62-47f5-8033-d2cd0a24ccb8): created successfully Sep 03 11:25:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5aaeea0a-37f0-49df-82a9-5175ffca4acf tempest-TestMinimumBasicScenario-1793377207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68ddce84-39e5-4f73-92a1-95abe6e9cc44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5aaeea0a-37f0-49df-82a9-5175ffca4acf tempest-TestMinimumBasicScenario-1793377207 None] Flow 'volume_create_manager' (62113768-1db3-4c56-ba70-67495f8b6e5d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:25:21 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-5aaeea0a-37f0-49df-82a9-5175ffca4acf tempest-TestMinimumBasicScenario-1793377207 None] Created volume successfully. Sep 03 11:25:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-f0c6c071-a3a5-4398-a4ac-d22952c24153 req-ef399f55-f9f9-46a6-bf71-172dd9ff923b tempest-TestMinimumBasicScenario-1793377207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-f0c6c071-a3a5-4398-a4ac-d22952c24153 req-ef399f55-f9f9-46a6-bf71-172dd9ff923b tempest-TestMinimumBasicScenario-1793377207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-f0c6c071-a3a5-4398-a4ac-d22952c24153 req-ef399f55-f9f9-46a6-bf71-172dd9ff923b tempest-TestMinimumBasicScenario-1793377207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-f0c6c071-a3a5-4398-a4ac-d22952c24153 req-ef399f55-f9f9-46a6-bf71-172dd9ff923b tempest-TestMinimumBasicScenario-1793377207 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912', 'name': 'volume-17e82fa0-cc62-47f5-8033-d2cd0a24ccb8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '97d52391-1535-4937-9e9b-49f9628f3f77', 'enforce_multipath': True} {{(pid=87038) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:25:23 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-f0c6c071-a3a5-4398-a4ac-d22952c24153 req-ef399f55-f9f9-46a6-bf71-172dd9ff923b tempest-TestMinimumBasicScenario-1793377207 None] attachment_update completed successfully. Sep 03 11:25:29 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-85b39681-ac3b-49a2-8be9-f8f40f599555 tempest-VolumesServicesTestJSON-766744343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:25:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-85b39681-ac3b-49a2-8be9-f8f40f599555 tempest-VolumesServicesTestJSON-766744343 None] Flow 'volume_create_manager' (720e4254-b5f6-4903-ae6c-c79fb4a61859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:25:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-85b39681-ac3b-49a2-8be9-f8f40f599555 tempest-VolumesServicesTestJSON-766744343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d0f375c-d588-488f-ab4c-a5787fe47236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-85b39681-ac3b-49a2-8be9-f8f40f599555 tempest-VolumesServicesTestJSON-766744343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d0f375c-d588-488f-ab4c-a5787fe47236) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2131055444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a36db8f3-da9d-44ed-bf8a-bd0538178a6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ba7b234151b4996aaeeec70bd0cbe5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:25:30Z,use_quota=True,user_id='f34d3a5b5aa942d18a07e02fff96b466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-85b39681-ac3b-49a2-8be9-f8f40f599555 tempest-VolumesServicesTestJSON-766744343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef38fbb0-2560-4221-a2d6-9ad1918b356a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-85b39681-ac3b-49a2-8be9-f8f40f599555 tempest-VolumesServicesTestJSON-766744343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef38fbb0-2560-4221-a2d6-9ad1918b356a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-85b39681-ac3b-49a2-8be9-f8f40f599555 tempest-VolumesServicesTestJSON-766744343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5b5fed1-e628-4266-b3a5-2fa7cf21e246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-85b39681-ac3b-49a2-8be9-f8f40f599555 tempest-VolumesServicesTestJSON-766744343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5b5fed1-e628-4266-b3a5-2fa7cf21e246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a36db8f3-da9d-44ed-bf8a-bd0538178a6e', 'volume_name': 'volume-a36db8f3-da9d-44ed-bf8a-bd0538178a6e', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-85b39681-ac3b-49a2-8be9-f8f40f599555 tempest-VolumesServicesTestJSON-766744343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf88194-2411-4918-84c4-0ba454ba9de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-85b39681-ac3b-49a2-8be9-f8f40f599555 tempest-VolumesServicesTestJSON-766744343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf88194-2411-4918-84c4-0ba454ba9de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-85b39681-ac3b-49a2-8be9-f8f40f599555 tempest-VolumesServicesTestJSON-766744343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (188bf1f9-f4c8-4435-b6d8-b3b03de218f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:29 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-85b39681-ac3b-49a2-8be9-f8f40f599555 tempest-VolumesServicesTestJSON-766744343 None] Volume a36db8f3-da9d-44ed-bf8a-bd0538178a6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a36db8f3-da9d-44ed-bf8a-bd0538178a6e', 'volume_size': 1} Sep 03 11:25:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-85b39681-ac3b-49a2-8be9-f8f40f599555 tempest-VolumesServicesTestJSON-766744343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-85b39681-ac3b-49a2-8be9-f8f40f599555 tempest-VolumesServicesTestJSON-766744343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:29 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-85b39681-ac3b-49a2-8be9-f8f40f599555 tempest-VolumesServicesTestJSON-766744343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:25:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-2131055444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a36db8f3-da9d-44ed-bf8a-bd0538178a6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9ba7b234151b4996aaeeec70bd0cbe5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:25:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:25:30Z,use_quota=True,user_id='f34d3a5b5aa942d18a07e02fff96b466',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:25:29 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-85b39681-ac3b-49a2-8be9-f8f40f599555 tempest-VolumesServicesTestJSON-766744343 None] Creating volume a36db8f3-da9d-44ed-bf8a-bd0538178a6e {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:25:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-85b39681-ac3b-49a2-8be9-f8f40f599555 tempest-VolumesServicesTestJSON-766744343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-85b39681-ac3b-49a2-8be9-f8f40f599555 tempest-VolumesServicesTestJSON-766744343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:29 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-85b39681-ac3b-49a2-8be9-f8f40f599555 tempest-VolumesServicesTestJSON-766744343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:25:29 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-85b39681-ac3b-49a2-8be9-f8f40f599555 tempest-VolumesServicesTestJSON-766744343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:25:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-85b39681-ac3b-49a2-8be9-f8f40f599555 tempest-VolumesServicesTestJSON-766744343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:29 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-85b39681-ac3b-49a2-8be9-f8f40f599555 tempest-VolumesServicesTestJSON-766744343 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:25:29 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-85b39681-ac3b-49a2-8be9-f8f40f599555 tempest-VolumesServicesTestJSON-766744343 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:25:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-85b39681-ac3b-49a2-8be9-f8f40f599555 tempest-VolumesServicesTestJSON-766744343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a36db8f3-da9d-44ed-bf8a-bd0538178a6e 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:29 devstack sudo[101371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a36db8f3-da9d-44ed-bf8a-bd0538178a6e 1073741824 Sep 03 11:25:29 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:30 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-85b39681-ac3b-49a2-8be9-f8f40f599555 tempest-VolumesServicesTestJSON-766744343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a36db8f3-da9d-44ed-bf8a-bd0538178a6e 1073741824" returned: 0 in 0.603s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-85b39681-ac3b-49a2-8be9-f8f40f599555 tempest-VolumesServicesTestJSON-766744343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a36db8f3-da9d-44ed-bf8a-bd0538178a6e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:30 devstack sudo[101378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a36db8f3-da9d-44ed-bf8a-bd0538178a6e Sep 03 11:25:30 devstack sudo[101378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:30 devstack sudo[101378]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-85b39681-ac3b-49a2-8be9-f8f40f599555 tempest-VolumesServicesTestJSON-766744343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a36db8f3-da9d-44ed-bf8a-bd0538178a6e" returned: 0 in 0.308s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-85b39681-ac3b-49a2-8be9-f8f40f599555 tempest-VolumesServicesTestJSON-766744343 None] <== create_volume: return (1004ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:25:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-85b39681-ac3b-49a2-8be9-f8f40f599555 tempest-VolumesServicesTestJSON-766744343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-85b39681-ac3b-49a2-8be9-f8f40f599555 tempest-VolumesServicesTestJSON-766744343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (188bf1f9-f4c8-4435-b6d8-b3b03de218f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a36db8f3-da9d-44ed-bf8a-bd0538178a6e', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-85b39681-ac3b-49a2-8be9-f8f40f599555 tempest-VolumesServicesTestJSON-766744343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05888062-e96b-4719-b439-6d3e6d572993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:30 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-85b39681-ac3b-49a2-8be9-f8f40f599555 tempest-VolumesServicesTestJSON-766744343 None] Volume volume-a36db8f3-da9d-44ed-bf8a-bd0538178a6e (a36db8f3-da9d-44ed-bf8a-bd0538178a6e): created successfully Sep 03 11:25:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-85b39681-ac3b-49a2-8be9-f8f40f599555 tempest-VolumesServicesTestJSON-766744343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05888062-e96b-4719-b439-6d3e6d572993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-85b39681-ac3b-49a2-8be9-f8f40f599555 tempest-VolumesServicesTestJSON-766744343 None] Flow 'volume_create_manager' (720e4254-b5f6-4903-ae6c-c79fb4a61859) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:25:30 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-85b39681-ac3b-49a2-8be9-f8f40f599555 tempest-VolumesServicesTestJSON-766744343 None] Created volume successfully. Sep 03 11:25:31 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d4e66ec9-8356-4521-a621-5792f9510234 tempest-VolumesServicesTestJSON-766744343 None] Acquiring lock "cinder-a36db8f3-da9d-44ed-bf8a-bd0538178a6e-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:25:31 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d4e66ec9-8356-4521-a621-5792f9510234 tempest-VolumesServicesTestJSON-766744343 None] Lock "cinder-a36db8f3-da9d-44ed-bf8a-bd0538178a6e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:25:31 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d4e66ec9-8356-4521-a621-5792f9510234 tempest-VolumesServicesTestJSON-766744343 None] Acquiring lock "cinder-quobyte-a36db8f3-da9d-44ed-bf8a-bd0538178a6e" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:25:32 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d4e66ec9-8356-4521-a621-5792f9510234 tempest-VolumesServicesTestJSON-766744343 None] Lock "cinder-quobyte-a36db8f3-da9d-44ed-bf8a-bd0538178a6e" acquired by "delete_volume" :: waited 0.027s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:25:32 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9edee5-1a26-45f5-96ec-218c993c3e65]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:25:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d4e66ec9-8356-4521-a621-5792f9510234 tempest-VolumesServicesTestJSON-766744343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a36db8f3-da9d-44ed-bf8a-bd0538178a6e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:32 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a36db8f3-da9d-44ed-bf8a-bd0538178a6e Sep 03 11:25:32 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:32 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d4e66ec9-8356-4521-a621-5792f9510234 tempest-VolumesServicesTestJSON-766744343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a36db8f3-da9d-44ed-bf8a-bd0538178a6e" returned: 0 in 0.450s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d4e66ec9-8356-4521-a621-5792f9510234 tempest-VolumesServicesTestJSON-766744343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a36db8f3-da9d-44ed-bf8a-bd0538178a6e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:32 devstack sudo[101389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a36db8f3-da9d-44ed-bf8a-bd0538178a6e Sep 03 11:25:32 devstack sudo[101389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:32 devstack sudo[101389]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d4e66ec9-8356-4521-a621-5792f9510234 tempest-VolumesServicesTestJSON-766744343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a36db8f3-da9d-44ed-bf8a-bd0538178a6e" returned: 0 in 0.255s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:32 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d4e66ec9-8356-4521-a621-5792f9510234 tempest-VolumesServicesTestJSON-766744343 None] Lock "cinder-quobyte-a36db8f3-da9d-44ed-bf8a-bd0538178a6e" released by "delete_volume" :: held 0.753s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:25:32 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-d4e66ec9-8356-4521-a621-5792f9510234 tempest-VolumesServicesTestJSON-766744343 None] Created reservations ['76299ecb-ee8c-43ec-991c-3ad0db80a565', 'af4080cb-866d-4a78-99a9-05a71376dfb7', '28313a4a-8049-46e4-92f5-32488dcc86e3', 'dddcc085-1477-4f34-a3b3-9fb6ff6a45ec'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:25:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d4e66ec9-8356-4521-a621-5792f9510234 tempest-VolumesServicesTestJSON-766744343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d4e66ec9-8356-4521-a621-5792f9510234 tempest-VolumesServicesTestJSON-766744343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d4e66ec9-8356-4521-a621-5792f9510234 tempest-VolumesServicesTestJSON-766744343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:25:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d4e66ec9-8356-4521-a621-5792f9510234 tempest-VolumesServicesTestJSON-766744343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:25:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d4e66ec9-8356-4521-a621-5792f9510234 tempest-VolumesServicesTestJSON-766744343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d4e66ec9-8356-4521-a621-5792f9510234 tempest-VolumesServicesTestJSON-766744343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:32 devstack sudo[101393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:25:32 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:33 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d4e66ec9-8356-4521-a621-5792f9510234 tempest-VolumesServicesTestJSON-766744343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.383s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:33 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-d4e66ec9-8356-4521-a621-5792f9510234 tempest-VolumesServicesTestJSON-766744343 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:25:33 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-d4e66ec9-8356-4521-a621-5792f9510234 tempest-VolumesServicesTestJSON-766744343 None] Deleted volume successfully. Sep 03 11:25:33 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d4e66ec9-8356-4521-a621-5792f9510234 tempest-VolumesServicesTestJSON-766744343 None] Lock "cinder-a36db8f3-da9d-44ed-bf8a-bd0538178a6e-delete_volume" released by "delete_volume" :: held 1.391s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:25:39 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd2804ac-bc04-456b-bd5e-5e91e7b64be5 tempest-VolumesListAdminTestJSON-1750968847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:25:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-cd2804ac-bc04-456b-bd5e-5e91e7b64be5 tempest-VolumesListAdminTestJSON-1750968847 None] Flow 'volume_create_manager' (6a96367c-f4ba-4ca9-b0b0-f5eb246329a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:25:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-cd2804ac-bc04-456b-bd5e-5e91e7b64be5 tempest-VolumesListAdminTestJSON-1750968847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12b0863d-1237-4fa4-b004-6a14d98bf2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-cd2804ac-bc04-456b-bd5e-5e91e7b64be5 tempest-VolumesListAdminTestJSON-1750968847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12b0863d-1237-4fa4-b004-6a14d98bf2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-658168868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26782e95-8739-4aac-8c8e-10c7153cdf5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e50167e6fd4faa9527fad3aca01bd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:25:39Z,use_quota=True,user_id='b846c6fe3da34b8b83514fc550ab971a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-cd2804ac-bc04-456b-bd5e-5e91e7b64be5 tempest-VolumesListAdminTestJSON-1750968847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a28b243e-10c8-413f-b5ef-7622730ef01d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-cd2804ac-bc04-456b-bd5e-5e91e7b64be5 tempest-VolumesListAdminTestJSON-1750968847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a28b243e-10c8-413f-b5ef-7622730ef01d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-cd2804ac-bc04-456b-bd5e-5e91e7b64be5 tempest-VolumesListAdminTestJSON-1750968847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d3b382-f259-499b-9281-c1024ff16084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-cd2804ac-bc04-456b-bd5e-5e91e7b64be5 tempest-VolumesListAdminTestJSON-1750968847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35d3b382-f259-499b-9281-c1024ff16084) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26782e95-8739-4aac-8c8e-10c7153cdf5c', 'volume_name': 'volume-26782e95-8739-4aac-8c8e-10c7153cdf5c', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-cd2804ac-bc04-456b-bd5e-5e91e7b64be5 tempest-VolumesListAdminTestJSON-1750968847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (908d2ade-dc40-4086-aeff-0c2e64dc0439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-cd2804ac-bc04-456b-bd5e-5e91e7b64be5 tempest-VolumesListAdminTestJSON-1750968847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (908d2ade-dc40-4086-aeff-0c2e64dc0439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-cd2804ac-bc04-456b-bd5e-5e91e7b64be5 tempest-VolumesListAdminTestJSON-1750968847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c96eabef-7cd9-40bf-9501-dae0afe8a1af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:39 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-cd2804ac-bc04-456b-bd5e-5e91e7b64be5 tempest-VolumesListAdminTestJSON-1750968847 None] Volume 26782e95-8739-4aac-8c8e-10c7153cdf5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26782e95-8739-4aac-8c8e-10c7153cdf5c', 'volume_size': 1} Sep 03 11:25:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-cd2804ac-bc04-456b-bd5e-5e91e7b64be5 tempest-VolumesListAdminTestJSON-1750968847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-cd2804ac-bc04-456b-bd5e-5e91e7b64be5 tempest-VolumesListAdminTestJSON-1750968847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-cd2804ac-bc04-456b-bd5e-5e91e7b64be5 tempest-VolumesListAdminTestJSON-1750968847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-658168868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26782e95-8739-4aac-8c8e-10c7153cdf5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e50167e6fd4faa9527fad3aca01bd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:25:39Z,use_quota=True,user_id='b846c6fe3da34b8b83514fc550ab971a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:25:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-cd2804ac-bc04-456b-bd5e-5e91e7b64be5 tempest-VolumesListAdminTestJSON-1750968847 None] Creating volume 26782e95-8739-4aac-8c8e-10c7153cdf5c {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:25:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-cd2804ac-bc04-456b-bd5e-5e91e7b64be5 tempest-VolumesListAdminTestJSON-1750968847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-cd2804ac-bc04-456b-bd5e-5e91e7b64be5 tempest-VolumesListAdminTestJSON-1750968847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-cd2804ac-bc04-456b-bd5e-5e91e7b64be5 tempest-VolumesListAdminTestJSON-1750968847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:25:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-cd2804ac-bc04-456b-bd5e-5e91e7b64be5 tempest-VolumesListAdminTestJSON-1750968847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:25:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-cd2804ac-bc04-456b-bd5e-5e91e7b64be5 tempest-VolumesListAdminTestJSON-1750968847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-cd2804ac-bc04-456b-bd5e-5e91e7b64be5 tempest-VolumesListAdminTestJSON-1750968847 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:25:39 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-cd2804ac-bc04-456b-bd5e-5e91e7b64be5 tempest-VolumesListAdminTestJSON-1750968847 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:25:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cd2804ac-bc04-456b-bd5e-5e91e7b64be5 tempest-VolumesListAdminTestJSON-1750968847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-26782e95-8739-4aac-8c8e-10c7153cdf5c 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:39 devstack sudo[101408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-26782e95-8739-4aac-8c8e-10c7153cdf5c 1073741824 Sep 03 11:25:39 devstack sudo[101408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:39 devstack sudo[101408]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cd2804ac-bc04-456b-bd5e-5e91e7b64be5 tempest-VolumesListAdminTestJSON-1750968847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-26782e95-8739-4aac-8c8e-10c7153cdf5c 1073741824" returned: 0 in 0.508s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cd2804ac-bc04-456b-bd5e-5e91e7b64be5 tempest-VolumesListAdminTestJSON-1750968847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-26782e95-8739-4aac-8c8e-10c7153cdf5c {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:39 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-26782e95-8739-4aac-8c8e-10c7153cdf5c Sep 03 11:25:39 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:39 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-d56ef374-ef80-4c7c-99f9-07b402e3fd9d tempest-CreateVolumesFromImageTest-1272102553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:25:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d56ef374-ef80-4c7c-99f9-07b402e3fd9d tempest-CreateVolumesFromImageTest-1272102553 None] Flow 'volume_create_manager' (807dd235-1f91-42e1-a1a0-9aba0e6db180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:25:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d56ef374-ef80-4c7c-99f9-07b402e3fd9d tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a40ba4ca-4209-4aa9-9320-93acdcedfcd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d56ef374-ef80-4c7c-99f9-07b402e3fd9d tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a40ba4ca-4209-4aa9-9320-93acdcedfcd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-149994987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cfb2684-fafa-400a-aa91-0b17c98955a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8470c0dcb64647359d49e178926c5237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:25:40Z,use_quota=True,user_id='865f190d9e2345fe95c7919a37a830cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d56ef374-ef80-4c7c-99f9-07b402e3fd9d tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f7768d4-66e9-45f6-8ab0-8369ce027123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d56ef374-ef80-4c7c-99f9-07b402e3fd9d tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f7768d4-66e9-45f6-8ab0-8369ce027123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d56ef374-ef80-4c7c-99f9-07b402e3fd9d tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (893a8477-665d-4d38-9f26-13b93ba3ff1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d56ef374-ef80-4c7c-99f9-07b402e3fd9d tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (893a8477-665d-4d38-9f26-13b93ba3ff1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cfb2684-fafa-400a-aa91-0b17c98955a2', 'volume_name': 'volume-3cfb2684-fafa-400a-aa91-0b17c98955a2', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d56ef374-ef80-4c7c-99f9-07b402e3fd9d tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2681a0d3-1d83-4784-9777-c721e060e17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d56ef374-ef80-4c7c-99f9-07b402e3fd9d tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2681a0d3-1d83-4784-9777-c721e060e17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d56ef374-ef80-4c7c-99f9-07b402e3fd9d tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5275aa10-b0c4-4849-8ac6-fa0a3067fa08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:39 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-d56ef374-ef80-4c7c-99f9-07b402e3fd9d tempest-CreateVolumesFromImageTest-1272102553 None] Volume 3cfb2684-fafa-400a-aa91-0b17c98955a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cfb2684-fafa-400a-aa91-0b17c98955a2', 'volume_size': 1} Sep 03 11:25:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d56ef374-ef80-4c7c-99f9-07b402e3fd9d tempest-CreateVolumesFromImageTest-1272102553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:40 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cd2804ac-bc04-456b-bd5e-5e91e7b64be5 tempest-VolumesListAdminTestJSON-1750968847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-26782e95-8739-4aac-8c8e-10c7153cdf5c" returned: 0 in 0.334s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-cd2804ac-bc04-456b-bd5e-5e91e7b64be5 tempest-VolumesListAdminTestJSON-1750968847 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-cd2804ac-bc04-456b-bd5e-5e91e7b64be5 tempest-VolumesListAdminTestJSON-1750968847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.890s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d56ef374-ef80-4c7c-99f9-07b402e3fd9d tempest-CreateVolumesFromImageTest-1272102553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.128s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d56ef374-ef80-4c7c-99f9-07b402e3fd9d tempest-CreateVolumesFromImageTest-1272102553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:25:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-149994987',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cfb2684-fafa-400a-aa91-0b17c98955a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8470c0dcb64647359d49e178926c5237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:25:40Z,use_quota=True,user_id='865f190d9e2345fe95c7919a37a830cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-d56ef374-ef80-4c7c-99f9-07b402e3fd9d tempest-CreateVolumesFromImageTest-1272102553 None] Creating volume 3cfb2684-fafa-400a-aa91-0b17c98955a2 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d56ef374-ef80-4c7c-99f9-07b402e3fd9d tempest-CreateVolumesFromImageTest-1272102553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d56ef374-ef80-4c7c-99f9-07b402e3fd9d tempest-CreateVolumesFromImageTest-1272102553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d56ef374-ef80-4c7c-99f9-07b402e3fd9d tempest-CreateVolumesFromImageTest-1272102553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d56ef374-ef80-4c7c-99f9-07b402e3fd9d tempest-CreateVolumesFromImageTest-1272102553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d56ef374-ef80-4c7c-99f9-07b402e3fd9d tempest-CreateVolumesFromImageTest-1272102553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d56ef374-ef80-4c7c-99f9-07b402e3fd9d tempest-CreateVolumesFromImageTest-1272102553 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:25:40 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-d56ef374-ef80-4c7c-99f9-07b402e3fd9d tempest-CreateVolumesFromImageTest-1272102553 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d56ef374-ef80-4c7c-99f9-07b402e3fd9d tempest-CreateVolumesFromImageTest-1272102553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-3cfb2684-fafa-400a-aa91-0b17c98955a2 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:40 devstack sudo[101417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-3cfb2684-fafa-400a-aa91-0b17c98955a2 1073741824 Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-cd2804ac-bc04-456b-bd5e-5e91e7b64be5 tempest-VolumesListAdminTestJSON-1750968847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c96eabef-7cd9-40bf-9501-dae0afe8a1af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26782e95-8739-4aac-8c8e-10c7153cdf5c', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:40 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-cd2804ac-bc04-456b-bd5e-5e91e7b64be5 tempest-VolumesListAdminTestJSON-1750968847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57a93301-6fbd-453a-bfd2-39344a652bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:40 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-cd2804ac-bc04-456b-bd5e-5e91e7b64be5 tempest-VolumesListAdminTestJSON-1750968847 None] Volume volume-26782e95-8739-4aac-8c8e-10c7153cdf5c (26782e95-8739-4aac-8c8e-10c7153cdf5c): created successfully Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-cd2804ac-bc04-456b-bd5e-5e91e7b64be5 tempest-VolumesListAdminTestJSON-1750968847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57a93301-6fbd-453a-bfd2-39344a652bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-cd2804ac-bc04-456b-bd5e-5e91e7b64be5 tempest-VolumesListAdminTestJSON-1750968847 None] Flow 'volume_create_manager' (6a96367c-f4ba-4ca9-b0b0-f5eb246329a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:25:40 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-cd2804ac-bc04-456b-bd5e-5e91e7b64be5 tempest-VolumesListAdminTestJSON-1750968847 None] Created volume successfully. Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-a11f1d20-29c3-4b9d-a39f-d9a2cca11320 tempest-CreateVolumesFromImageTest-1272102553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a11f1d20-29c3-4b9d-a39f-d9a2cca11320 tempest-CreateVolumesFromImageTest-1272102553 None] Flow 'volume_create_manager' (8a5c9c31-45f4-4291-9719-aa262ec5057d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a11f1d20-29c3-4b9d-a39f-d9a2cca11320 tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bdec687-e8f6-460a-aa83-dc6ca190e3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a11f1d20-29c3-4b9d-a39f-d9a2cca11320 tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1bdec687-e8f6-460a-aa83-dc6ca190e3fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1945114888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b5d293a-26d1-47be-a94c-8e32c75b9433,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8470c0dcb64647359d49e178926c5237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:25:40Z,use_quota=True,user_id='865f190d9e2345fe95c7919a37a830cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a11f1d20-29c3-4b9d-a39f-d9a2cca11320 tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e21d407-d534-4f99-99aa-612395b21023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a11f1d20-29c3-4b9d-a39f-d9a2cca11320 tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e21d407-d534-4f99-99aa-612395b21023) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a11f1d20-29c3-4b9d-a39f-d9a2cca11320 tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a284ebf4-5f42-45ed-ada2-853487ed4045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a11f1d20-29c3-4b9d-a39f-d9a2cca11320 tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a284ebf4-5f42-45ed-ada2-853487ed4045) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b5d293a-26d1-47be-a94c-8e32c75b9433', 'volume_name': 'volume-0b5d293a-26d1-47be-a94c-8e32c75b9433', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a11f1d20-29c3-4b9d-a39f-d9a2cca11320 tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e26877-0b56-4e62-9ecb-9061967d0e36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a11f1d20-29c3-4b9d-a39f-d9a2cca11320 tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9e26877-0b56-4e62-9ecb-9061967d0e36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a11f1d20-29c3-4b9d-a39f-d9a2cca11320 tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (895a5cbe-fc6b-4626-a26d-b11a096d3ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:40 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-a11f1d20-29c3-4b9d-a39f-d9a2cca11320 tempest-CreateVolumesFromImageTest-1272102553 None] Volume 0b5d293a-26d1-47be-a94c-8e32c75b9433: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b5d293a-26d1-47be-a94c-8e32c75b9433', 'volume_size': 1} Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a11f1d20-29c3-4b9d-a39f-d9a2cca11320 tempest-CreateVolumesFromImageTest-1272102553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ea32496-6fdd-4fbb-be55-8daa169c855f tempest-CreateVolumesFromImageTest-1272102553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:25:40 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2ea32496-6fdd-4fbb-be55-8daa169c855f tempest-CreateVolumesFromImageTest-1272102553 None] Flow 'volume_create_manager' (18496fc8-93af-4cb3-aefe-51889d21fc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2ea32496-6fdd-4fbb-be55-8daa169c855f tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaa9fe43-03fb-4cdd-9f79-0b6b9df9ad3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d56ef374-ef80-4c7c-99f9-07b402e3fd9d tempest-CreateVolumesFromImageTest-1272102553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-3cfb2684-fafa-400a-aa91-0b17c98955a2 1073741824" returned: 0 in 0.673s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2ea32496-6fdd-4fbb-be55-8daa169c855f tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaa9fe43-03fb-4cdd-9f79-0b6b9df9ad3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1020113613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70b79e59-90d0-4de9-84ea-ab4a41dd5379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8470c0dcb64647359d49e178926c5237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:25:41Z,use_quota=True,user_id='865f190d9e2345fe95c7919a37a830cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2ea32496-6fdd-4fbb-be55-8daa169c855f tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69a4217e-23b8-4805-8677-d530b2bbaea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2ea32496-6fdd-4fbb-be55-8daa169c855f tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69a4217e-23b8-4805-8677-d530b2bbaea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2ea32496-6fdd-4fbb-be55-8daa169c855f tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (778c41dd-7f6a-48eb-918c-8595c6cd5ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2ea32496-6fdd-4fbb-be55-8daa169c855f tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (778c41dd-7f6a-48eb-918c-8595c6cd5ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70b79e59-90d0-4de9-84ea-ab4a41dd5379', 'volume_name': 'volume-70b79e59-90d0-4de9-84ea-ab4a41dd5379', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2ea32496-6fdd-4fbb-be55-8daa169c855f tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56430f9c-d095-4245-a20e-ec4e4fc19f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2ea32496-6fdd-4fbb-be55-8daa169c855f tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56430f9c-d095-4245-a20e-ec4e4fc19f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2ea32496-6fdd-4fbb-be55-8daa169c855f tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c88fc234-bab0-4187-959d-a40543b078a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:40 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-2ea32496-6fdd-4fbb-be55-8daa169c855f tempest-CreateVolumesFromImageTest-1272102553 None] Volume 70b79e59-90d0-4de9-84ea-ab4a41dd5379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70b79e59-90d0-4de9-84ea-ab4a41dd5379', 'volume_size': 1} Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2ea32496-6fdd-4fbb-be55-8daa169c855f tempest-CreateVolumesFromImageTest-1272102553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d56ef374-ef80-4c7c-99f9-07b402e3fd9d tempest-CreateVolumesFromImageTest-1272102553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-3cfb2684-fafa-400a-aa91-0b17c98955a2 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:40 devstack sudo[101424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-3cfb2684-fafa-400a-aa91-0b17c98955a2 Sep 03 11:25:40 devstack sudo[101424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-093a07ce-4594-416b-8d6a-bbf3307c20e7 tempest-CreateVolumesFromImageTest-1272102553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:25:41 devstack sudo[101424]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-093a07ce-4594-416b-8d6a-bbf3307c20e7 tempest-CreateVolumesFromImageTest-1272102553 None] Flow 'volume_create_manager' (5d985170-14cc-42c4-92bb-ad958cbc4788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-093a07ce-4594-416b-8d6a-bbf3307c20e7 tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76500906-0584-454e-bc2e-02efb6bd0f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d56ef374-ef80-4c7c-99f9-07b402e3fd9d tempest-CreateVolumesFromImageTest-1272102553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-3cfb2684-fafa-400a-aa91-0b17c98955a2" returned: 0 in 0.407s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d56ef374-ef80-4c7c-99f9-07b402e3fd9d tempest-CreateVolumesFromImageTest-1272102553 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d56ef374-ef80-4c7c-99f9-07b402e3fd9d tempest-CreateVolumesFromImageTest-1272102553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.176s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a11f1d20-29c3-4b9d-a39f-d9a2cca11320 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.941s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a11f1d20-29c3-4b9d-a39f-d9a2cca11320 tempest-CreateVolumesFromImageTest-1272102553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1945114888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b5d293a-26d1-47be-a94c-8e32c75b9433,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8470c0dcb64647359d49e178926c5237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:25:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:25:40Z,use_quota=True,user_id='865f190d9e2345fe95c7919a37a830cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-a11f1d20-29c3-4b9d-a39f-d9a2cca11320 tempest-CreateVolumesFromImageTest-1272102553 None] Creating volume 0b5d293a-26d1-47be-a94c-8e32c75b9433 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a11f1d20-29c3-4b9d-a39f-d9a2cca11320 tempest-CreateVolumesFromImageTest-1272102553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a11f1d20-29c3-4b9d-a39f-d9a2cca11320 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a11f1d20-29c3-4b9d-a39f-d9a2cca11320 tempest-CreateVolumesFromImageTest-1272102553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a11f1d20-29c3-4b9d-a39f-d9a2cca11320 tempest-CreateVolumesFromImageTest-1272102553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a11f1d20-29c3-4b9d-a39f-d9a2cca11320 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a11f1d20-29c3-4b9d-a39f-d9a2cca11320 tempest-CreateVolumesFromImageTest-1272102553 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:25:41 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-a11f1d20-29c3-4b9d-a39f-d9a2cca11320 tempest-CreateVolumesFromImageTest-1272102553 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a11f1d20-29c3-4b9d-a39f-d9a2cca11320 tempest-CreateVolumesFromImageTest-1272102553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0b5d293a-26d1-47be-a94c-8e32c75b9433 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:41 devstack sudo[101427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0b5d293a-26d1-47be-a94c-8e32c75b9433 1073741824 Sep 03 11:25:41 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-093a07ce-4594-416b-8d6a-bbf3307c20e7 tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (76500906-0584-454e-bc2e-02efb6bd0f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-7159038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d70d4005-962e-4dee-ac9d-58010f6f2146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8470c0dcb64647359d49e178926c5237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:25:41Z,use_quota=True,user_id='865f190d9e2345fe95c7919a37a830cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-093a07ce-4594-416b-8d6a-bbf3307c20e7 tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad2c2fa9-07a5-4a65-9207-9c8f322c9ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-093a07ce-4594-416b-8d6a-bbf3307c20e7 tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad2c2fa9-07a5-4a65-9207-9c8f322c9ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-093a07ce-4594-416b-8d6a-bbf3307c20e7 tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (208530ac-a056-4938-b2ce-72e488177025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-093a07ce-4594-416b-8d6a-bbf3307c20e7 tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (208530ac-a056-4938-b2ce-72e488177025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd70d4005-962e-4dee-ac9d-58010f6f2146', 'volume_name': 'volume-d70d4005-962e-4dee-ac9d-58010f6f2146', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-093a07ce-4594-416b-8d6a-bbf3307c20e7 tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (954d77c7-29ed-4ab7-9e53-ea1850bf05ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-093a07ce-4594-416b-8d6a-bbf3307c20e7 tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (954d77c7-29ed-4ab7-9e53-ea1850bf05ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-093a07ce-4594-416b-8d6a-bbf3307c20e7 tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b27f69-303d-41d7-aec2-b535e138e95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:41 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-093a07ce-4594-416b-8d6a-bbf3307c20e7 tempest-CreateVolumesFromImageTest-1272102553 None] Volume d70d4005-962e-4dee-ac9d-58010f6f2146: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d70d4005-962e-4dee-ac9d-58010f6f2146', 'volume_size': 1} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-093a07ce-4594-416b-8d6a-bbf3307c20e7 tempest-CreateVolumesFromImageTest-1272102553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d56ef374-ef80-4c7c-99f9-07b402e3fd9d tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5275aa10-b0c4-4849-8ac6-fa0a3067fa08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cfb2684-fafa-400a-aa91-0b17c98955a2', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d56ef374-ef80-4c7c-99f9-07b402e3fd9d tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53028198-a6f5-4f64-bf7c-f5856c101859) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:41 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-d56ef374-ef80-4c7c-99f9-07b402e3fd9d tempest-CreateVolumesFromImageTest-1272102553 None] Volume volume-3cfb2684-fafa-400a-aa91-0b17c98955a2 (3cfb2684-fafa-400a-aa91-0b17c98955a2): created successfully Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d56ef374-ef80-4c7c-99f9-07b402e3fd9d tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53028198-a6f5-4f64-bf7c-f5856c101859) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d56ef374-ef80-4c7c-99f9-07b402e3fd9d tempest-CreateVolumesFromImageTest-1272102553 None] Flow 'volume_create_manager' (807dd235-1f91-42e1-a1a0-9aba0e6db180) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:25:41 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-d56ef374-ef80-4c7c-99f9-07b402e3fd9d tempest-CreateVolumesFromImageTest-1272102553 None] Created volume successfully. Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-e586b482-6ace-4dbc-9e13-d34005de326b tempest-CreateVolumesFromImageTest-1272102553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e586b482-6ace-4dbc-9e13-d34005de326b tempest-CreateVolumesFromImageTest-1272102553 None] Flow 'volume_create_manager' (9101ab66-50dc-4290-b0e9-1c3505fd97ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e586b482-6ace-4dbc-9e13-d34005de326b tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb1770e-e959-4664-87b6-f8560f45f601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e586b482-6ace-4dbc-9e13-d34005de326b tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cb1770e-e959-4664-87b6-f8560f45f601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1177991577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdcceaff-7d6d-46b0-8942-99f25f1e5847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8470c0dcb64647359d49e178926c5237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:25:42Z,use_quota=True,user_id='865f190d9e2345fe95c7919a37a830cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e586b482-6ace-4dbc-9e13-d34005de326b tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (defeb4fe-34ed-4919-a03d-00293777ec6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e586b482-6ace-4dbc-9e13-d34005de326b tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (defeb4fe-34ed-4919-a03d-00293777ec6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e586b482-6ace-4dbc-9e13-d34005de326b tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15acd42b-1119-424a-a8e7-742dcdd91936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e586b482-6ace-4dbc-9e13-d34005de326b tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15acd42b-1119-424a-a8e7-742dcdd91936) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdcceaff-7d6d-46b0-8942-99f25f1e5847', 'volume_name': 'volume-fdcceaff-7d6d-46b0-8942-99f25f1e5847', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e586b482-6ace-4dbc-9e13-d34005de326b tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440b6c55-8c0e-4b5c-bd85-a68261ba7bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e586b482-6ace-4dbc-9e13-d34005de326b tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (440b6c55-8c0e-4b5c-bd85-a68261ba7bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e586b482-6ace-4dbc-9e13-d34005de326b tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (436e3308-759b-404d-a860-2d4d033ea49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:41 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-e586b482-6ace-4dbc-9e13-d34005de326b tempest-CreateVolumesFromImageTest-1272102553 None] Volume fdcceaff-7d6d-46b0-8942-99f25f1e5847: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdcceaff-7d6d-46b0-8942-99f25f1e5847', 'volume_size': 1} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e586b482-6ace-4dbc-9e13-d34005de326b tempest-CreateVolumesFromImageTest-1272102553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:41 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a11f1d20-29c3-4b9d-a39f-d9a2cca11320 tempest-CreateVolumesFromImageTest-1272102553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0b5d293a-26d1-47be-a94c-8e32c75b9433 1073741824" returned: 0 in 0.613s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-16ddb62c-275c-4e9c-8995-dd10804101a6 tempest-VolumesListAdminTestJSON-1750968847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-16ddb62c-275c-4e9c-8995-dd10804101a6 tempest-VolumesListAdminTestJSON-1750968847 None] Flow 'volume_create_manager' (217764b1-68fb-4f64-b347-8bf15eb762a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-16ddb62c-275c-4e9c-8995-dd10804101a6 tempest-VolumesListAdminTestJSON-1750968847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fb44c02-25ea-4a24-99f0-bef8a79bb627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a11f1d20-29c3-4b9d-a39f-d9a2cca11320 tempest-CreateVolumesFromImageTest-1272102553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0b5d293a-26d1-47be-a94c-8e32c75b9433 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-16ddb62c-275c-4e9c-8995-dd10804101a6 tempest-VolumesListAdminTestJSON-1750968847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fb44c02-25ea-4a24-99f0-bef8a79bb627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1345321304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=614900a6-42b5-4765-8953-8ba9f7865b2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e50167e6fd4faa9527fad3aca01bd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:25:42Z,use_quota=True,user_id='b846c6fe3da34b8b83514fc550ab971a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:42 devstack sudo[101432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0b5d293a-26d1-47be-a94c-8e32c75b9433 Sep 03 11:25:42 devstack sudo[101432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-16ddb62c-275c-4e9c-8995-dd10804101a6 tempest-VolumesListAdminTestJSON-1750968847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce64ff5-906b-4d6e-9070-d7625d8a676c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-16ddb62c-275c-4e9c-8995-dd10804101a6 tempest-VolumesListAdminTestJSON-1750968847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ce64ff5-906b-4d6e-9070-d7625d8a676c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-16ddb62c-275c-4e9c-8995-dd10804101a6 tempest-VolumesListAdminTestJSON-1750968847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e087a45-f47a-43e5-88ae-6e14b4ee0f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-16ddb62c-275c-4e9c-8995-dd10804101a6 tempest-VolumesListAdminTestJSON-1750968847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e087a45-f47a-43e5-88ae-6e14b4ee0f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '614900a6-42b5-4765-8953-8ba9f7865b2e', 'volume_name': 'volume-614900a6-42b5-4765-8953-8ba9f7865b2e', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-16ddb62c-275c-4e9c-8995-dd10804101a6 tempest-VolumesListAdminTestJSON-1750968847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75b20a79-e96e-41ca-95b3-94ec4841b2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-16ddb62c-275c-4e9c-8995-dd10804101a6 tempest-VolumesListAdminTestJSON-1750968847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75b20a79-e96e-41ca-95b3-94ec4841b2af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-16ddb62c-275c-4e9c-8995-dd10804101a6 tempest-VolumesListAdminTestJSON-1750968847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (207e9f71-cb92-4d45-8d85-208b6315aad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:42 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-16ddb62c-275c-4e9c-8995-dd10804101a6 tempest-VolumesListAdminTestJSON-1750968847 None] Volume 614900a6-42b5-4765-8953-8ba9f7865b2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-614900a6-42b5-4765-8953-8ba9f7865b2e', 'volume_size': 1} Sep 03 11:25:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-16ddb62c-275c-4e9c-8995-dd10804101a6 tempest-VolumesListAdminTestJSON-1750968847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:42 devstack sudo[101432]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a11f1d20-29c3-4b9d-a39f-d9a2cca11320 tempest-CreateVolumesFromImageTest-1272102553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0b5d293a-26d1-47be-a94c-8e32c75b9433" returned: 0 in 0.261s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:42 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a11f1d20-29c3-4b9d-a39f-d9a2cca11320 tempest-CreateVolumesFromImageTest-1272102553 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:25:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a11f1d20-29c3-4b9d-a39f-d9a2cca11320 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2ea32496-6fdd-4fbb-be55-8daa169c855f tempest-CreateVolumesFromImageTest-1272102553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.426s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:42 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2ea32496-6fdd-4fbb-be55-8daa169c855f tempest-CreateVolumesFromImageTest-1272102553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:25:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1020113613',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70b79e59-90d0-4de9-84ea-ab4a41dd5379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8470c0dcb64647359d49e178926c5237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:25:41Z,use_quota=True,user_id='865f190d9e2345fe95c7919a37a830cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:25:42 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-2ea32496-6fdd-4fbb-be55-8daa169c855f tempest-CreateVolumesFromImageTest-1272102553 None] Creating volume 70b79e59-90d0-4de9-84ea-ab4a41dd5379 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:25:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2ea32496-6fdd-4fbb-be55-8daa169c855f tempest-CreateVolumesFromImageTest-1272102553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2ea32496-6fdd-4fbb-be55-8daa169c855f tempest-CreateVolumesFromImageTest-1272102553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:42 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2ea32496-6fdd-4fbb-be55-8daa169c855f tempest-CreateVolumesFromImageTest-1272102553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:25:42 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2ea32496-6fdd-4fbb-be55-8daa169c855f tempest-CreateVolumesFromImageTest-1272102553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:25:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2ea32496-6fdd-4fbb-be55-8daa169c855f tempest-CreateVolumesFromImageTest-1272102553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:42 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2ea32496-6fdd-4fbb-be55-8daa169c855f tempest-CreateVolumesFromImageTest-1272102553 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:25:42 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-2ea32496-6fdd-4fbb-be55-8daa169c855f tempest-CreateVolumesFromImageTest-1272102553 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:25:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2ea32496-6fdd-4fbb-be55-8daa169c855f tempest-CreateVolumesFromImageTest-1272102553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-70b79e59-90d0-4de9-84ea-ab4a41dd5379 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a11f1d20-29c3-4b9d-a39f-d9a2cca11320 tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (895a5cbe-fc6b-4626-a26d-b11a096d3ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b5d293a-26d1-47be-a94c-8e32c75b9433', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:42 devstack sudo[101435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-70b79e59-90d0-4de9-84ea-ab4a41dd5379 1073741824 Sep 03 11:25:42 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a11f1d20-29c3-4b9d-a39f-d9a2cca11320 tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a1f0b9b-76b7-4638-8696-b1c903e8a1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:42 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-a11f1d20-29c3-4b9d-a39f-d9a2cca11320 tempest-CreateVolumesFromImageTest-1272102553 None] Volume volume-0b5d293a-26d1-47be-a94c-8e32c75b9433 (0b5d293a-26d1-47be-a94c-8e32c75b9433): created successfully Sep 03 11:25:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a11f1d20-29c3-4b9d-a39f-d9a2cca11320 tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a1f0b9b-76b7-4638-8696-b1c903e8a1a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a11f1d20-29c3-4b9d-a39f-d9a2cca11320 tempest-CreateVolumesFromImageTest-1272102553 None] Flow 'volume_create_manager' (8a5c9c31-45f4-4291-9719-aa262ec5057d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:25:42 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-a11f1d20-29c3-4b9d-a39f-d9a2cca11320 tempest-CreateVolumesFromImageTest-1272102553 None] Created volume successfully. Sep 03 11:25:42 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2ea32496-6fdd-4fbb-be55-8daa169c855f tempest-CreateVolumesFromImageTest-1272102553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-70b79e59-90d0-4de9-84ea-ab4a41dd5379 1073741824" returned: 0 in 0.442s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2ea32496-6fdd-4fbb-be55-8daa169c855f tempest-CreateVolumesFromImageTest-1272102553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-70b79e59-90d0-4de9-84ea-ab4a41dd5379 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:42 devstack sudo[101441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-70b79e59-90d0-4de9-84ea-ab4a41dd5379 Sep 03 11:25:42 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:42 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2ea32496-6fdd-4fbb-be55-8daa169c855f tempest-CreateVolumesFromImageTest-1272102553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-70b79e59-90d0-4de9-84ea-ab4a41dd5379" returned: 0 in 0.254s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2ea32496-6fdd-4fbb-be55-8daa169c855f tempest-CreateVolumesFromImageTest-1272102553 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:25:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2ea32496-6fdd-4fbb-be55-8daa169c855f tempest-CreateVolumesFromImageTest-1272102553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-093a07ce-4594-416b-8d6a-bbf3307c20e7 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.619s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-093a07ce-4594-416b-8d6a-bbf3307c20e7 tempest-CreateVolumesFromImageTest-1272102553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-7159038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d70d4005-962e-4dee-ac9d-58010f6f2146,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8470c0dcb64647359d49e178926c5237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:25:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:25:41Z,use_quota=True,user_id='865f190d9e2345fe95c7919a37a830cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:25:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-093a07ce-4594-416b-8d6a-bbf3307c20e7 tempest-CreateVolumesFromImageTest-1272102553 None] Creating volume d70d4005-962e-4dee-ac9d-58010f6f2146 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:25:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-093a07ce-4594-416b-8d6a-bbf3307c20e7 tempest-CreateVolumesFromImageTest-1272102553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-093a07ce-4594-416b-8d6a-bbf3307c20e7 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-093a07ce-4594-416b-8d6a-bbf3307c20e7 tempest-CreateVolumesFromImageTest-1272102553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:25:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-093a07ce-4594-416b-8d6a-bbf3307c20e7 tempest-CreateVolumesFromImageTest-1272102553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:25:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-093a07ce-4594-416b-8d6a-bbf3307c20e7 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-093a07ce-4594-416b-8d6a-bbf3307c20e7 tempest-CreateVolumesFromImageTest-1272102553 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:25:43 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-093a07ce-4594-416b-8d6a-bbf3307c20e7 tempest-CreateVolumesFromImageTest-1272102553 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:25:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-093a07ce-4594-416b-8d6a-bbf3307c20e7 tempest-CreateVolumesFromImageTest-1272102553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d70d4005-962e-4dee-ac9d-58010f6f2146 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2ea32496-6fdd-4fbb-be55-8daa169c855f tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c88fc234-bab0-4187-959d-a40543b078a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70b79e59-90d0-4de9-84ea-ab4a41dd5379', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:43 devstack sudo[101444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d70d4005-962e-4dee-ac9d-58010f6f2146 1073741824 Sep 03 11:25:43 devstack sudo[101444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2ea32496-6fdd-4fbb-be55-8daa169c855f tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10f47212-4c18-4803-837b-b8062d6c8610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:43 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-2ea32496-6fdd-4fbb-be55-8daa169c855f tempest-CreateVolumesFromImageTest-1272102553 None] Volume volume-70b79e59-90d0-4de9-84ea-ab4a41dd5379 (70b79e59-90d0-4de9-84ea-ab4a41dd5379): created successfully Sep 03 11:25:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2ea32496-6fdd-4fbb-be55-8daa169c855f tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10f47212-4c18-4803-837b-b8062d6c8610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2ea32496-6fdd-4fbb-be55-8daa169c855f tempest-CreateVolumesFromImageTest-1272102553 None] Flow 'volume_create_manager' (18496fc8-93af-4cb3-aefe-51889d21fc11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:25:43 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-2ea32496-6fdd-4fbb-be55-8daa169c855f tempest-CreateVolumesFromImageTest-1272102553 None] Created volume successfully. Sep 03 11:25:43 devstack sudo[101444]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-093a07ce-4594-416b-8d6a-bbf3307c20e7 tempest-CreateVolumesFromImageTest-1272102553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d70d4005-962e-4dee-ac9d-58010f6f2146 1073741824" returned: 0 in 0.434s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-093a07ce-4594-416b-8d6a-bbf3307c20e7 tempest-CreateVolumesFromImageTest-1272102553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d70d4005-962e-4dee-ac9d-58010f6f2146 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:43 devstack sudo[101449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d70d4005-962e-4dee-ac9d-58010f6f2146 Sep 03 11:25:43 devstack sudo[101449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:43 devstack sudo[101449]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-093a07ce-4594-416b-8d6a-bbf3307c20e7 tempest-CreateVolumesFromImageTest-1272102553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d70d4005-962e-4dee-ac9d-58010f6f2146" returned: 0 in 0.246s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-093a07ce-4594-416b-8d6a-bbf3307c20e7 tempest-CreateVolumesFromImageTest-1272102553 None] <== create_volume: return (719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:25:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-093a07ce-4594-416b-8d6a-bbf3307c20e7 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e586b482-6ace-4dbc-9e13-d34005de326b tempest-CreateVolumesFromImageTest-1272102553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.962s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e586b482-6ace-4dbc-9e13-d34005de326b tempest-CreateVolumesFromImageTest-1272102553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:25:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1177991577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdcceaff-7d6d-46b0-8942-99f25f1e5847,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8470c0dcb64647359d49e178926c5237',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:25:42Z,use_quota=True,user_id='865f190d9e2345fe95c7919a37a830cf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:25:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-e586b482-6ace-4dbc-9e13-d34005de326b tempest-CreateVolumesFromImageTest-1272102553 None] Creating volume fdcceaff-7d6d-46b0-8942-99f25f1e5847 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:25:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e586b482-6ace-4dbc-9e13-d34005de326b tempest-CreateVolumesFromImageTest-1272102553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e586b482-6ace-4dbc-9e13-d34005de326b tempest-CreateVolumesFromImageTest-1272102553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e586b482-6ace-4dbc-9e13-d34005de326b tempest-CreateVolumesFromImageTest-1272102553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:25:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e586b482-6ace-4dbc-9e13-d34005de326b tempest-CreateVolumesFromImageTest-1272102553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:25:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e586b482-6ace-4dbc-9e13-d34005de326b tempest-CreateVolumesFromImageTest-1272102553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e586b482-6ace-4dbc-9e13-d34005de326b tempest-CreateVolumesFromImageTest-1272102553 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:25:43 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-e586b482-6ace-4dbc-9e13-d34005de326b tempest-CreateVolumesFromImageTest-1272102553 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:25:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e586b482-6ace-4dbc-9e13-d34005de326b tempest-CreateVolumesFromImageTest-1272102553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fdcceaff-7d6d-46b0-8942-99f25f1e5847 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-093a07ce-4594-416b-8d6a-bbf3307c20e7 tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16b27f69-303d-41d7-aec2-b535e138e95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d70d4005-962e-4dee-ac9d-58010f6f2146', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:43 devstack sudo[101452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fdcceaff-7d6d-46b0-8942-99f25f1e5847 1073741824 Sep 03 11:25:43 devstack sudo[101452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-093a07ce-4594-416b-8d6a-bbf3307c20e7 tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22532455-677d-42c7-8393-07866d99dddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:43 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-093a07ce-4594-416b-8d6a-bbf3307c20e7 tempest-CreateVolumesFromImageTest-1272102553 None] Volume volume-d70d4005-962e-4dee-ac9d-58010f6f2146 (d70d4005-962e-4dee-ac9d-58010f6f2146): created successfully Sep 03 11:25:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-093a07ce-4594-416b-8d6a-bbf3307c20e7 tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22532455-677d-42c7-8393-07866d99dddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-093a07ce-4594-416b-8d6a-bbf3307c20e7 tempest-CreateVolumesFromImageTest-1272102553 None] Flow 'volume_create_manager' (5d985170-14cc-42c4-92bb-ad958cbc4788) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:25:43 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-093a07ce-4594-416b-8d6a-bbf3307c20e7 tempest-CreateVolumesFromImageTest-1272102553 None] Created volume successfully. Sep 03 11:25:44 devstack sudo[101452]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e586b482-6ace-4dbc-9e13-d34005de326b tempest-CreateVolumesFromImageTest-1272102553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fdcceaff-7d6d-46b0-8942-99f25f1e5847 1073741824" returned: 0 in 0.433s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e586b482-6ace-4dbc-9e13-d34005de326b tempest-CreateVolumesFromImageTest-1272102553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fdcceaff-7d6d-46b0-8942-99f25f1e5847 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:44 devstack sudo[101487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fdcceaff-7d6d-46b0-8942-99f25f1e5847 Sep 03 11:25:44 devstack sudo[101487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:44 devstack sudo[101487]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e586b482-6ace-4dbc-9e13-d34005de326b tempest-CreateVolumesFromImageTest-1272102553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fdcceaff-7d6d-46b0-8942-99f25f1e5847" returned: 0 in 0.242s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e586b482-6ace-4dbc-9e13-d34005de326b tempest-CreateVolumesFromImageTest-1272102553 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:25:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e586b482-6ace-4dbc-9e13-d34005de326b tempest-CreateVolumesFromImageTest-1272102553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-16ddb62c-275c-4e9c-8995-dd10804101a6 tempest-VolumesListAdminTestJSON-1750968847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.386s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-16ddb62c-275c-4e9c-8995-dd10804101a6 tempest-VolumesListAdminTestJSON-1750968847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:25:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1345321304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=614900a6-42b5-4765-8953-8ba9f7865b2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e50167e6fd4faa9527fad3aca01bd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:25:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:25:42Z,use_quota=True,user_id='b846c6fe3da34b8b83514fc550ab971a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:25:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-16ddb62c-275c-4e9c-8995-dd10804101a6 tempest-VolumesListAdminTestJSON-1750968847 None] Creating volume 614900a6-42b5-4765-8953-8ba9f7865b2e {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:25:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-16ddb62c-275c-4e9c-8995-dd10804101a6 tempest-VolumesListAdminTestJSON-1750968847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-16ddb62c-275c-4e9c-8995-dd10804101a6 tempest-VolumesListAdminTestJSON-1750968847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-16ddb62c-275c-4e9c-8995-dd10804101a6 tempest-VolumesListAdminTestJSON-1750968847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:25:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-16ddb62c-275c-4e9c-8995-dd10804101a6 tempest-VolumesListAdminTestJSON-1750968847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:25:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-16ddb62c-275c-4e9c-8995-dd10804101a6 tempest-VolumesListAdminTestJSON-1750968847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-16ddb62c-275c-4e9c-8995-dd10804101a6 tempest-VolumesListAdminTestJSON-1750968847 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:25:44 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-16ddb62c-275c-4e9c-8995-dd10804101a6 tempest-VolumesListAdminTestJSON-1750968847 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:25:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-16ddb62c-275c-4e9c-8995-dd10804101a6 tempest-VolumesListAdminTestJSON-1750968847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-614900a6-42b5-4765-8953-8ba9f7865b2e 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e586b482-6ace-4dbc-9e13-d34005de326b tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (436e3308-759b-404d-a860-2d4d033ea49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdcceaff-7d6d-46b0-8942-99f25f1e5847', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:44 devstack sudo[101490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-614900a6-42b5-4765-8953-8ba9f7865b2e 1073741824 Sep 03 11:25:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e586b482-6ace-4dbc-9e13-d34005de326b tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bbf3099-c550-4e70-9668-62a859132156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:44 devstack sudo[101490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:44 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-e586b482-6ace-4dbc-9e13-d34005de326b tempest-CreateVolumesFromImageTest-1272102553 None] Volume volume-fdcceaff-7d6d-46b0-8942-99f25f1e5847 (fdcceaff-7d6d-46b0-8942-99f25f1e5847): created successfully Sep 03 11:25:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e586b482-6ace-4dbc-9e13-d34005de326b tempest-CreateVolumesFromImageTest-1272102553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bbf3099-c550-4e70-9668-62a859132156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e586b482-6ace-4dbc-9e13-d34005de326b tempest-CreateVolumesFromImageTest-1272102553 None] Flow 'volume_create_manager' (9101ab66-50dc-4290-b0e9-1c3505fd97ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:25:44 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-e586b482-6ace-4dbc-9e13-d34005de326b tempest-CreateVolumesFromImageTest-1272102553 None] Created volume successfully. Sep 03 11:25:44 devstack sudo[101490]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-16ddb62c-275c-4e9c-8995-dd10804101a6 tempest-VolumesListAdminTestJSON-1750968847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-614900a6-42b5-4765-8953-8ba9f7865b2e 1073741824" returned: 0 in 0.434s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-16ddb62c-275c-4e9c-8995-dd10804101a6 tempest-VolumesListAdminTestJSON-1750968847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-614900a6-42b5-4765-8953-8ba9f7865b2e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:44 devstack sudo[101509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-614900a6-42b5-4765-8953-8ba9f7865b2e Sep 03 11:25:44 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:45 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f10aa8c7-1144-4999-9355-3242d3f395e0 tempest-CreateVolumesFromImageTest-1272102553 None] Acquiring lock "cinder-fdcceaff-7d6d-46b0-8942-99f25f1e5847-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:25:45 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f10aa8c7-1144-4999-9355-3242d3f395e0 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "cinder-fdcceaff-7d6d-46b0-8942-99f25f1e5847-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:25:45 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f10aa8c7-1144-4999-9355-3242d3f395e0 tempest-CreateVolumesFromImageTest-1272102553 None] Acquiring lock "cinder-quobyte-fdcceaff-7d6d-46b0-8942-99f25f1e5847" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:25:45 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f10aa8c7-1144-4999-9355-3242d3f395e0 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "cinder-quobyte-fdcceaff-7d6d-46b0-8942-99f25f1e5847" acquired by "delete_volume" :: waited 0.016s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:25:45 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52b4c7d-f146-4c5d-8833-6950b5358e43]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:25:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f10aa8c7-1144-4999-9355-3242d3f395e0 tempest-CreateVolumesFromImageTest-1272102553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fdcceaff-7d6d-46b0-8942-99f25f1e5847 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:45 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-16ddb62c-275c-4e9c-8995-dd10804101a6 tempest-VolumesListAdminTestJSON-1750968847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-614900a6-42b5-4765-8953-8ba9f7865b2e" returned: 0 in 0.334s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:45 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-16ddb62c-275c-4e9c-8995-dd10804101a6 tempest-VolumesListAdminTestJSON-1750968847 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:25:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-16ddb62c-275c-4e9c-8995-dd10804101a6 tempest-VolumesListAdminTestJSON-1750968847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:45 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fdcceaff-7d6d-46b0-8942-99f25f1e5847 Sep 03 11:25:45 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:45 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-16ddb62c-275c-4e9c-8995-dd10804101a6 tempest-VolumesListAdminTestJSON-1750968847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (207e9f71-cb92-4d45-8d85-208b6315aad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-614900a6-42b5-4765-8953-8ba9f7865b2e', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:45 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-16ddb62c-275c-4e9c-8995-dd10804101a6 tempest-VolumesListAdminTestJSON-1750968847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06954efa-7122-4829-a22c-bb08a6533917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:45 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-16ddb62c-275c-4e9c-8995-dd10804101a6 tempest-VolumesListAdminTestJSON-1750968847 None] Volume volume-614900a6-42b5-4765-8953-8ba9f7865b2e (614900a6-42b5-4765-8953-8ba9f7865b2e): created successfully Sep 03 11:25:45 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-16ddb62c-275c-4e9c-8995-dd10804101a6 tempest-VolumesListAdminTestJSON-1750968847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06954efa-7122-4829-a22c-bb08a6533917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:45 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-16ddb62c-275c-4e9c-8995-dd10804101a6 tempest-VolumesListAdminTestJSON-1750968847 None] Flow 'volume_create_manager' (217764b1-68fb-4f64-b347-8bf15eb762a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:25:45 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-16ddb62c-275c-4e9c-8995-dd10804101a6 tempest-VolumesListAdminTestJSON-1750968847 None] Created volume successfully. Sep 03 11:25:45 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f10aa8c7-1144-4999-9355-3242d3f395e0 tempest-CreateVolumesFromImageTest-1272102553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fdcceaff-7d6d-46b0-8942-99f25f1e5847" returned: 0 in 0.392s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f10aa8c7-1144-4999-9355-3242d3f395e0 tempest-CreateVolumesFromImageTest-1272102553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fdcceaff-7d6d-46b0-8942-99f25f1e5847 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:45 devstack sudo[101526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fdcceaff-7d6d-46b0-8942-99f25f1e5847 Sep 03 11:25:45 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:45 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f10aa8c7-1144-4999-9355-3242d3f395e0 tempest-CreateVolumesFromImageTest-1272102553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fdcceaff-7d6d-46b0-8942-99f25f1e5847" returned: 0 in 0.247s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:45 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f10aa8c7-1144-4999-9355-3242d3f395e0 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "cinder-quobyte-fdcceaff-7d6d-46b0-8942-99f25f1e5847" released by "delete_volume" :: held 0.702s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:25:45 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-f10aa8c7-1144-4999-9355-3242d3f395e0 tempest-CreateVolumesFromImageTest-1272102553 None] Created reservations ['c31ef808-3e8d-46f4-8ec1-426d6b2f6b93', 'd0f87a55-28a5-4ce1-bfbb-585b3a35efbf', 'f7fb84f4-e9a7-4efa-a81c-b69e01489565', 'a4eeb82f-b3b6-4d40-910b-d51102e3a5c9'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:25:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f10aa8c7-1144-4999-9355-3242d3f395e0 tempest-CreateVolumesFromImageTest-1272102553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f10aa8c7-1144-4999-9355-3242d3f395e0 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:45 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f10aa8c7-1144-4999-9355-3242d3f395e0 tempest-CreateVolumesFromImageTest-1272102553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:25:45 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f10aa8c7-1144-4999-9355-3242d3f395e0 tempest-CreateVolumesFromImageTest-1272102553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:25:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f10aa8c7-1144-4999-9355-3242d3f395e0 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f10aa8c7-1144-4999-9355-3242d3f395e0 tempest-CreateVolumesFromImageTest-1272102553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:45 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:25:45 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:46 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f10aa8c7-1144-4999-9355-3242d3f395e0 tempest-CreateVolumesFromImageTest-1272102553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.328s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:46 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-f10aa8c7-1144-4999-9355-3242d3f395e0 tempest-CreateVolumesFromImageTest-1272102553 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:25:46 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-f10aa8c7-1144-4999-9355-3242d3f395e0 tempest-CreateVolumesFromImageTest-1272102553 None] Deleted volume successfully. Sep 03 11:25:46 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-c16ffb5e-bd44-457b-9eb5-972dcfd8ac29 tempest-CreateVolumesFromImageTest-1272102553 None] Acquiring lock "cinder-d70d4005-962e-4dee-ac9d-58010f6f2146-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:25:46 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f10aa8c7-1144-4999-9355-3242d3f395e0 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "cinder-fdcceaff-7d6d-46b0-8942-99f25f1e5847-delete_volume" released by "delete_volume" :: held 1.265s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:25:46 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-c16ffb5e-bd44-457b-9eb5-972dcfd8ac29 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "cinder-d70d4005-962e-4dee-ac9d-58010f6f2146-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:25:46 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-c16ffb5e-bd44-457b-9eb5-972dcfd8ac29 tempest-CreateVolumesFromImageTest-1272102553 None] Acquiring lock "cinder-quobyte-d70d4005-962e-4dee-ac9d-58010f6f2146" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:25:46 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-c16ffb5e-bd44-457b-9eb5-972dcfd8ac29 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "cinder-quobyte-d70d4005-962e-4dee-ac9d-58010f6f2146" acquired by "delete_volume" :: waited 0.023s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:25:46 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9f1afa-1347-4474-ad56-44c54d90420f]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:25:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c16ffb5e-bd44-457b-9eb5-972dcfd8ac29 tempest-CreateVolumesFromImageTest-1272102553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d70d4005-962e-4dee-ac9d-58010f6f2146 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:46 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d70d4005-962e-4dee-ac9d-58010f6f2146 Sep 03 11:25:46 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:46 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-addb96bc-96e6-46b1-834b-33323367f800 tempest-VolumesListAdminTestJSON-1750968847 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:25:46 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:46 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-addb96bc-96e6-46b1-834b-33323367f800 tempest-VolumesListAdminTestJSON-1750968847 None] Flow 'volume_create_manager' (2b551d9e-b5e9-4c6b-a84f-a413a5f7c786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:25:46 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-addb96bc-96e6-46b1-834b-33323367f800 tempest-VolumesListAdminTestJSON-1750968847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4d22a68-b013-451a-acf0-849b63be1cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c16ffb5e-bd44-457b-9eb5-972dcfd8ac29 tempest-CreateVolumesFromImageTest-1272102553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d70d4005-962e-4dee-ac9d-58010f6f2146" returned: 0 in 0.532s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c16ffb5e-bd44-457b-9eb5-972dcfd8ac29 tempest-CreateVolumesFromImageTest-1272102553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d70d4005-962e-4dee-ac9d-58010f6f2146 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-addb96bc-96e6-46b1-834b-33323367f800 tempest-VolumesListAdminTestJSON-1750968847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4d22a68-b013-451a-acf0-849b63be1cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-904186376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e724440c-1bb8-4ee6-8fab-ccfbfddfd233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e50167e6fd4faa9527fad3aca01bd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:25:47Z,use_quota=True,user_id='b846c6fe3da34b8b83514fc550ab971a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-addb96bc-96e6-46b1-834b-33323367f800 tempest-VolumesListAdminTestJSON-1750968847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd8f4332-6d5b-455d-b240-bd9d668a30ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:47 devstack sudo[101539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d70d4005-962e-4dee-ac9d-58010f6f2146 Sep 03 11:25:47 devstack sudo[101539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-addb96bc-96e6-46b1-834b-33323367f800 tempest-VolumesListAdminTestJSON-1750968847 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd8f4332-6d5b-455d-b240-bd9d668a30ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-addb96bc-96e6-46b1-834b-33323367f800 tempest-VolumesListAdminTestJSON-1750968847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a5279f3-528d-41f5-95f0-f85077ba0924) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-addb96bc-96e6-46b1-834b-33323367f800 tempest-VolumesListAdminTestJSON-1750968847 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a5279f3-528d-41f5-95f0-f85077ba0924) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e724440c-1bb8-4ee6-8fab-ccfbfddfd233', 'volume_name': 'volume-e724440c-1bb8-4ee6-8fab-ccfbfddfd233', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-addb96bc-96e6-46b1-834b-33323367f800 tempest-VolumesListAdminTestJSON-1750968847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (775b707f-4210-45ee-acce-0e5373389699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-addb96bc-96e6-46b1-834b-33323367f800 tempest-VolumesListAdminTestJSON-1750968847 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (775b707f-4210-45ee-acce-0e5373389699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-addb96bc-96e6-46b1-834b-33323367f800 tempest-VolumesListAdminTestJSON-1750968847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19d5f01a-64aa-4af7-805e-9e5bb71bda72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:47 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-addb96bc-96e6-46b1-834b-33323367f800 tempest-VolumesListAdminTestJSON-1750968847 None] Volume e724440c-1bb8-4ee6-8fab-ccfbfddfd233: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e724440c-1bb8-4ee6-8fab-ccfbfddfd233', 'volume_size': 1} Sep 03 11:25:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-addb96bc-96e6-46b1-834b-33323367f800 tempest-VolumesListAdminTestJSON-1750968847 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-addb96bc-96e6-46b1-834b-33323367f800 tempest-VolumesListAdminTestJSON-1750968847 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:47 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-addb96bc-96e6-46b1-834b-33323367f800 tempest-VolumesListAdminTestJSON-1750968847 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:25:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-904186376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e724440c-1bb8-4ee6-8fab-ccfbfddfd233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06e50167e6fd4faa9527fad3aca01bd3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:25:47Z,use_quota=True,user_id='b846c6fe3da34b8b83514fc550ab971a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:25:47 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-addb96bc-96e6-46b1-834b-33323367f800 tempest-VolumesListAdminTestJSON-1750968847 None] Creating volume e724440c-1bb8-4ee6-8fab-ccfbfddfd233 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:25:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-addb96bc-96e6-46b1-834b-33323367f800 tempest-VolumesListAdminTestJSON-1750968847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-addb96bc-96e6-46b1-834b-33323367f800 tempest-VolumesListAdminTestJSON-1750968847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:47 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-addb96bc-96e6-46b1-834b-33323367f800 tempest-VolumesListAdminTestJSON-1750968847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:25:47 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-addb96bc-96e6-46b1-834b-33323367f800 tempest-VolumesListAdminTestJSON-1750968847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:25:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-addb96bc-96e6-46b1-834b-33323367f800 tempest-VolumesListAdminTestJSON-1750968847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:47 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-addb96bc-96e6-46b1-834b-33323367f800 tempest-VolumesListAdminTestJSON-1750968847 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:25:47 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-addb96bc-96e6-46b1-834b-33323367f800 tempest-VolumesListAdminTestJSON-1750968847 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:25:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-addb96bc-96e6-46b1-834b-33323367f800 tempest-VolumesListAdminTestJSON-1750968847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e724440c-1bb8-4ee6-8fab-ccfbfddfd233 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:47 devstack sudo[101541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e724440c-1bb8-4ee6-8fab-ccfbfddfd233 1073741824 Sep 03 11:25:47 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:47 devstack sudo[101539]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c16ffb5e-bd44-457b-9eb5-972dcfd8ac29 tempest-CreateVolumesFromImageTest-1272102553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d70d4005-962e-4dee-ac9d-58010f6f2146" returned: 0 in 0.329s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:47 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-c16ffb5e-bd44-457b-9eb5-972dcfd8ac29 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "cinder-quobyte-d70d4005-962e-4dee-ac9d-58010f6f2146" released by "delete_volume" :: held 0.912s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:25:47 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-c16ffb5e-bd44-457b-9eb5-972dcfd8ac29 tempest-CreateVolumesFromImageTest-1272102553 None] Created reservations ['ad19ef7e-a8a6-43d8-bf98-24032343f147', '9fa988f6-8c0b-404e-b2c3-4089d3456086', 'd2d69243-382d-4d5a-b7b4-b1df4e29fc76', 'e72c118e-dba1-4442-8f9a-05afc64e31e5'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:25:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-c16ffb5e-bd44-457b-9eb5-972dcfd8ac29 tempest-CreateVolumesFromImageTest-1272102553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-c16ffb5e-bd44-457b-9eb5-972dcfd8ac29 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:47 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-c16ffb5e-bd44-457b-9eb5-972dcfd8ac29 tempest-CreateVolumesFromImageTest-1272102553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:25:47 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-c16ffb5e-bd44-457b-9eb5-972dcfd8ac29 tempest-CreateVolumesFromImageTest-1272102553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:25:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-c16ffb5e-bd44-457b-9eb5-972dcfd8ac29 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c16ffb5e-bd44-457b-9eb5-972dcfd8ac29 tempest-CreateVolumesFromImageTest-1272102553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:47 devstack sudo[101549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:25:47 devstack sudo[101549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:47 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-addb96bc-96e6-46b1-834b-33323367f800 tempest-VolumesListAdminTestJSON-1750968847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e724440c-1bb8-4ee6-8fab-ccfbfddfd233 1073741824" returned: 0 in 0.616s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-addb96bc-96e6-46b1-834b-33323367f800 tempest-VolumesListAdminTestJSON-1750968847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e724440c-1bb8-4ee6-8fab-ccfbfddfd233 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:47 devstack sudo[101556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e724440c-1bb8-4ee6-8fab-ccfbfddfd233 Sep 03 11:25:47 devstack sudo[101556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:47 devstack sudo[101549]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c16ffb5e-bd44-457b-9eb5-972dcfd8ac29 tempest-CreateVolumesFromImageTest-1272102553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.325s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:47 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-c16ffb5e-bd44-457b-9eb5-972dcfd8ac29 tempest-CreateVolumesFromImageTest-1272102553 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:25:47 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-c16ffb5e-bd44-457b-9eb5-972dcfd8ac29 tempest-CreateVolumesFromImageTest-1272102553 None] Deleted volume successfully. Sep 03 11:25:47 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-c16ffb5e-bd44-457b-9eb5-972dcfd8ac29 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "cinder-d70d4005-962e-4dee-ac9d-58010f6f2146-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:25:48 devstack sudo[101556]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-addb96bc-96e6-46b1-834b-33323367f800 tempest-VolumesListAdminTestJSON-1750968847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e724440c-1bb8-4ee6-8fab-ccfbfddfd233" returned: 0 in 0.329s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-addb96bc-96e6-46b1-834b-33323367f800 tempest-VolumesListAdminTestJSON-1750968847 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:25:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-addb96bc-96e6-46b1-834b-33323367f800 tempest-VolumesListAdminTestJSON-1750968847 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-addb96bc-96e6-46b1-834b-33323367f800 tempest-VolumesListAdminTestJSON-1750968847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19d5f01a-64aa-4af7-805e-9e5bb71bda72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e724440c-1bb8-4ee6-8fab-ccfbfddfd233', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-addb96bc-96e6-46b1-834b-33323367f800 tempest-VolumesListAdminTestJSON-1750968847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29cc16c2-f6e9-4de5-808f-9e9710ab3f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:48 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-addb96bc-96e6-46b1-834b-33323367f800 tempest-VolumesListAdminTestJSON-1750968847 None] Volume volume-e724440c-1bb8-4ee6-8fab-ccfbfddfd233 (e724440c-1bb8-4ee6-8fab-ccfbfddfd233): created successfully Sep 03 11:25:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-addb96bc-96e6-46b1-834b-33323367f800 tempest-VolumesListAdminTestJSON-1750968847 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29cc16c2-f6e9-4de5-808f-9e9710ab3f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-addb96bc-96e6-46b1-834b-33323367f800 tempest-VolumesListAdminTestJSON-1750968847 None] Flow 'volume_create_manager' (2b551d9e-b5e9-4c6b-a84f-a413a5f7c786) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:25:48 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-addb96bc-96e6-46b1-834b-33323367f800 tempest-VolumesListAdminTestJSON-1750968847 None] Created volume successfully. Sep 03 11:25:48 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-205d6ff8-655b-4fb1-9fca-0ec04083f975 tempest-CreateVolumesFromImageTest-1272102553 None] Acquiring lock "cinder-70b79e59-90d0-4de9-84ea-ab4a41dd5379-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:25:48 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-205d6ff8-655b-4fb1-9fca-0ec04083f975 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "cinder-70b79e59-90d0-4de9-84ea-ab4a41dd5379-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:25:48 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-205d6ff8-655b-4fb1-9fca-0ec04083f975 tempest-CreateVolumesFromImageTest-1272102553 None] Acquiring lock "cinder-quobyte-70b79e59-90d0-4de9-84ea-ab4a41dd5379" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:25:48 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-205d6ff8-655b-4fb1-9fca-0ec04083f975 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "cinder-quobyte-70b79e59-90d0-4de9-84ea-ab4a41dd5379" acquired by "delete_volume" :: waited 0.017s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:25:48 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[707b563b-37a5-4045-b4c0-e45697625681]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:25:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-205d6ff8-655b-4fb1-9fca-0ec04083f975 tempest-CreateVolumesFromImageTest-1272102553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-70b79e59-90d0-4de9-84ea-ab4a41dd5379 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:48 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-70b79e59-90d0-4de9-84ea-ab4a41dd5379 Sep 03 11:25:48 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:49 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-205d6ff8-655b-4fb1-9fca-0ec04083f975 tempest-CreateVolumesFromImageTest-1272102553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-70b79e59-90d0-4de9-84ea-ab4a41dd5379" returned: 0 in 0.406s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-205d6ff8-655b-4fb1-9fca-0ec04083f975 tempest-CreateVolumesFromImageTest-1272102553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-70b79e59-90d0-4de9-84ea-ab4a41dd5379 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:49 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-70b79e59-90d0-4de9-84ea-ab4a41dd5379 Sep 03 11:25:49 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:49 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-205d6ff8-655b-4fb1-9fca-0ec04083f975 tempest-CreateVolumesFromImageTest-1272102553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-70b79e59-90d0-4de9-84ea-ab4a41dd5379" returned: 0 in 0.280s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-205d6ff8-655b-4fb1-9fca-0ec04083f975 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "cinder-quobyte-70b79e59-90d0-4de9-84ea-ab4a41dd5379" released by "delete_volume" :: held 0.724s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-205d6ff8-655b-4fb1-9fca-0ec04083f975 tempest-CreateVolumesFromImageTest-1272102553 None] Created reservations ['5d75627e-44f7-4615-8a9f-0ff698eefcf3', '7e7441ed-d71c-4c77-a671-a252a3831b7f', 'da8d2829-19ce-4a00-b2dc-b5e7df36cfe8', '823bbde3-b44e-4339-88c0-fe69b0c0dac3'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-205d6ff8-655b-4fb1-9fca-0ec04083f975 tempest-CreateVolumesFromImageTest-1272102553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-205d6ff8-655b-4fb1-9fca-0ec04083f975 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-205d6ff8-655b-4fb1-9fca-0ec04083f975 tempest-CreateVolumesFromImageTest-1272102553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-205d6ff8-655b-4fb1-9fca-0ec04083f975 tempest-CreateVolumesFromImageTest-1272102553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-205d6ff8-655b-4fb1-9fca-0ec04083f975 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-205d6ff8-655b-4fb1-9fca-0ec04083f975 tempest-CreateVolumesFromImageTest-1272102553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:49 devstack sudo[101573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:25:49 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cd44e68-da39-492a-8c4b-5f0ef3b048c7 tempest-VolumesListAdminTestJSON-815140747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8cd44e68-da39-492a-8c4b-5f0ef3b048c7 tempest-VolumesListAdminTestJSON-815140747 None] Flow 'volume_create_manager' (f358adad-750f-4a57-a535-4d9a74d4697b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8cd44e68-da39-492a-8c4b-5f0ef3b048c7 tempest-VolumesListAdminTestJSON-815140747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f444c08e-d5d6-4373-8a76-e2a1d4eff204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8cd44e68-da39-492a-8c4b-5f0ef3b048c7 tempest-VolumesListAdminTestJSON-815140747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f444c08e-d5d6-4373-8a76-e2a1d4eff204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c88562b-0fbb-4ab5-9462-f6a91df927aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='943b4e36c6b745e6a69993e9bd5fdd78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:25:50Z,use_quota=True,user_id='14eea5de2b5449b9ab2226bc35275cae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8cd44e68-da39-492a-8c4b-5f0ef3b048c7 tempest-VolumesListAdminTestJSON-815140747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54108eda-7213-4259-af3b-ef657fda50c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8cd44e68-da39-492a-8c4b-5f0ef3b048c7 tempest-VolumesListAdminTestJSON-815140747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54108eda-7213-4259-af3b-ef657fda50c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8cd44e68-da39-492a-8c4b-5f0ef3b048c7 tempest-VolumesListAdminTestJSON-815140747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5656be96-1a6c-49a0-9b98-7ee67304af07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:49 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8cd44e68-da39-492a-8c4b-5f0ef3b048c7 tempest-VolumesListAdminTestJSON-815140747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5656be96-1a6c-49a0-9b98-7ee67304af07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c88562b-0fbb-4ab5-9462-f6a91df927aa', 'volume_name': 'volume-5c88562b-0fbb-4ab5-9462-f6a91df927aa', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8cd44e68-da39-492a-8c4b-5f0ef3b048c7 tempest-VolumesListAdminTestJSON-815140747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b20332a9-964e-40bb-8f79-0c72f10b37df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8cd44e68-da39-492a-8c4b-5f0ef3b048c7 tempest-VolumesListAdminTestJSON-815140747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b20332a9-964e-40bb-8f79-0c72f10b37df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8cd44e68-da39-492a-8c4b-5f0ef3b048c7 tempest-VolumesListAdminTestJSON-815140747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46ad4966-e87b-4d28-aeb4-e5908bca5e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:49 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-8cd44e68-da39-492a-8c4b-5f0ef3b048c7 tempest-VolumesListAdminTestJSON-815140747 None] Volume 5c88562b-0fbb-4ab5-9462-f6a91df927aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c88562b-0fbb-4ab5-9462-f6a91df927aa', 'volume_size': 1} Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-8cd44e68-da39-492a-8c4b-5f0ef3b048c7 tempest-VolumesListAdminTestJSON-815140747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-8cd44e68-da39-492a-8c4b-5f0ef3b048c7 tempest-VolumesListAdminTestJSON-815140747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-8cd44e68-da39-492a-8c4b-5f0ef3b048c7 tempest-VolumesListAdminTestJSON-815140747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:25:49Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c88562b-0fbb-4ab5-9462-f6a91df927aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='943b4e36c6b745e6a69993e9bd5fdd78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:25:50Z,use_quota=True,user_id='14eea5de2b5449b9ab2226bc35275cae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-8cd44e68-da39-492a-8c4b-5f0ef3b048c7 tempest-VolumesListAdminTestJSON-815140747 None] Creating volume 5c88562b-0fbb-4ab5-9462-f6a91df927aa {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-8cd44e68-da39-492a-8c4b-5f0ef3b048c7 tempest-VolumesListAdminTestJSON-815140747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-8cd44e68-da39-492a-8c4b-5f0ef3b048c7 tempest-VolumesListAdminTestJSON-815140747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-8cd44e68-da39-492a-8c4b-5f0ef3b048c7 tempest-VolumesListAdminTestJSON-815140747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-8cd44e68-da39-492a-8c4b-5f0ef3b048c7 tempest-VolumesListAdminTestJSON-815140747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-8cd44e68-da39-492a-8c4b-5f0ef3b048c7 tempest-VolumesListAdminTestJSON-815140747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-8cd44e68-da39-492a-8c4b-5f0ef3b048c7 tempest-VolumesListAdminTestJSON-815140747 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:25:49 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-8cd44e68-da39-492a-8c4b-5f0ef3b048c7 tempest-VolumesListAdminTestJSON-815140747 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8cd44e68-da39-492a-8c4b-5f0ef3b048c7 tempest-VolumesListAdminTestJSON-815140747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5c88562b-0fbb-4ab5-9462-f6a91df927aa 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-23e6fb50-601a-49d0-bb6a-f777aa7567f2 tempest-CreateVolumesFromImageTest-1272102553 None] Acquiring lock "cinder-0b5d293a-26d1-47be-a94c-8e32c75b9433-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-205d6ff8-655b-4fb1-9fca-0ec04083f975 tempest-CreateVolumesFromImageTest-1272102553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.349s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-205d6ff8-655b-4fb1-9fca-0ec04083f975 tempest-CreateVolumesFromImageTest-1272102553 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:25:49 devstack sudo[101576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5c88562b-0fbb-4ab5-9462-f6a91df927aa 1073741824 Sep 03 11:25:49 devstack sudo[101576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:49 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-205d6ff8-655b-4fb1-9fca-0ec04083f975 tempest-CreateVolumesFromImageTest-1272102553 None] Deleted volume successfully. Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-23e6fb50-601a-49d0-bb6a-f777aa7567f2 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "cinder-0b5d293a-26d1-47be-a94c-8e32c75b9433-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-205d6ff8-655b-4fb1-9fca-0ec04083f975 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "cinder-70b79e59-90d0-4de9-84ea-ab4a41dd5379-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-23e6fb50-601a-49d0-bb6a-f777aa7567f2 tempest-CreateVolumesFromImageTest-1272102553 None] Acquiring lock "cinder-quobyte-0b5d293a-26d1-47be-a94c-8e32c75b9433" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-23e6fb50-601a-49d0-bb6a-f777aa7567f2 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "cinder-quobyte-0b5d293a-26d1-47be-a94c-8e32c75b9433" acquired by "delete_volume" :: waited 0.016s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e4827e-b31f-4574-8109-dd41db1e314a]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:25:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23e6fb50-601a-49d0-bb6a-f777aa7567f2 tempest-CreateVolumesFromImageTest-1272102553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0b5d293a-26d1-47be-a94c-8e32c75b9433 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:50 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0b5d293a-26d1-47be-a94c-8e32c75b9433 Sep 03 11:25:50 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:50 devstack sudo[101576]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8cd44e68-da39-492a-8c4b-5f0ef3b048c7 tempest-VolumesListAdminTestJSON-815140747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5c88562b-0fbb-4ab5-9462-f6a91df927aa 1073741824" returned: 0 in 0.449s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8cd44e68-da39-492a-8c4b-5f0ef3b048c7 tempest-VolumesListAdminTestJSON-815140747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5c88562b-0fbb-4ab5-9462-f6a91df927aa {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:50 devstack sudo[101587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5c88562b-0fbb-4ab5-9462-f6a91df927aa Sep 03 11:25:50 devstack sudo[101587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:50 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23e6fb50-601a-49d0-bb6a-f777aa7567f2 tempest-CreateVolumesFromImageTest-1272102553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0b5d293a-26d1-47be-a94c-8e32c75b9433" returned: 0 in 0.404s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23e6fb50-601a-49d0-bb6a-f777aa7567f2 tempest-CreateVolumesFromImageTest-1272102553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0b5d293a-26d1-47be-a94c-8e32c75b9433 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:50 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0b5d293a-26d1-47be-a94c-8e32c75b9433 Sep 03 11:25:50 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:50 devstack sudo[101587]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8cd44e68-da39-492a-8c4b-5f0ef3b048c7 tempest-VolumesListAdminTestJSON-815140747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5c88562b-0fbb-4ab5-9462-f6a91df927aa" returned: 0 in 0.256s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:50 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-8cd44e68-da39-492a-8c4b-5f0ef3b048c7 tempest-VolumesListAdminTestJSON-815140747 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:25:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-8cd44e68-da39-492a-8c4b-5f0ef3b048c7 tempest-VolumesListAdminTestJSON-815140747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8cd44e68-da39-492a-8c4b-5f0ef3b048c7 tempest-VolumesListAdminTestJSON-815140747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46ad4966-e87b-4d28-aeb4-e5908bca5e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c88562b-0fbb-4ab5-9462-f6a91df927aa', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8cd44e68-da39-492a-8c4b-5f0ef3b048c7 tempest-VolumesListAdminTestJSON-815140747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18bdf6ce-d50d-4206-9965-02344f7c5c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:50 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-8cd44e68-da39-492a-8c4b-5f0ef3b048c7 tempest-VolumesListAdminTestJSON-815140747 None] Volume volume-5c88562b-0fbb-4ab5-9462-f6a91df927aa (5c88562b-0fbb-4ab5-9462-f6a91df927aa): created successfully Sep 03 11:25:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8cd44e68-da39-492a-8c4b-5f0ef3b048c7 tempest-VolumesListAdminTestJSON-815140747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18bdf6ce-d50d-4206-9965-02344f7c5c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8cd44e68-da39-492a-8c4b-5f0ef3b048c7 tempest-VolumesListAdminTestJSON-815140747 None] Flow 'volume_create_manager' (f358adad-750f-4a57-a535-4d9a74d4697b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:25:50 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23e6fb50-601a-49d0-bb6a-f777aa7567f2 tempest-CreateVolumesFromImageTest-1272102553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0b5d293a-26d1-47be-a94c-8e32c75b9433" returned: 0 in 0.299s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:50 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-8cd44e68-da39-492a-8c4b-5f0ef3b048c7 tempest-VolumesListAdminTestJSON-815140747 None] Created volume successfully. Sep 03 11:25:50 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-23e6fb50-601a-49d0-bb6a-f777aa7567f2 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "cinder-quobyte-0b5d293a-26d1-47be-a94c-8e32c75b9433" released by "delete_volume" :: held 0.747s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:25:50 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-23e6fb50-601a-49d0-bb6a-f777aa7567f2 tempest-CreateVolumesFromImageTest-1272102553 None] Created reservations ['6bf98324-a3a5-457f-bb94-ed226e92ae10', '92166394-5d3b-455c-8a51-25de751d1d5f', 'c2d8a943-ef9c-4da3-b62f-fbdd382c5ec1', '30d514b8-1324-4a31-af43-56ffdf0cad1f'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:25:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-23e6fb50-601a-49d0-bb6a-f777aa7567f2 tempest-CreateVolumesFromImageTest-1272102553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-23e6fb50-601a-49d0-bb6a-f777aa7567f2 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:50 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-23e6fb50-601a-49d0-bb6a-f777aa7567f2 tempest-CreateVolumesFromImageTest-1272102553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:25:50 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-23e6fb50-601a-49d0-bb6a-f777aa7567f2 tempest-CreateVolumesFromImageTest-1272102553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:25:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-23e6fb50-601a-49d0-bb6a-f777aa7567f2 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23e6fb50-601a-49d0-bb6a-f777aa7567f2 tempest-CreateVolumesFromImageTest-1272102553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:50 devstack sudo[101593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:25:50 devstack sudo[101593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:50 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d6ccb6cb-fe21-4cee-948b-8ec1c2f238f4 tempest-CreateVolumesFromImageTest-1272102553 None] Acquiring lock "cinder-3cfb2684-fafa-400a-aa91-0b17c98955a2-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:25:50 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d6ccb6cb-fe21-4cee-948b-8ec1c2f238f4 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "cinder-3cfb2684-fafa-400a-aa91-0b17c98955a2-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:25:51 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d6ccb6cb-fe21-4cee-948b-8ec1c2f238f4 tempest-CreateVolumesFromImageTest-1272102553 None] Acquiring lock "cinder-quobyte-3cfb2684-fafa-400a-aa91-0b17c98955a2" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:25:51 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d6ccb6cb-fe21-4cee-948b-8ec1c2f238f4 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "cinder-quobyte-3cfb2684-fafa-400a-aa91-0b17c98955a2" acquired by "delete_volume" :: waited 0.018s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:25:51 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d395de3-b38f-4fba-a228-8c4bb70049b1]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:25:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d6ccb6cb-fe21-4cee-948b-8ec1c2f238f4 tempest-CreateVolumesFromImageTest-1272102553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-3cfb2684-fafa-400a-aa91-0b17c98955a2 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:51 devstack sudo[101593]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23e6fb50-601a-49d0-bb6a-f777aa7567f2 tempest-CreateVolumesFromImageTest-1272102553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.285s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:51 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-23e6fb50-601a-49d0-bb6a-f777aa7567f2 tempest-CreateVolumesFromImageTest-1272102553 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:25:51 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-23e6fb50-601a-49d0-bb6a-f777aa7567f2 tempest-CreateVolumesFromImageTest-1272102553 None] Deleted volume successfully. Sep 03 11:25:51 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-23e6fb50-601a-49d0-bb6a-f777aa7567f2 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "cinder-0b5d293a-26d1-47be-a94c-8e32c75b9433-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:25:51 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-3cfb2684-fafa-400a-aa91-0b17c98955a2 Sep 03 11:25:51 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:51 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d6ccb6cb-fe21-4cee-948b-8ec1c2f238f4 tempest-CreateVolumesFromImageTest-1272102553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-3cfb2684-fafa-400a-aa91-0b17c98955a2" returned: 0 in 0.377s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d6ccb6cb-fe21-4cee-948b-8ec1c2f238f4 tempest-CreateVolumesFromImageTest-1272102553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-3cfb2684-fafa-400a-aa91-0b17c98955a2 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:51 devstack sudo[101601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-3cfb2684-fafa-400a-aa91-0b17c98955a2 Sep 03 11:25:51 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:51 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d6ccb6cb-fe21-4cee-948b-8ec1c2f238f4 tempest-CreateVolumesFromImageTest-1272102553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-3cfb2684-fafa-400a-aa91-0b17c98955a2" returned: 0 in 0.258s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:51 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d6ccb6cb-fe21-4cee-948b-8ec1c2f238f4 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "cinder-quobyte-3cfb2684-fafa-400a-aa91-0b17c98955a2" released by "delete_volume" :: held 0.680s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:25:51 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-d6ccb6cb-fe21-4cee-948b-8ec1c2f238f4 tempest-CreateVolumesFromImageTest-1272102553 None] Created reservations ['246e402c-a487-4e04-afae-0b5759b07c38', '3c377a9f-4de0-4bc8-a981-69fa7784abc7', 'e7ae7e01-3387-430b-a3df-e2dad2e40bd7', 'f7801393-da89-4353-bd40-5887dd5871f9'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:25:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d6ccb6cb-fe21-4cee-948b-8ec1c2f238f4 tempest-CreateVolumesFromImageTest-1272102553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d6ccb6cb-fe21-4cee-948b-8ec1c2f238f4 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:51 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d6ccb6cb-fe21-4cee-948b-8ec1c2f238f4 tempest-CreateVolumesFromImageTest-1272102553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:25:51 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d6ccb6cb-fe21-4cee-948b-8ec1c2f238f4 tempest-CreateVolumesFromImageTest-1272102553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:25:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d6ccb6cb-fe21-4cee-948b-8ec1c2f238f4 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d6ccb6cb-fe21-4cee-948b-8ec1c2f238f4 tempest-CreateVolumesFromImageTest-1272102553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:51 devstack sudo[101604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:25:51 devstack sudo[101604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:51 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1b81aac4-a74b-4aaa-ba42-68b19e662ab4 tempest-VolumesListAdminTestJSON-815140747 None] Acquiring lock "cinder-5c88562b-0fbb-4ab5-9462-f6a91df927aa-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:25:51 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1b81aac4-a74b-4aaa-ba42-68b19e662ab4 tempest-VolumesListAdminTestJSON-815140747 None] Lock "cinder-5c88562b-0fbb-4ab5-9462-f6a91df927aa-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:25:51 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1b81aac4-a74b-4aaa-ba42-68b19e662ab4 tempest-VolumesListAdminTestJSON-815140747 None] Acquiring lock "cinder-quobyte-5c88562b-0fbb-4ab5-9462-f6a91df927aa" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:25:52 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1b81aac4-a74b-4aaa-ba42-68b19e662ab4 tempest-VolumesListAdminTestJSON-815140747 None] Lock "cinder-quobyte-5c88562b-0fbb-4ab5-9462-f6a91df927aa" acquired by "delete_volume" :: waited 0.016s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:25:52 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[678887c7-4328-46b1-9b2c-e635626f86f2]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:25:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1b81aac4-a74b-4aaa-ba42-68b19e662ab4 tempest-VolumesListAdminTestJSON-815140747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5c88562b-0fbb-4ab5-9462-f6a91df927aa {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:52 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ea17b3d3-f7e8-4871-9e61-713bc2a47385 tempest-VolumesListAdminTestJSON-1750968847 None] Acquiring lock "cinder-e724440c-1bb8-4ee6-8fab-ccfbfddfd233-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:25:52 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ea17b3d3-f7e8-4871-9e61-713bc2a47385 tempest-VolumesListAdminTestJSON-1750968847 None] Lock "cinder-e724440c-1bb8-4ee6-8fab-ccfbfddfd233-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:25:52 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ea17b3d3-f7e8-4871-9e61-713bc2a47385 tempest-VolumesListAdminTestJSON-1750968847 None] Acquiring lock "cinder-quobyte-e724440c-1bb8-4ee6-8fab-ccfbfddfd233" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:25:52 devstack sudo[101604]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d6ccb6cb-fe21-4cee-948b-8ec1c2f238f4 tempest-CreateVolumesFromImageTest-1272102553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.371s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:52 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-d6ccb6cb-fe21-4cee-948b-8ec1c2f238f4 tempest-CreateVolumesFromImageTest-1272102553 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:25:52 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ea17b3d3-f7e8-4871-9e61-713bc2a47385 tempest-VolumesListAdminTestJSON-1750968847 None] Lock "cinder-quobyte-e724440c-1bb8-4ee6-8fab-ccfbfddfd233" acquired by "delete_volume" :: waited 0.036s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:25:52 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-d6ccb6cb-fe21-4cee-948b-8ec1c2f238f4 tempest-CreateVolumesFromImageTest-1272102553 None] Deleted volume successfully. Sep 03 11:25:52 devstack sudo[101606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5c88562b-0fbb-4ab5-9462-f6a91df927aa Sep 03 11:25:52 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:52 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07e778d-98ce-47f7-9ef3-f2e8470e8ded]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:25:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ea17b3d3-f7e8-4871-9e61-713bc2a47385 tempest-VolumesListAdminTestJSON-1750968847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e724440c-1bb8-4ee6-8fab-ccfbfddfd233 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:52 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d6ccb6cb-fe21-4cee-948b-8ec1c2f238f4 tempest-CreateVolumesFromImageTest-1272102553 None] Lock "cinder-3cfb2684-fafa-400a-aa91-0b17c98955a2-delete_volume" released by "delete_volume" :: held 1.334s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:25:52 devstack sudo[101609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e724440c-1bb8-4ee6-8fab-ccfbfddfd233 Sep 03 11:25:52 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:52 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1b81aac4-a74b-4aaa-ba42-68b19e662ab4 tempest-VolumesListAdminTestJSON-815140747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5c88562b-0fbb-4ab5-9462-f6a91df927aa" returned: 0 in 0.604s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1b81aac4-a74b-4aaa-ba42-68b19e662ab4 tempest-VolumesListAdminTestJSON-815140747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5c88562b-0fbb-4ab5-9462-f6a91df927aa {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:52 devstack sudo[101615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5c88562b-0fbb-4ab5-9462-f6a91df927aa Sep 03 11:25:52 devstack sudo[101615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:52 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ea17b3d3-f7e8-4871-9e61-713bc2a47385 tempest-VolumesListAdminTestJSON-1750968847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e724440c-1bb8-4ee6-8fab-ccfbfddfd233" returned: 0 in 0.467s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ea17b3d3-f7e8-4871-9e61-713bc2a47385 tempest-VolumesListAdminTestJSON-1750968847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e724440c-1bb8-4ee6-8fab-ccfbfddfd233 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:52 devstack sudo[101621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e724440c-1bb8-4ee6-8fab-ccfbfddfd233 Sep 03 11:25:52 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:52 devstack sudo[101615]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1b81aac4-a74b-4aaa-ba42-68b19e662ab4 tempest-VolumesListAdminTestJSON-815140747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5c88562b-0fbb-4ab5-9462-f6a91df927aa" returned: 0 in 0.304s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:52 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1b81aac4-a74b-4aaa-ba42-68b19e662ab4 tempest-VolumesListAdminTestJSON-815140747 None] Lock "cinder-quobyte-5c88562b-0fbb-4ab5-9462-f6a91df927aa" released by "delete_volume" :: held 0.969s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:25:53 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-1b81aac4-a74b-4aaa-ba42-68b19e662ab4 tempest-VolumesListAdminTestJSON-815140747 None] Created reservations ['d2835c3e-8fe2-449a-8514-4b58c67c4f59', '7c50db86-33fb-42ea-ad4c-196db17a5ca7', 'd508525e-f021-4707-a3ce-4defa50b5115', '23258795-a4ba-42fd-acba-e6ac342863f9'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:25:53 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ea17b3d3-f7e8-4871-9e61-713bc2a47385 tempest-VolumesListAdminTestJSON-1750968847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e724440c-1bb8-4ee6-8fab-ccfbfddfd233" returned: 0 in 0.337s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:53 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ea17b3d3-f7e8-4871-9e61-713bc2a47385 tempest-VolumesListAdminTestJSON-1750968847 None] Lock "cinder-quobyte-e724440c-1bb8-4ee6-8fab-ccfbfddfd233" released by "delete_volume" :: held 0.878s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:25:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1b81aac4-a74b-4aaa-ba42-68b19e662ab4 tempest-VolumesListAdminTestJSON-815140747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1b81aac4-a74b-4aaa-ba42-68b19e662ab4 tempest-VolumesListAdminTestJSON-815140747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:53 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1b81aac4-a74b-4aaa-ba42-68b19e662ab4 tempest-VolumesListAdminTestJSON-815140747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:25:53 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1b81aac4-a74b-4aaa-ba42-68b19e662ab4 tempest-VolumesListAdminTestJSON-815140747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:25:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1b81aac4-a74b-4aaa-ba42-68b19e662ab4 tempest-VolumesListAdminTestJSON-815140747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1b81aac4-a74b-4aaa-ba42-68b19e662ab4 tempest-VolumesListAdminTestJSON-815140747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:53 devstack sudo[101625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:25:53 devstack sudo[101625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:53 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-ea17b3d3-f7e8-4871-9e61-713bc2a47385 tempest-VolumesListAdminTestJSON-1750968847 None] Created reservations ['0095add8-ef93-4e0c-b19c-0b9d6dff1961', '695c6c00-e4b3-4806-b158-943f791407b7', '91046417-0a7d-42a7-8787-b910bc1eac8f', '0225ab9f-209e-4cf4-b7da-ab54a8530e30'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:25:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ea17b3d3-f7e8-4871-9e61-713bc2a47385 tempest-VolumesListAdminTestJSON-1750968847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ea17b3d3-f7e8-4871-9e61-713bc2a47385 tempest-VolumesListAdminTestJSON-1750968847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:53 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ea17b3d3-f7e8-4871-9e61-713bc2a47385 tempest-VolumesListAdminTestJSON-1750968847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:25:53 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ea17b3d3-f7e8-4871-9e61-713bc2a47385 tempest-VolumesListAdminTestJSON-1750968847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:25:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ea17b3d3-f7e8-4871-9e61-713bc2a47385 tempest-VolumesListAdminTestJSON-1750968847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ea17b3d3-f7e8-4871-9e61-713bc2a47385 tempest-VolumesListAdminTestJSON-1750968847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:53 devstack sudo[101627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:25:53 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:53 devstack sudo[101625]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:53 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f792a068-058e-47fe-bc7b-528eb337fd33 tempest-VolumesListAdminTestJSON-1750968847 None] Acquiring lock "cinder-614900a6-42b5-4765-8953-8ba9f7865b2e-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:25:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1b81aac4-a74b-4aaa-ba42-68b19e662ab4 tempest-VolumesListAdminTestJSON-815140747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.432s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:53 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-1b81aac4-a74b-4aaa-ba42-68b19e662ab4 tempest-VolumesListAdminTestJSON-815140747 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:25:53 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-1b81aac4-a74b-4aaa-ba42-68b19e662ab4 tempest-VolumesListAdminTestJSON-815140747 None] Deleted volume successfully. Sep 03 11:25:53 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f792a068-058e-47fe-bc7b-528eb337fd33 tempest-VolumesListAdminTestJSON-1750968847 None] Lock "cinder-614900a6-42b5-4765-8953-8ba9f7865b2e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:25:53 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1b81aac4-a74b-4aaa-ba42-68b19e662ab4 tempest-VolumesListAdminTestJSON-815140747 None] Lock "cinder-5c88562b-0fbb-4ab5-9462-f6a91df927aa-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:25:53 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f792a068-058e-47fe-bc7b-528eb337fd33 tempest-VolumesListAdminTestJSON-1750968847 None] Acquiring lock "cinder-quobyte-614900a6-42b5-4765-8953-8ba9f7865b2e" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:25:53 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f792a068-058e-47fe-bc7b-528eb337fd33 tempest-VolumesListAdminTestJSON-1750968847 None] Lock "cinder-quobyte-614900a6-42b5-4765-8953-8ba9f7865b2e" acquired by "delete_volume" :: waited 0.029s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:25:53 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea05035-d5ee-4ba4-b165-35a6531037c5]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:25:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f792a068-058e-47fe-bc7b-528eb337fd33 tempest-VolumesListAdminTestJSON-1750968847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-614900a6-42b5-4765-8953-8ba9f7865b2e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:53 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ea17b3d3-f7e8-4871-9e61-713bc2a47385 tempest-VolumesListAdminTestJSON-1750968847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.435s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:53 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-ea17b3d3-f7e8-4871-9e61-713bc2a47385 tempest-VolumesListAdminTestJSON-1750968847 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:25:53 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-ea17b3d3-f7e8-4871-9e61-713bc2a47385 tempest-VolumesListAdminTestJSON-1750968847 None] Deleted volume successfully. Sep 03 11:25:53 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ea17b3d3-f7e8-4871-9e61-713bc2a47385 tempest-VolumesListAdminTestJSON-1750968847 None] Lock "cinder-e724440c-1bb8-4ee6-8fab-ccfbfddfd233-delete_volume" released by "delete_volume" :: held 1.639s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:25:53 devstack sudo[101631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-614900a6-42b5-4765-8953-8ba9f7865b2e Sep 03 11:25:53 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:54 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f792a068-058e-47fe-bc7b-528eb337fd33 tempest-VolumesListAdminTestJSON-1750968847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-614900a6-42b5-4765-8953-8ba9f7865b2e" returned: 0 in 0.485s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f792a068-058e-47fe-bc7b-528eb337fd33 tempest-VolumesListAdminTestJSON-1750968847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-614900a6-42b5-4765-8953-8ba9f7865b2e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:54 devstack sudo[101636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-614900a6-42b5-4765-8953-8ba9f7865b2e Sep 03 11:25:54 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:54 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f792a068-058e-47fe-bc7b-528eb337fd33 tempest-VolumesListAdminTestJSON-1750968847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-614900a6-42b5-4765-8953-8ba9f7865b2e" returned: 0 in 0.290s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:54 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f792a068-058e-47fe-bc7b-528eb337fd33 tempest-VolumesListAdminTestJSON-1750968847 None] Lock "cinder-quobyte-614900a6-42b5-4765-8953-8ba9f7865b2e" released by "delete_volume" :: held 0.829s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:25:54 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-f792a068-058e-47fe-bc7b-528eb337fd33 tempest-VolumesListAdminTestJSON-1750968847 None] Created reservations ['296b6bf3-e9e8-4690-a591-5119fb624fb2', 'ec4fb5de-3a64-4d8c-ae5b-d2296dca7137', '9d32e143-66f7-4a0c-a9f4-381b916fafde', '99199d23-839a-4804-816e-34d4595bd97d'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:25:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f792a068-058e-47fe-bc7b-528eb337fd33 tempest-VolumesListAdminTestJSON-1750968847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f792a068-058e-47fe-bc7b-528eb337fd33 tempest-VolumesListAdminTestJSON-1750968847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:54 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f792a068-058e-47fe-bc7b-528eb337fd33 tempest-VolumesListAdminTestJSON-1750968847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:25:54 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f792a068-058e-47fe-bc7b-528eb337fd33 tempest-VolumesListAdminTestJSON-1750968847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:25:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f792a068-058e-47fe-bc7b-528eb337fd33 tempest-VolumesListAdminTestJSON-1750968847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f792a068-058e-47fe-bc7b-528eb337fd33 tempest-VolumesListAdminTestJSON-1750968847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:54 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:25:54 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:54 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-bc3ae857-4716-45da-acb4-bead45ea47d7 tempest-VolumesListAdminTestJSON-1750968847 None] Acquiring lock "cinder-26782e95-8739-4aac-8c8e-10c7153cdf5c-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:25:54 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-bc3ae857-4716-45da-acb4-bead45ea47d7 tempest-VolumesListAdminTestJSON-1750968847 None] Lock "cinder-26782e95-8739-4aac-8c8e-10c7153cdf5c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:25:55 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-bc3ae857-4716-45da-acb4-bead45ea47d7 tempest-VolumesListAdminTestJSON-1750968847 None] Acquiring lock "cinder-quobyte-26782e95-8739-4aac-8c8e-10c7153cdf5c" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:25:55 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-bc3ae857-4716-45da-acb4-bead45ea47d7 tempest-VolumesListAdminTestJSON-1750968847 None] Lock "cinder-quobyte-26782e95-8739-4aac-8c8e-10c7153cdf5c" acquired by "delete_volume" :: waited 0.025s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:25:55 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f792a068-058e-47fe-bc7b-528eb337fd33 tempest-VolumesListAdminTestJSON-1750968847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.385s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:55 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-f792a068-058e-47fe-bc7b-528eb337fd33 tempest-VolumesListAdminTestJSON-1750968847 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:25:55 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-f792a068-058e-47fe-bc7b-528eb337fd33 tempest-VolumesListAdminTestJSON-1750968847 None] Deleted volume successfully. Sep 03 11:25:55 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d790cb9-ee3f-4f2f-9625-0fa54e4993e3]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:25:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bc3ae857-4716-45da-acb4-bead45ea47d7 tempest-VolumesListAdminTestJSON-1750968847 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-26782e95-8739-4aac-8c8e-10c7153cdf5c {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:55 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f792a068-058e-47fe-bc7b-528eb337fd33 tempest-VolumesListAdminTestJSON-1750968847 None] Lock "cinder-614900a6-42b5-4765-8953-8ba9f7865b2e-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:25:55 devstack sudo[101642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-26782e95-8739-4aac-8c8e-10c7153cdf5c Sep 03 11:25:55 devstack sudo[101642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:55 devstack sudo[101642]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bc3ae857-4716-45da-acb4-bead45ea47d7 tempest-VolumesListAdminTestJSON-1750968847 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-26782e95-8739-4aac-8c8e-10c7153cdf5c" returned: 0 in 0.388s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bc3ae857-4716-45da-acb4-bead45ea47d7 tempest-VolumesListAdminTestJSON-1750968847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-26782e95-8739-4aac-8c8e-10c7153cdf5c {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:55 devstack sudo[101647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-26782e95-8739-4aac-8c8e-10c7153cdf5c Sep 03 11:25:55 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:55 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bc3ae857-4716-45da-acb4-bead45ea47d7 tempest-VolumesListAdminTestJSON-1750968847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-26782e95-8739-4aac-8c8e-10c7153cdf5c" returned: 0 in 0.299s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:55 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-bc3ae857-4716-45da-acb4-bead45ea47d7 tempest-VolumesListAdminTestJSON-1750968847 None] Lock "cinder-quobyte-26782e95-8739-4aac-8c8e-10c7153cdf5c" released by "delete_volume" :: held 0.751s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:25:55 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-bc3ae857-4716-45da-acb4-bead45ea47d7 tempest-VolumesListAdminTestJSON-1750968847 None] Created reservations ['68e27891-b799-451b-9f4b-a0e11f42d95b', '5ff79fe9-8b21-4463-90be-96f5198aa0e0', '1e6fc43d-0e7a-45c9-b9a6-46860921eb90', '75edafaf-7322-4862-b29a-a05ae8386a62'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:25:55 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f2e2ced-c39b-47fb-b8f4-43dd7fc6daba tempest-VolumeDependencyTests-2042862046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:25:55 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0f2e2ced-c39b-47fb-b8f4-43dd7fc6daba tempest-VolumeDependencyTests-2042862046 None] Flow 'volume_create_manager' (653477f1-d002-4f9f-a08a-1ff909192477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:25:55 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0f2e2ced-c39b-47fb-b8f4-43dd7fc6daba tempest-VolumeDependencyTests-2042862046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0afc5f54-784a-48e6-9c93-2715e39d6cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:55 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0f2e2ced-c39b-47fb-b8f4-43dd7fc6daba tempest-VolumeDependencyTests-2042862046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0afc5f54-784a-48e6-9c93-2715e39d6cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-805735662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb3f04d134e343099459a04cb770793f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:25:56Z,use_quota=True,user_id='bde416b1f80a4c399ad1161c49735463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:55 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0f2e2ced-c39b-47fb-b8f4-43dd7fc6daba tempest-VolumeDependencyTests-2042862046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b611f5-3b89-4735-8f70-24b6afe6467e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:55 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0f2e2ced-c39b-47fb-b8f4-43dd7fc6daba tempest-VolumeDependencyTests-2042862046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6b611f5-3b89-4735-8f70-24b6afe6467e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:55 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0f2e2ced-c39b-47fb-b8f4-43dd7fc6daba tempest-VolumeDependencyTests-2042862046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cee60f23-3d9e-4002-93c7-ed54178ca9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:56 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0f2e2ced-c39b-47fb-b8f4-43dd7fc6daba tempest-VolumeDependencyTests-2042862046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cee60f23-3d9e-4002-93c7-ed54178ca9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb', 'volume_name': 'volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:56 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0f2e2ced-c39b-47fb-b8f4-43dd7fc6daba tempest-VolumeDependencyTests-2042862046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e10befdd-e883-4526-bd10-cef607501888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:56 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0f2e2ced-c39b-47fb-b8f4-43dd7fc6daba tempest-VolumeDependencyTests-2042862046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e10befdd-e883-4526-bd10-cef607501888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:56 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0f2e2ced-c39b-47fb-b8f4-43dd7fc6daba tempest-VolumeDependencyTests-2042862046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6535c8a-8863-46db-a01f-28b7d35ef43d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:56 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-0f2e2ced-c39b-47fb-b8f4-43dd7fc6daba tempest-VolumeDependencyTests-2042862046 None] Volume a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb', 'volume_size': 1} Sep 03 11:25:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0f2e2ced-c39b-47fb-b8f4-43dd7fc6daba tempest-VolumeDependencyTests-2042862046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0f2e2ced-c39b-47fb-b8f4-43dd7fc6daba tempest-VolumeDependencyTests-2042862046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0f2e2ced-c39b-47fb-b8f4-43dd7fc6daba tempest-VolumeDependencyTests-2042862046 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-805735662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb3f04d134e343099459a04cb770793f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:25:56Z,use_quota=True,user_id='bde416b1f80a4c399ad1161c49735463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:25:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-0f2e2ced-c39b-47fb-b8f4-43dd7fc6daba tempest-VolumeDependencyTests-2042862046 None] Creating volume a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:25:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0f2e2ced-c39b-47fb-b8f4-43dd7fc6daba tempest-VolumeDependencyTests-2042862046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0f2e2ced-c39b-47fb-b8f4-43dd7fc6daba tempest-VolumeDependencyTests-2042862046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0f2e2ced-c39b-47fb-b8f4-43dd7fc6daba tempest-VolumeDependencyTests-2042862046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:25:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0f2e2ced-c39b-47fb-b8f4-43dd7fc6daba tempest-VolumeDependencyTests-2042862046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:25:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0f2e2ced-c39b-47fb-b8f4-43dd7fc6daba tempest-VolumeDependencyTests-2042862046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0f2e2ced-c39b-47fb-b8f4-43dd7fc6daba tempest-VolumeDependencyTests-2042862046 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:25:56 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-0f2e2ced-c39b-47fb-b8f4-43dd7fc6daba tempest-VolumeDependencyTests-2042862046 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:25:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0f2e2ced-c39b-47fb-b8f4-43dd7fc6daba tempest-VolumeDependencyTests-2042862046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bc3ae857-4716-45da-acb4-bead45ea47d7 tempest-VolumesListAdminTestJSON-1750968847 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bc3ae857-4716-45da-acb4-bead45ea47d7 tempest-VolumesListAdminTestJSON-1750968847 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-bc3ae857-4716-45da-acb4-bead45ea47d7 tempest-VolumesListAdminTestJSON-1750968847 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:25:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-bc3ae857-4716-45da-acb4-bead45ea47d7 tempest-VolumesListAdminTestJSON-1750968847 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:25:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bc3ae857-4716-45da-acb4-bead45ea47d7 tempest-VolumesListAdminTestJSON-1750968847 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bc3ae857-4716-45da-acb4-bead45ea47d7 tempest-VolumesListAdminTestJSON-1750968847 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:56 devstack sudo[101650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb 1073741824 Sep 03 11:25:56 devstack sudo[101650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:56 devstack sudo[101652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:25:56 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:56 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bc3ae857-4716-45da-acb4-bead45ea47d7 tempest-VolumesListAdminTestJSON-1750968847 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.317s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:56 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-bc3ae857-4716-45da-acb4-bead45ea47d7 tempest-VolumesListAdminTestJSON-1750968847 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:25:56 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-bc3ae857-4716-45da-acb4-bead45ea47d7 tempest-VolumesListAdminTestJSON-1750968847 None] Deleted volume successfully. Sep 03 11:25:56 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-bc3ae857-4716-45da-acb4-bead45ea47d7 tempest-VolumesListAdminTestJSON-1750968847 None] Lock "cinder-26782e95-8739-4aac-8c8e-10c7153cdf5c-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:25:56 devstack sudo[101650]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0f2e2ced-c39b-47fb-b8f4-43dd7fc6daba tempest-VolumeDependencyTests-2042862046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb 1073741824" returned: 0 in 0.543s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0f2e2ced-c39b-47fb-b8f4-43dd7fc6daba tempest-VolumeDependencyTests-2042862046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:56 devstack sudo[101659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb Sep 03 11:25:56 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:56 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0f2e2ced-c39b-47fb-b8f4-43dd7fc6daba tempest-VolumeDependencyTests-2042862046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb" returned: 0 in 0.306s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0f2e2ced-c39b-47fb-b8f4-43dd7fc6daba tempest-VolumeDependencyTests-2042862046 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:25:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0f2e2ced-c39b-47fb-b8f4-43dd7fc6daba tempest-VolumeDependencyTests-2042862046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:25:56 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0f2e2ced-c39b-47fb-b8f4-43dd7fc6daba tempest-VolumeDependencyTests-2042862046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6535c8a-8863-46db-a01f-28b7d35ef43d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:56 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0f2e2ced-c39b-47fb-b8f4-43dd7fc6daba tempest-VolumeDependencyTests-2042862046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b959d332-5251-4af2-ada8-47f7a58df337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:25:56 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-0f2e2ced-c39b-47fb-b8f4-43dd7fc6daba tempest-VolumeDependencyTests-2042862046 None] Volume volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb (a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb): created successfully Sep 03 11:25:56 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0f2e2ced-c39b-47fb-b8f4-43dd7fc6daba tempest-VolumeDependencyTests-2042862046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b959d332-5251-4af2-ada8-47f7a58df337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:25:56 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0f2e2ced-c39b-47fb-b8f4-43dd7fc6daba tempest-VolumeDependencyTests-2042862046 None] Flow 'volume_create_manager' (653477f1-d002-4f9f-a08a-1ff909192477) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:25:56 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-0f2e2ced-c39b-47fb-b8f4-43dd7fc6daba tempest-VolumeDependencyTests-2042862046 None] Created volume successfully. Sep 03 11:25:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-456e6b26-1479-4bee-96d6-91ee1962cba8 tempest-VolumeDependencyTests-2042862046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:25:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-456e6b26-1479-4bee-96d6-91ee1962cba8 tempest-VolumeDependencyTests-2042862046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:25:58 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-456e6b26-1479-4bee-96d6-91ee1962cba8 tempest-VolumeDependencyTests-2042862046 None] Creating offline snapshot 764b38b7-8708-496f-99bc-8dcbdf349b55 of volume a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:25:58 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f81815-edb7-4888-9262-9612782e1db0]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:25:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-456e6b26-1479-4bee-96d6-91ee1962cba8 tempest-VolumeDependencyTests-2042862046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:58 devstack sudo[101663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb Sep 03 11:25:58 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:58 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-456e6b26-1479-4bee-96d6-91ee1962cba8 tempest-VolumeDependencyTests-2042862046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb" returned: 0 in 0.431s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-456e6b26-1479-4bee-96d6-91ee1962cba8 tempest-VolumeDependencyTests-2042862046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb.764b38b7-8708-496f-99bc-8dcbdf349b55 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:58 devstack sudo[101669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb.764b38b7-8708-496f-99bc-8dcbdf349b55 1G Sep 03 11:25:58 devstack sudo[101669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:59 devstack sudo[101669]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-456e6b26-1479-4bee-96d6-91ee1962cba8 tempest-VolumeDependencyTests-2042862046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb.764b38b7-8708-496f-99bc-8dcbdf349b55 1G" returned: 0 in 0.481s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-456e6b26-1479-4bee-96d6-91ee1962cba8 tempest-VolumeDependencyTests-2042862046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb.764b38b7-8708-496f-99bc-8dcbdf349b55 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:59 devstack sudo[101675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb.764b38b7-8708-496f-99bc-8dcbdf349b55 Sep 03 11:25:59 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:59 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-456e6b26-1479-4bee-96d6-91ee1962cba8 tempest-VolumeDependencyTests-2042862046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb.764b38b7-8708-496f-99bc-8dcbdf349b55" returned: 0 in 0.302s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:59 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-456e6b26-1479-4bee-96d6-91ee1962cba8 tempest-VolumeDependencyTests-2042862046 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb.764b38b7-8708-496f-99bc-8dcbdf349b55 is being set with open permissions: ugo+rw Sep 03 11:25:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-456e6b26-1479-4bee-96d6-91ee1962cba8 tempest-VolumeDependencyTests-2042862046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb.764b38b7-8708-496f-99bc-8dcbdf349b55 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:59 devstack sudo[101680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb.764b38b7-8708-496f-99bc-8dcbdf349b55 Sep 03 11:25:59 devstack sudo[101680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:25:59 devstack sudo[101680]: pam_unix(sudo:session): session closed for user root Sep 03 11:25:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-456e6b26-1479-4bee-96d6-91ee1962cba8 tempest-VolumeDependencyTests-2042862046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb.764b38b7-8708-496f-99bc-8dcbdf349b55" returned: 0 in 0.245s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:25:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-456e6b26-1479-4bee-96d6-91ee1962cba8 tempest-VolumeDependencyTests-2042862046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:25:59 devstack sudo[101683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb.info Sep 03 11:25:59 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:00 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-456e6b26-1479-4bee-96d6-91ee1962cba8 tempest-VolumeDependencyTests-2042862046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb.info" returned: 0 in 0.254s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:00 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-456e6b26-1479-4bee-96d6-91ee1962cba8 tempest-VolumeDependencyTests-2042862046 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb.info is being set with open permissions: ugo+rw Sep 03 11:26:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-456e6b26-1479-4bee-96d6-91ee1962cba8 tempest-VolumeDependencyTests-2042862046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:00 devstack sudo[101686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb.info Sep 03 11:26:00 devstack sudo[101686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:00 devstack sudo[101686]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-456e6b26-1479-4bee-96d6-91ee1962cba8 tempest-VolumeDependencyTests-2042862046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb.info" returned: 0 in 0.243s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-456e6b26-1479-4bee-96d6-91ee1962cba8 tempest-VolumeDependencyTests-2042862046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.057s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:26:00 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-456e6b26-1479-4bee-96d6-91ee1962cba8 tempest-VolumeDependencyTests-2042862046 None] Create snapshot completed successfully Sep 03 11:26:01 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:26:01 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Flow 'volume_create_manager' (d39f5a90-036c-4207-a2df-602e8882b182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:26:01 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33822e2e-4aeb-4755-9d6d-482419b5730a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:01 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33822e2e-4aeb-4755-9d6d-482419b5730a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:26:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1113310085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54b4cdfd-2a2c-472b-ac06-a250af399b1e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb3f04d134e343099459a04cb770793f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=764b38b7-8708-496f-99bc-8dcbdf349b55,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:26:02Z,use_quota=True,user_id='bde416b1f80a4c399ad1161c49735463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:01 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc45e05-3cef-4b6f-beed-db2130f5c510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:01 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bc45e05-3cef-4b6f-beed-db2130f5c510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:01 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a803b5e-81ae-4ba1-8258-9f104e4afedb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:02 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a803b5e-81ae-4ba1-8258-9f104e4afedb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '54b4cdfd-2a2c-472b-ac06-a250af399b1e', 'volume_name': 'volume-54b4cdfd-2a2c-472b-ac06-a250af399b1e', 'volume_size': 1, 'snapshot_id': '764b38b7-8708-496f-99bc-8dcbdf349b55'}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:02 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f40c6d0-cbed-4be7-8268-98e46640dcb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:02 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f40c6d0-cbed-4be7-8268-98e46640dcb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:02 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b1a9a78-4f86-4362-bebb-e1f79bc817bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:02 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Volume 54b4cdfd-2a2c-472b-ac06-a250af399b1e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-54b4cdfd-2a2c-472b-ac06-a250af399b1e', 'volume_size': 1, 'snapshot_id': '764b38b7-8708-496f-99bc-8dcbdf349b55'} Sep 03 11:26:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:26:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:26:02 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Acquiring lock "cinder-quobyte-764b38b7-8708-496f-99bc-8dcbdf349b55-54b4cdfd-2a2c-472b-ac06-a250af399b1e" by "_create_volume_from_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:26:02 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Lock "cinder-quobyte-764b38b7-8708-496f-99bc-8dcbdf349b55-54b4cdfd-2a2c-472b-ac06-a250af399b1e" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:26:02 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Creating volume 54b4cdfd-2a2c-472b-ac06-a250af399b1e from snapshot 764b38b7-8708-496f-99bc-8dcbdf349b55 {{(pid=87038) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 11:26:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:26:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:26:02 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:26:02 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:26:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:26:02 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:26:02 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Acquiring lock "cinder-quobyte-54b4cdfd-2a2c-472b-ac06-a250af399b1e" by "_copy_volume_from_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:26:02 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Lock "cinder-quobyte-54b4cdfd-2a2c-472b-ac06-a250af399b1e" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:26:02 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] snapshot: 764b38b7-8708-496f-99bc-8dcbdf349b55, volume: 54b4cdfd-2a2c-472b-ac06-a250af399b1e, {{(pid=87038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 11:26:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:26:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:26:02 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:26:02 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:26:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:26:02 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bbfeed-1107-4b77-b33d-af5289fff959]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:26:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb.764b38b7-8708-496f-99bc-8dcbdf349b55 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:02 devstack sudo[101689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb.764b38b7-8708-496f-99bc-8dcbdf349b55 Sep 03 11:26:02 devstack sudo[101689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:02 devstack sudo[101689]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb.764b38b7-8708-496f-99bc-8dcbdf349b55" returned: 0 in 0.380s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:02 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:26:02 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4b15e1-65ef-472a-a366-cc6791042c67]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:26:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:02 devstack sudo[101694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb Sep 03 11:26:02 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:02 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb" returned: 0 in 0.416s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:02 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb {{(pid=87038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 11:26:02 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Creating direct copy from snapshot {{(pid=87038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 11:26:02 devstack cinder-volume[87038]: DEBUG cinder.utils [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Path /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-54b4cdfd-2a2c-472b-ac06-a250af399b1e not found in is_blk_device check {{(pid=87038) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 11:26:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-54b4cdfd-2a2c-472b-ac06-a250af399b1e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:02 devstack sudo[101700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-54b4cdfd-2a2c-472b-ac06-a250af399b1e Sep 03 11:26:02 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:08 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-54b4cdfd-2a2c-472b-ac06-a250af399b1e" returned: 0 in 5.181s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:08 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Image conversion details: src /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb, size 1024.00 MB, duration 5.18 sec, destination /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-54b4cdfd-2a2c-472b-ac06-a250af399b1e {{(pid=87038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:26:08 devstack cinder-volume[87038]: INFO cinder.image.image_utils [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Converted 1024.00 MB image at 197.58 MB/s Sep 03 11:26:08 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-54b4cdfd-2a2c-472b-ac06-a250af399b1e is being set with open permissions: ugo+rw Sep 03 11:26:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-54b4cdfd-2a2c-472b-ac06-a250af399b1e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:08 devstack sudo[101715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-54b4cdfd-2a2c-472b-ac06-a250af399b1e Sep 03 11:26:08 devstack sudo[101715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:08 devstack sudo[101715]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-54b4cdfd-2a2c-472b-ac06-a250af399b1e" returned: 0 in 0.241s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Lock "cinder-quobyte-54b4cdfd-2a2c-472b-ac06-a250af399b1e" released by "_copy_volume_from_snapshot" :: held 6.309s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:26:08 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:INSERT=32,cinder:UPDATE=146,cinder:SELECT=112,cinder:DELETE=6 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:26:08 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=119,cinder:INSERT=38,cinder:UPDATE=158,cinder:DELETE=20 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:26:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Lock "cinder-quobyte-764b38b7-8708-496f-99bc-8dcbdf349b55-54b4cdfd-2a2c-472b-ac06-a250af399b1e" released by "_create_volume_from_snapshot" :: held 6.388s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:26:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.403s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:26:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b1a9a78-4f86-4362-bebb-e1f79bc817bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54b4cdfd-2a2c-472b-ac06-a250af399b1e', 'volume_size': 1, 'snapshot_id': '764b38b7-8708-496f-99bc-8dcbdf349b55'}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59ea35c6-d732-46ec-bed1-27d8b8aba3dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:08 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Volume volume-54b4cdfd-2a2c-472b-ac06-a250af399b1e (54b4cdfd-2a2c-472b-ac06-a250af399b1e): created successfully Sep 03 11:26:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59ea35c6-d732-46ec-bed1-27d8b8aba3dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Flow 'volume_create_manager' (d39f5a90-036c-4207-a2df-602e8882b182) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:26:08 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-f1a78832-818d-4b1e-bbde-67d683dca6c8 tempest-VolumeDependencyTests-2042862046 None] Created volume successfully. Sep 03 11:26:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1db571f5-1e2d-40b8-af6f-ab059d460319 tempest-VolumeDependencyTests-2042862046 None] Acquiring lock "cinder-764b38b7-8708-496f-99bc-8dcbdf349b55-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:26:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1db571f5-1e2d-40b8-af6f-ab059d460319 tempest-VolumeDependencyTests-2042862046 None] Lock "cinder-764b38b7-8708-496f-99bc-8dcbdf349b55-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:26:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1db571f5-1e2d-40b8-af6f-ab059d460319 tempest-VolumeDependencyTests-2042862046 None] Acquiring lock "cinder-quobyte-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:26:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1db571f5-1e2d-40b8-af6f-ab059d460319 tempest-VolumeDependencyTests-2042862046 None] Lock "cinder-quobyte-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:26:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1db571f5-1e2d-40b8-af6f-ab059d460319 tempest-VolumeDependencyTests-2042862046 None] Acquiring lock "cinder-quobyte-764b38b7-8708-496f-99bc-8dcbdf349b55" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:26:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1db571f5-1e2d-40b8-af6f-ab059d460319 tempest-VolumeDependencyTests-2042862046 None] Lock "cinder-quobyte-764b38b7-8708-496f-99bc-8dcbdf349b55" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:26:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-1db571f5-1e2d-40b8-af6f-ab059d460319 tempest-VolumeDependencyTests-2042862046 None] Deleting offline snapshot 764b38b7-8708-496f-99bc-8dcbdf349b55 of volume a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:26:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-1db571f5-1e2d-40b8-af6f-ab059d460319 tempest-VolumeDependencyTests-2042862046 None] snapshot_file for this snap is: volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb.764b38b7-8708-496f-99bc-8dcbdf349b55 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:26:08 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ea90817-f042-45bd-8c59-5c7249c07004]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:26:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1db571f5-1e2d-40b8-af6f-ab059d460319 tempest-VolumeDependencyTests-2042862046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb.764b38b7-8708-496f-99bc-8dcbdf349b55 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:08 devstack sudo[101718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb.764b38b7-8708-496f-99bc-8dcbdf349b55 Sep 03 11:26:08 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:08 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-a802232b-3420-4606-aac0-5075d21aa716 tempest-AbsoluteLimitsTests-1386072021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:26:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a802232b-3420-4606-aac0-5075d21aa716 tempest-AbsoluteLimitsTests-1386072021 None] Flow 'volume_create_manager' (21de4bab-2d00-4d09-b331-45bbdaf32666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:26:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a802232b-3420-4606-aac0-5075d21aa716 tempest-AbsoluteLimitsTests-1386072021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4a355a-791a-47b5-a0fe-e84dbecc4562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a802232b-3420-4606-aac0-5075d21aa716 tempest-AbsoluteLimitsTests-1386072021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef4a355a-791a-47b5-a0fe-e84dbecc4562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1017891096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e312c35-c2ff-4586-9a95-193ee29fe534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50d703e5580488badd8908fc4a14831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:26:09Z,use_quota=True,user_id='a33cad1deda9464c993366a61f461b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a802232b-3420-4606-aac0-5075d21aa716 tempest-AbsoluteLimitsTests-1386072021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46850011-d0a6-4918-be5c-0a0fb02bde26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a802232b-3420-4606-aac0-5075d21aa716 tempest-AbsoluteLimitsTests-1386072021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46850011-d0a6-4918-be5c-0a0fb02bde26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a802232b-3420-4606-aac0-5075d21aa716 tempest-AbsoluteLimitsTests-1386072021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f695eab3-4b69-48b8-9385-801dbc327e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a802232b-3420-4606-aac0-5075d21aa716 tempest-AbsoluteLimitsTests-1386072021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f695eab3-4b69-48b8-9385-801dbc327e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e312c35-c2ff-4586-9a95-193ee29fe534', 'volume_name': 'volume-9e312c35-c2ff-4586-9a95-193ee29fe534', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a802232b-3420-4606-aac0-5075d21aa716 tempest-AbsoluteLimitsTests-1386072021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d06e4291-d015-4fbf-be28-d93f5d6e6ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a802232b-3420-4606-aac0-5075d21aa716 tempest-AbsoluteLimitsTests-1386072021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d06e4291-d015-4fbf-be28-d93f5d6e6ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a802232b-3420-4606-aac0-5075d21aa716 tempest-AbsoluteLimitsTests-1386072021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f517bb2-5eed-4a83-8820-c20b0286bec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:09 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-a802232b-3420-4606-aac0-5075d21aa716 tempest-AbsoluteLimitsTests-1386072021 None] Volume 9e312c35-c2ff-4586-9a95-193ee29fe534: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e312c35-c2ff-4586-9a95-193ee29fe534', 'volume_size': 1} Sep 03 11:26:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a802232b-3420-4606-aac0-5075d21aa716 tempest-AbsoluteLimitsTests-1386072021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:26:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a802232b-3420-4606-aac0-5075d21aa716 tempest-AbsoluteLimitsTests-1386072021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:26:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a802232b-3420-4606-aac0-5075d21aa716 tempest-AbsoluteLimitsTests-1386072021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:26:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1017891096',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e312c35-c2ff-4586-9a95-193ee29fe534,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e50d703e5580488badd8908fc4a14831',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:26:09Z,use_quota=True,user_id='a33cad1deda9464c993366a61f461b1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:26:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-a802232b-3420-4606-aac0-5075d21aa716 tempest-AbsoluteLimitsTests-1386072021 None] Creating volume 9e312c35-c2ff-4586-9a95-193ee29fe534 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:26:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a802232b-3420-4606-aac0-5075d21aa716 tempest-AbsoluteLimitsTests-1386072021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:26:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a802232b-3420-4606-aac0-5075d21aa716 tempest-AbsoluteLimitsTests-1386072021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:26:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a802232b-3420-4606-aac0-5075d21aa716 tempest-AbsoluteLimitsTests-1386072021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:26:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a802232b-3420-4606-aac0-5075d21aa716 tempest-AbsoluteLimitsTests-1386072021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:26:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a802232b-3420-4606-aac0-5075d21aa716 tempest-AbsoluteLimitsTests-1386072021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:26:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a802232b-3420-4606-aac0-5075d21aa716 tempest-AbsoluteLimitsTests-1386072021 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:26:09 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-a802232b-3420-4606-aac0-5075d21aa716 tempest-AbsoluteLimitsTests-1386072021 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:26:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a802232b-3420-4606-aac0-5075d21aa716 tempest-AbsoluteLimitsTests-1386072021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9e312c35-c2ff-4586-9a95-193ee29fe534 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:09 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1db571f5-1e2d-40b8-af6f-ab059d460319 tempest-VolumeDependencyTests-2042862046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb.764b38b7-8708-496f-99bc-8dcbdf349b55" returned: 0 in 0.367s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-1db571f5-1e2d-40b8-af6f-ab059d460319 tempest-VolumeDependencyTests-2042862046 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:26:09 devstack sudo[101725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9e312c35-c2ff-4586-9a95-193ee29fe534 1073741824 Sep 03 11:26:09 devstack sudo[101725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:09 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4366de6-fb31-4a6c-a1e9-e2efa2362850]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:26:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1db571f5-1e2d-40b8-af6f-ab059d460319 tempest-VolumeDependencyTests-2042862046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:09 devstack sudo[101729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb Sep 03 11:26:09 devstack sudo[101729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:09 devstack sudo[101725]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a802232b-3420-4606-aac0-5075d21aa716 tempest-AbsoluteLimitsTests-1386072021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9e312c35-c2ff-4586-9a95-193ee29fe534 1073741824" returned: 0 in 0.467s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a802232b-3420-4606-aac0-5075d21aa716 tempest-AbsoluteLimitsTests-1386072021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9e312c35-c2ff-4586-9a95-193ee29fe534 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:09 devstack sudo[101736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9e312c35-c2ff-4586-9a95-193ee29fe534 Sep 03 11:26:09 devstack sudo[101736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:09 devstack sudo[101729]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1db571f5-1e2d-40b8-af6f-ab059d460319 tempest-VolumeDependencyTests-2042862046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb" returned: 0 in 0.563s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1db571f5-1e2d-40b8-af6f-ab059d460319 tempest-VolumeDependencyTests-2042862046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb.764b38b7-8708-496f-99bc-8dcbdf349b55 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:09 devstack sudo[101739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb.764b38b7-8708-496f-99bc-8dcbdf349b55 Sep 03 11:26:09 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:09 devstack sudo[101736]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a802232b-3420-4606-aac0-5075d21aa716 tempest-AbsoluteLimitsTests-1386072021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9e312c35-c2ff-4586-9a95-193ee29fe534" returned: 0 in 0.260s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a802232b-3420-4606-aac0-5075d21aa716 tempest-AbsoluteLimitsTests-1386072021 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:26:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a802232b-3420-4606-aac0-5075d21aa716 tempest-AbsoluteLimitsTests-1386072021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:26:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a802232b-3420-4606-aac0-5075d21aa716 tempest-AbsoluteLimitsTests-1386072021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f517bb2-5eed-4a83-8820-c20b0286bec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e312c35-c2ff-4586-9a95-193ee29fe534', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a802232b-3420-4606-aac0-5075d21aa716 tempest-AbsoluteLimitsTests-1386072021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43cad7c2-1792-4df0-ae71-8300fd6ae706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:09 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-a802232b-3420-4606-aac0-5075d21aa716 tempest-AbsoluteLimitsTests-1386072021 None] Volume volume-9e312c35-c2ff-4586-9a95-193ee29fe534 (9e312c35-c2ff-4586-9a95-193ee29fe534): created successfully Sep 03 11:26:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a802232b-3420-4606-aac0-5075d21aa716 tempest-AbsoluteLimitsTests-1386072021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43cad7c2-1792-4df0-ae71-8300fd6ae706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a802232b-3420-4606-aac0-5075d21aa716 tempest-AbsoluteLimitsTests-1386072021 None] Flow 'volume_create_manager' (21de4bab-2d00-4d09-b331-45bbdaf32666) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:26:09 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-a802232b-3420-4606-aac0-5075d21aa716 tempest-AbsoluteLimitsTests-1386072021 None] Created volume successfully. Sep 03 11:26:10 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1db571f5-1e2d-40b8-af6f-ab059d460319 tempest-VolumeDependencyTests-2042862046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb.764b38b7-8708-496f-99bc-8dcbdf349b55" returned: 0 in 0.353s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1db571f5-1e2d-40b8-af6f-ab059d460319 tempest-VolumeDependencyTests-2042862046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb.764b38b7-8708-496f-99bc-8dcbdf349b55 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:10 devstack sudo[101746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb.764b38b7-8708-496f-99bc-8dcbdf349b55 Sep 03 11:26:10 devstack sudo[101746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:10 devstack sudo[101746]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1db571f5-1e2d-40b8-af6f-ab059d460319 tempest-VolumeDependencyTests-2042862046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb.764b38b7-8708-496f-99bc-8dcbdf349b55" returned: 0 in 0.277s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1db571f5-1e2d-40b8-af6f-ab059d460319 tempest-VolumeDependencyTests-2042862046 None] Lock "cinder-quobyte-764b38b7-8708-496f-99bc-8dcbdf349b55" released by "_delete_snapshot" :: held 1.679s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:26:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1db571f5-1e2d-40b8-af6f-ab059d460319 tempest-VolumeDependencyTests-2042862046 None] Lock "cinder-quobyte-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb" released by "delete_snapshot" :: held 1.701s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:26:10 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-1db571f5-1e2d-40b8-af6f-ab059d460319 tempest-VolumeDependencyTests-2042862046 None] Created reservations ['a4cbf024-cc23-47be-a520-f705a5c84b2f', '7082334d-b169-430e-ac39-19c6d8d928ec', '8c8cbc3f-8765-4d15-b6b3-6b806fc2e9ae', '236c897e-bf3d-4c70-b4aa-932be34b948f'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:26:10 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-1db571f5-1e2d-40b8-af6f-ab059d460319 tempest-VolumeDependencyTests-2042862046 None] Delete snapshot completed successfully. Sep 03 11:26:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1db571f5-1e2d-40b8-af6f-ab059d460319 tempest-VolumeDependencyTests-2042862046 None] Lock "cinder-764b38b7-8708-496f-99bc-8dcbdf349b55-delete_snapshot" released by "delete_snapshot" :: held 1.859s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:26:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8a8153c1-6873-427c-a169-9c7fd47bb0f0 tempest-VolumeDependencyTests-2042862046 None] Acquiring lock "cinder-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:26:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8a8153c1-6873-427c-a169-9c7fd47bb0f0 tempest-VolumeDependencyTests-2042862046 None] Lock "cinder-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:26:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8a8153c1-6873-427c-a169-9c7fd47bb0f0 tempest-VolumeDependencyTests-2042862046 None] Acquiring lock "cinder-quobyte-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:26:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8a8153c1-6873-427c-a169-9c7fd47bb0f0 tempest-VolumeDependencyTests-2042862046 None] Lock "cinder-quobyte-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb" acquired by "delete_volume" :: waited 0.014s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:26:10 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c000fa6-bf72-4978-8d8d-d500633afbcb]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:26:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8a8153c1-6873-427c-a169-9c7fd47bb0f0 tempest-VolumeDependencyTests-2042862046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:11 devstack sudo[101750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb Sep 03 11:26:11 devstack sudo[101750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:11 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-0c1fb0f0-f482-4fe5-b5dc-4d05e01d3887 tempest-AbsoluteLimitsTests-1386072021 None] Acquiring lock "cinder-9e312c35-c2ff-4586-9a95-193ee29fe534-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:26:11 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-0c1fb0f0-f482-4fe5-b5dc-4d05e01d3887 tempest-AbsoluteLimitsTests-1386072021 None] Lock "cinder-9e312c35-c2ff-4586-9a95-193ee29fe534-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:26:11 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-0c1fb0f0-f482-4fe5-b5dc-4d05e01d3887 tempest-AbsoluteLimitsTests-1386072021 None] Acquiring lock "cinder-quobyte-9e312c35-c2ff-4586-9a95-193ee29fe534" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:26:11 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-0c1fb0f0-f482-4fe5-b5dc-4d05e01d3887 tempest-AbsoluteLimitsTests-1386072021 None] Lock "cinder-quobyte-9e312c35-c2ff-4586-9a95-193ee29fe534" acquired by "delete_volume" :: waited 0.021s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:26:11 devstack sudo[101750]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8a8153c1-6873-427c-a169-9c7fd47bb0f0 tempest-VolumeDependencyTests-2042862046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb" returned: 0 in 0.443s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8a8153c1-6873-427c-a169-9c7fd47bb0f0 tempest-VolumeDependencyTests-2042862046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:11 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6ae8b3-051c-4471-84ae-7c8ce0104d5c]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:26:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0c1fb0f0-f482-4fe5-b5dc-4d05e01d3887 tempest-AbsoluteLimitsTests-1386072021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9e312c35-c2ff-4586-9a95-193ee29fe534 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:11 devstack sudo[101758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb Sep 03 11:26:11 devstack sudo[101758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:11 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9e312c35-c2ff-4586-9a95-193ee29fe534 Sep 03 11:26:11 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:11 devstack sudo[101758]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8a8153c1-6873-427c-a169-9c7fd47bb0f0 tempest-VolumeDependencyTests-2042862046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb" returned: 0 in 0.355s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:11 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8a8153c1-6873-427c-a169-9c7fd47bb0f0 tempest-VolumeDependencyTests-2042862046 None] Lock "cinder-quobyte-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb" released by "delete_volume" :: held 0.866s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:26:11 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-8a8153c1-6873-427c-a169-9c7fd47bb0f0 tempest-VolumeDependencyTests-2042862046 None] Created reservations ['6ab1bf01-6ad2-4e2c-a2a4-5c7c1155cb59', 'abb237c4-0a4a-4206-b9eb-077299d65bdb', '6d6d2377-5221-4f73-82f3-93b991700e47', '2759918a-3dd3-4a45-aa1f-cdde52fd1022'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:26:11 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0c1fb0f0-f482-4fe5-b5dc-4d05e01d3887 tempest-AbsoluteLimitsTests-1386072021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9e312c35-c2ff-4586-9a95-193ee29fe534" returned: 0 in 0.469s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0c1fb0f0-f482-4fe5-b5dc-4d05e01d3887 tempest-AbsoluteLimitsTests-1386072021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9e312c35-c2ff-4586-9a95-193ee29fe534 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:11 devstack sudo[101767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9e312c35-c2ff-4586-9a95-193ee29fe534 Sep 03 11:26:11 devstack sudo[101767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-8a8153c1-6873-427c-a169-9c7fd47bb0f0 tempest-VolumeDependencyTests-2042862046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:26:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-8a8153c1-6873-427c-a169-9c7fd47bb0f0 tempest-VolumeDependencyTests-2042862046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:26:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-8a8153c1-6873-427c-a169-9c7fd47bb0f0 tempest-VolumeDependencyTests-2042862046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:26:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-8a8153c1-6873-427c-a169-9c7fd47bb0f0 tempest-VolumeDependencyTests-2042862046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:26:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-8a8153c1-6873-427c-a169-9c7fd47bb0f0 tempest-VolumeDependencyTests-2042862046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:26:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8a8153c1-6873-427c-a169-9c7fd47bb0f0 tempest-VolumeDependencyTests-2042862046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:11 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:26:11 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:11 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-9fc9d069-6c2d-4825-a5c1-4a237b405c9b tempest-VolumeDependencyTests-2042862046 None] Acquiring lock "cinder-54b4cdfd-2a2c-472b-ac06-a250af399b1e-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:26:12 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-9fc9d069-6c2d-4825-a5c1-4a237b405c9b tempest-VolumeDependencyTests-2042862046 None] Lock "cinder-54b4cdfd-2a2c-472b-ac06-a250af399b1e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:26:12 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-9fc9d069-6c2d-4825-a5c1-4a237b405c9b tempest-VolumeDependencyTests-2042862046 None] Acquiring lock "cinder-quobyte-54b4cdfd-2a2c-472b-ac06-a250af399b1e" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:26:12 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-9fc9d069-6c2d-4825-a5c1-4a237b405c9b tempest-VolumeDependencyTests-2042862046 None] Lock "cinder-quobyte-54b4cdfd-2a2c-472b-ac06-a250af399b1e" acquired by "delete_volume" :: waited 0.021s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:26:12 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[722b959f-6000-42ff-9bbd-e4008e66b0ea]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:26:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9fc9d069-6c2d-4825-a5c1-4a237b405c9b tempest-VolumeDependencyTests-2042862046 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-54b4cdfd-2a2c-472b-ac06-a250af399b1e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:12 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-2f290963-7d9b-499b-b150-0134343b42fb req-ddb7e81c-b8e5-4655-aa83-d928984a9a73 tempest-TestMinimumBasicScenario-1793377207 None] Terminate volume connection completed successfully. Sep 03 11:26:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-2f290963-7d9b-499b-b150-0134343b42fb req-ddb7e81c-b8e5-4655-aa83-d928984a9a73 tempest-TestMinimumBasicScenario-1793377207 None] Deleting attachment 97d52391-1535-4937-9e9b-49f9628f3f77. {{(pid=87038) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:26:12 devstack sudo[101767]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0c1fb0f0-f482-4fe5-b5dc-4d05e01d3887 tempest-AbsoluteLimitsTests-1386072021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9e312c35-c2ff-4586-9a95-193ee29fe534" returned: 0 in 0.415s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:12 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:12 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-0c1fb0f0-f482-4fe5-b5dc-4d05e01d3887 tempest-AbsoluteLimitsTests-1386072021 None] Lock "cinder-quobyte-9e312c35-c2ff-4586-9a95-193ee29fe534" released by "delete_volume" :: held 0.966s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:26:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8a8153c1-6873-427c-a169-9c7fd47bb0f0 tempest-VolumeDependencyTests-2042862046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.379s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:12 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-8a8153c1-6873-427c-a169-9c7fd47bb0f0 tempest-VolumeDependencyTests-2042862046 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:26:12 devstack sudo[101774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-54b4cdfd-2a2c-472b-ac06-a250af399b1e Sep 03 11:26:12 devstack sudo[101774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:12 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-8a8153c1-6873-427c-a169-9c7fd47bb0f0 tempest-VolumeDependencyTests-2042862046 None] Deleted volume successfully. Sep 03 11:26:12 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8a8153c1-6873-427c-a169-9c7fd47bb0f0 tempest-VolumeDependencyTests-2042862046 None] Lock "cinder-a1a72ac0-a1e4-4300-9c0f-8ec6a7ce36eb-delete_volume" released by "delete_volume" :: held 1.523s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:26:12 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-0c1fb0f0-f482-4fe5-b5dc-4d05e01d3887 tempest-AbsoluteLimitsTests-1386072021 None] Created reservations ['5cd63e7f-8f9a-4c1d-8aa1-85a011f8fedf', '97cbadb1-517e-4a61-9518-d85e55e3db49', '6ec4e61c-20d5-47f7-b06d-67bd4651e459', '8bcde403-f14a-4d73-946f-113799f9695f'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:26:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0c1fb0f0-f482-4fe5-b5dc-4d05e01d3887 tempest-AbsoluteLimitsTests-1386072021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:26:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0c1fb0f0-f482-4fe5-b5dc-4d05e01d3887 tempest-AbsoluteLimitsTests-1386072021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:26:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0c1fb0f0-f482-4fe5-b5dc-4d05e01d3887 tempest-AbsoluteLimitsTests-1386072021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:26:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0c1fb0f0-f482-4fe5-b5dc-4d05e01d3887 tempest-AbsoluteLimitsTests-1386072021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:26:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0c1fb0f0-f482-4fe5-b5dc-4d05e01d3887 tempest-AbsoluteLimitsTests-1386072021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:26:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0c1fb0f0-f482-4fe5-b5dc-4d05e01d3887 tempest-AbsoluteLimitsTests-1386072021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:12 devstack sudo[101778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:26:12 devstack sudo[101778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:12 devstack sudo[101774]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9fc9d069-6c2d-4825-a5c1-4a237b405c9b tempest-VolumeDependencyTests-2042862046 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-54b4cdfd-2a2c-472b-ac06-a250af399b1e" returned: 0 in 0.410s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9fc9d069-6c2d-4825-a5c1-4a237b405c9b tempest-VolumeDependencyTests-2042862046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-54b4cdfd-2a2c-472b-ac06-a250af399b1e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:12 devstack sudo[101783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-54b4cdfd-2a2c-472b-ac06-a250af399b1e Sep 03 11:26:12 devstack sudo[101783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:12 devstack sudo[101778]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0c1fb0f0-f482-4fe5-b5dc-4d05e01d3887 tempest-AbsoluteLimitsTests-1386072021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.259s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:12 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-0c1fb0f0-f482-4fe5-b5dc-4d05e01d3887 tempest-AbsoluteLimitsTests-1386072021 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:26:12 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-0c1fb0f0-f482-4fe5-b5dc-4d05e01d3887 tempest-AbsoluteLimitsTests-1386072021 None] Deleted volume successfully. Sep 03 11:26:12 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-0c1fb0f0-f482-4fe5-b5dc-4d05e01d3887 tempest-AbsoluteLimitsTests-1386072021 None] Lock "cinder-9e312c35-c2ff-4586-9a95-193ee29fe534-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:26:12 devstack sudo[101783]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9fc9d069-6c2d-4825-a5c1-4a237b405c9b tempest-VolumeDependencyTests-2042862046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-54b4cdfd-2a2c-472b-ac06-a250af399b1e" returned: 0 in 0.266s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:12 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-9fc9d069-6c2d-4825-a5c1-4a237b405c9b tempest-VolumeDependencyTests-2042862046 None] Lock "cinder-quobyte-54b4cdfd-2a2c-472b-ac06-a250af399b1e" released by "delete_volume" :: held 0.744s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:26:12 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-9fc9d069-6c2d-4825-a5c1-4a237b405c9b tempest-VolumeDependencyTests-2042862046 None] Created reservations ['6c0ad479-dd88-441f-bf03-40777690b5bc', 'ef58442a-d375-46cc-aa07-41442b688f8e', 'a8d38455-b0b0-4046-bd21-248f5536a2e4', 'ab3edea0-230d-4a13-ab09-c0995cc07352'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:26:12 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d6d6a4d5-74d4-47b3-b3f8-9bfc295848b8 tempest-TestMinimumBasicScenario-1793377207 None] Acquiring lock "cinder-17e82fa0-cc62-47f5-8033-d2cd0a24ccb8-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:26:12 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d6d6a4d5-74d4-47b3-b3f8-9bfc295848b8 tempest-TestMinimumBasicScenario-1793377207 None] Lock "cinder-17e82fa0-cc62-47f5-8033-d2cd0a24ccb8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:26:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9fc9d069-6c2d-4825-a5c1-4a237b405c9b tempest-VolumeDependencyTests-2042862046 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:26:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9fc9d069-6c2d-4825-a5c1-4a237b405c9b tempest-VolumeDependencyTests-2042862046 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:26:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-9fc9d069-6c2d-4825-a5c1-4a237b405c9b tempest-VolumeDependencyTests-2042862046 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:26:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-9fc9d069-6c2d-4825-a5c1-4a237b405c9b tempest-VolumeDependencyTests-2042862046 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:26:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9fc9d069-6c2d-4825-a5c1-4a237b405c9b tempest-VolumeDependencyTests-2042862046 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:26:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9fc9d069-6c2d-4825-a5c1-4a237b405c9b tempest-VolumeDependencyTests-2042862046 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:13 devstack sudo[101787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:26:13 devstack sudo[101787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:13 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d6d6a4d5-74d4-47b3-b3f8-9bfc295848b8 tempest-TestMinimumBasicScenario-1793377207 None] Acquiring lock "cinder-quobyte-17e82fa0-cc62-47f5-8033-d2cd0a24ccb8" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:26:13 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d6d6a4d5-74d4-47b3-b3f8-9bfc295848b8 tempest-TestMinimumBasicScenario-1793377207 None] Lock "cinder-quobyte-17e82fa0-cc62-47f5-8033-d2cd0a24ccb8" acquired by "delete_volume" :: waited 0.015s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:26:13 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[03629d3c-4f01-4d6b-8224-d8f85f5d076a]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:26:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d6d6a4d5-74d4-47b3-b3f8-9bfc295848b8 tempest-TestMinimumBasicScenario-1793377207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-17e82fa0-cc62-47f5-8033-d2cd0a24ccb8 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:13 devstack sudo[101789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-17e82fa0-cc62-47f5-8033-d2cd0a24ccb8 Sep 03 11:26:13 devstack sudo[101789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:13 devstack sudo[101787]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9fc9d069-6c2d-4825-a5c1-4a237b405c9b tempest-VolumeDependencyTests-2042862046 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.261s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:13 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-9fc9d069-6c2d-4825-a5c1-4a237b405c9b tempest-VolumeDependencyTests-2042862046 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:26:13 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-9fc9d069-6c2d-4825-a5c1-4a237b405c9b tempest-VolumeDependencyTests-2042862046 None] Deleted volume successfully. Sep 03 11:26:13 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-9fc9d069-6c2d-4825-a5c1-4a237b405c9b tempest-VolumeDependencyTests-2042862046 None] Lock "cinder-54b4cdfd-2a2c-472b-ac06-a250af399b1e-delete_volume" released by "delete_volume" :: held 1.273s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:26:13 devstack sudo[101789]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d6d6a4d5-74d4-47b3-b3f8-9bfc295848b8 tempest-TestMinimumBasicScenario-1793377207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-17e82fa0-cc62-47f5-8033-d2cd0a24ccb8" returned: 0 in 0.388s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d6d6a4d5-74d4-47b3-b3f8-9bfc295848b8 tempest-TestMinimumBasicScenario-1793377207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-17e82fa0-cc62-47f5-8033-d2cd0a24ccb8 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:13 devstack sudo[101795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-17e82fa0-cc62-47f5-8033-d2cd0a24ccb8 Sep 03 11:26:13 devstack sudo[101795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:13 devstack sudo[101795]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d6d6a4d5-74d4-47b3-b3f8-9bfc295848b8 tempest-TestMinimumBasicScenario-1793377207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-17e82fa0-cc62-47f5-8033-d2cd0a24ccb8" returned: 0 in 0.262s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:13 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d6d6a4d5-74d4-47b3-b3f8-9bfc295848b8 tempest-TestMinimumBasicScenario-1793377207 None] Lock "cinder-quobyte-17e82fa0-cc62-47f5-8033-d2cd0a24ccb8" released by "delete_volume" :: held 0.702s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:26:13 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-d6d6a4d5-74d4-47b3-b3f8-9bfc295848b8 tempest-TestMinimumBasicScenario-1793377207 None] Created reservations ['7b5c76e5-5b11-49d0-9e90-e807d0900709', '9b78c4be-6e78-44f9-a7f4-8b46922740d5', '69b9c759-d2b2-4be5-ab3e-736fbdb08ef0', '581a6557-0401-4bf1-a4a9-f8eb36888313'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:26:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d6d6a4d5-74d4-47b3-b3f8-9bfc295848b8 tempest-TestMinimumBasicScenario-1793377207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:26:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d6d6a4d5-74d4-47b3-b3f8-9bfc295848b8 tempest-TestMinimumBasicScenario-1793377207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:26:13 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d6d6a4d5-74d4-47b3-b3f8-9bfc295848b8 tempest-TestMinimumBasicScenario-1793377207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:26:13 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d6d6a4d5-74d4-47b3-b3f8-9bfc295848b8 tempest-TestMinimumBasicScenario-1793377207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:26:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d6d6a4d5-74d4-47b3-b3f8-9bfc295848b8 tempest-TestMinimumBasicScenario-1793377207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:26:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d6d6a4d5-74d4-47b3-b3f8-9bfc295848b8 tempest-TestMinimumBasicScenario-1793377207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:13 devstack sudo[101798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:26:13 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:14 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d6d6a4d5-74d4-47b3-b3f8-9bfc295848b8 tempest-TestMinimumBasicScenario-1793377207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.328s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:14 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-d6d6a4d5-74d4-47b3-b3f8-9bfc295848b8 tempest-TestMinimumBasicScenario-1793377207 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:26:14 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-d6d6a4d5-74d4-47b3-b3f8-9bfc295848b8 tempest-TestMinimumBasicScenario-1793377207 None] Deleted volume successfully. Sep 03 11:26:14 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d6d6a4d5-74d4-47b3-b3f8-9bfc295848b8 tempest-TestMinimumBasicScenario-1793377207 None] Lock "cinder-17e82fa0-cc62-47f5-8033-d2cd0a24ccb8-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:26:17 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:26:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:26:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:26:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:26:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:26:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:26:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:18 devstack sudo[101860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:26:18 devstack sudo[101860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:18 devstack sudo[101860]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.421s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:18 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:26:18 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:26:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread count: 28 {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:26:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread info: [<_MainThread(MainThread, started 139554943000704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:26:20 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-0474224b-6e53-4475-b8ed-5c2729a6d61a tempest-VolumesTransfersV357Test-1425495785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:26:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0474224b-6e53-4475-b8ed-5c2729a6d61a tempest-VolumesTransfersV357Test-1425495785 None] Flow 'volume_create_manager' (d9c8c998-fa4e-4eef-8910-8ae55d0972c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:26:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0474224b-6e53-4475-b8ed-5c2729a6d61a tempest-VolumesTransfersV357Test-1425495785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaa46053-9067-4cb1-a7e1-e77070357510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0474224b-6e53-4475-b8ed-5c2729a6d61a tempest-VolumesTransfersV357Test-1425495785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaa46053-9067-4cb1-a7e1-e77070357510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-213368248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5a907e4-dd39-4cc6-a532-2adf0f4aa541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1233d23339e54fcb98196a2d7ad1db6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:26:20Z,use_quota=True,user_id='458d8f0c1354417db7ea31eb9ba39507',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0474224b-6e53-4475-b8ed-5c2729a6d61a tempest-VolumesTransfersV357Test-1425495785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5358c1c1-9820-4ab2-9738-3fdadf9d16a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0474224b-6e53-4475-b8ed-5c2729a6d61a tempest-VolumesTransfersV357Test-1425495785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5358c1c1-9820-4ab2-9738-3fdadf9d16a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0474224b-6e53-4475-b8ed-5c2729a6d61a tempest-VolumesTransfersV357Test-1425495785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f51551a2-782d-4ba8-8539-c2b42ec78500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0474224b-6e53-4475-b8ed-5c2729a6d61a tempest-VolumesTransfersV357Test-1425495785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f51551a2-782d-4ba8-8539-c2b42ec78500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5a907e4-dd39-4cc6-a532-2adf0f4aa541', 'volume_name': 'volume-b5a907e4-dd39-4cc6-a532-2adf0f4aa541', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0474224b-6e53-4475-b8ed-5c2729a6d61a tempest-VolumesTransfersV357Test-1425495785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cb9c819-977d-4925-b623-a0a2a9170e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0474224b-6e53-4475-b8ed-5c2729a6d61a tempest-VolumesTransfersV357Test-1425495785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cb9c819-977d-4925-b623-a0a2a9170e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0474224b-6e53-4475-b8ed-5c2729a6d61a tempest-VolumesTransfersV357Test-1425495785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8163e100-02d6-4ad0-89b8-9f1463054da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:20 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-0474224b-6e53-4475-b8ed-5c2729a6d61a tempest-VolumesTransfersV357Test-1425495785 None] Volume b5a907e4-dd39-4cc6-a532-2adf0f4aa541: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5a907e4-dd39-4cc6-a532-2adf0f4aa541', 'volume_size': 1} Sep 03 11:26:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0474224b-6e53-4475-b8ed-5c2729a6d61a tempest-VolumesTransfersV357Test-1425495785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:26:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0474224b-6e53-4475-b8ed-5c2729a6d61a tempest-VolumesTransfersV357Test-1425495785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:26:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0474224b-6e53-4475-b8ed-5c2729a6d61a tempest-VolumesTransfersV357Test-1425495785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:26:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-213368248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5a907e4-dd39-4cc6-a532-2adf0f4aa541,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1233d23339e54fcb98196a2d7ad1db6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:26:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:26:20Z,use_quota=True,user_id='458d8f0c1354417db7ea31eb9ba39507',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:26:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-0474224b-6e53-4475-b8ed-5c2729a6d61a tempest-VolumesTransfersV357Test-1425495785 None] Creating volume b5a907e4-dd39-4cc6-a532-2adf0f4aa541 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:26:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0474224b-6e53-4475-b8ed-5c2729a6d61a tempest-VolumesTransfersV357Test-1425495785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:26:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0474224b-6e53-4475-b8ed-5c2729a6d61a tempest-VolumesTransfersV357Test-1425495785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:26:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0474224b-6e53-4475-b8ed-5c2729a6d61a tempest-VolumesTransfersV357Test-1425495785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:26:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0474224b-6e53-4475-b8ed-5c2729a6d61a tempest-VolumesTransfersV357Test-1425495785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:26:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0474224b-6e53-4475-b8ed-5c2729a6d61a tempest-VolumesTransfersV357Test-1425495785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:26:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0474224b-6e53-4475-b8ed-5c2729a6d61a tempest-VolumesTransfersV357Test-1425495785 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:26:20 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-0474224b-6e53-4475-b8ed-5c2729a6d61a tempest-VolumesTransfersV357Test-1425495785 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:26:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0474224b-6e53-4475-b8ed-5c2729a6d61a tempest-VolumesTransfersV357Test-1425495785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b5a907e4-dd39-4cc6-a532-2adf0f4aa541 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:20 devstack sudo[101866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b5a907e4-dd39-4cc6-a532-2adf0f4aa541 1073741824 Sep 03 11:26:20 devstack sudo[101866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:20 devstack sudo[101866]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0474224b-6e53-4475-b8ed-5c2729a6d61a tempest-VolumesTransfersV357Test-1425495785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b5a907e4-dd39-4cc6-a532-2adf0f4aa541 1073741824" returned: 0 in 0.456s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0474224b-6e53-4475-b8ed-5c2729a6d61a tempest-VolumesTransfersV357Test-1425495785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b5a907e4-dd39-4cc6-a532-2adf0f4aa541 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:20 devstack sudo[101873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b5a907e4-dd39-4cc6-a532-2adf0f4aa541 Sep 03 11:26:20 devstack sudo[101873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:21 devstack sudo[101873]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0474224b-6e53-4475-b8ed-5c2729a6d61a tempest-VolumesTransfersV357Test-1425495785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b5a907e4-dd39-4cc6-a532-2adf0f4aa541" returned: 0 in 0.261s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:21 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0474224b-6e53-4475-b8ed-5c2729a6d61a tempest-VolumesTransfersV357Test-1425495785 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:26:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0474224b-6e53-4475-b8ed-5c2729a6d61a tempest-VolumesTransfersV357Test-1425495785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:26:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0474224b-6e53-4475-b8ed-5c2729a6d61a tempest-VolumesTransfersV357Test-1425495785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8163e100-02d6-4ad0-89b8-9f1463054da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5a907e4-dd39-4cc6-a532-2adf0f4aa541', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0474224b-6e53-4475-b8ed-5c2729a6d61a tempest-VolumesTransfersV357Test-1425495785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5666063b-96f1-4759-a5f7-dcd591e5f506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:21 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-0474224b-6e53-4475-b8ed-5c2729a6d61a tempest-VolumesTransfersV357Test-1425495785 None] Volume volume-b5a907e4-dd39-4cc6-a532-2adf0f4aa541 (b5a907e4-dd39-4cc6-a532-2adf0f4aa541): created successfully Sep 03 11:26:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0474224b-6e53-4475-b8ed-5c2729a6d61a tempest-VolumesTransfersV357Test-1425495785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5666063b-96f1-4759-a5f7-dcd591e5f506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0474224b-6e53-4475-b8ed-5c2729a6d61a tempest-VolumesTransfersV357Test-1425495785 None] Flow 'volume_create_manager' (d9c8c998-fa4e-4eef-8910-8ae55d0972c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:26:21 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-0474224b-6e53-4475-b8ed-5c2729a6d61a tempest-VolumesTransfersV357Test-1425495785 None] Created volume successfully. Sep 03 11:26:22 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-10c068a9-d413-426b-8c10-44c7095a99ad tempest-VolumesTransfersV357Test-1651706746 None] Transfer volume completed successfully. Sep 03 11:26:23 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3fec7b71-5a0b-400a-8160-55fdc959e420 tempest-VolumesTransfersV357Test-539985400 None] Acquiring lock "cinder-b5a907e4-dd39-4cc6-a532-2adf0f4aa541-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:26:23 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3fec7b71-5a0b-400a-8160-55fdc959e420 tempest-VolumesTransfersV357Test-539985400 None] Lock "cinder-b5a907e4-dd39-4cc6-a532-2adf0f4aa541-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:26:23 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3fec7b71-5a0b-400a-8160-55fdc959e420 tempest-VolumesTransfersV357Test-539985400 None] Acquiring lock "cinder-quobyte-b5a907e4-dd39-4cc6-a532-2adf0f4aa541" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:26:23 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3fec7b71-5a0b-400a-8160-55fdc959e420 tempest-VolumesTransfersV357Test-539985400 None] Lock "cinder-quobyte-b5a907e4-dd39-4cc6-a532-2adf0f4aa541" acquired by "delete_volume" :: waited 0.024s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:26:23 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb21fcff-6be1-474d-a82d-5bb65719fb3d]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:26:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3fec7b71-5a0b-400a-8160-55fdc959e420 tempest-VolumesTransfersV357Test-539985400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b5a907e4-dd39-4cc6-a532-2adf0f4aa541 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:23 devstack sudo[101877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b5a907e4-dd39-4cc6-a532-2adf0f4aa541 Sep 03 11:26:23 devstack sudo[101877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:23 devstack sudo[101877]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3fec7b71-5a0b-400a-8160-55fdc959e420 tempest-VolumesTransfersV357Test-539985400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b5a907e4-dd39-4cc6-a532-2adf0f4aa541" returned: 0 in 0.390s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3fec7b71-5a0b-400a-8160-55fdc959e420 tempest-VolumesTransfersV357Test-539985400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b5a907e4-dd39-4cc6-a532-2adf0f4aa541 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:23 devstack sudo[101882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b5a907e4-dd39-4cc6-a532-2adf0f4aa541 Sep 03 11:26:23 devstack sudo[101882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:24 devstack sudo[101882]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3fec7b71-5a0b-400a-8160-55fdc959e420 tempest-VolumesTransfersV357Test-539985400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b5a907e4-dd39-4cc6-a532-2adf0f4aa541" returned: 0 in 0.252s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:24 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3fec7b71-5a0b-400a-8160-55fdc959e420 tempest-VolumesTransfersV357Test-539985400 None] Lock "cinder-quobyte-b5a907e4-dd39-4cc6-a532-2adf0f4aa541" released by "delete_volume" :: held 0.687s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:26:24 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-3fec7b71-5a0b-400a-8160-55fdc959e420 tempest-VolumesTransfersV357Test-539985400 None] Created reservations ['75088634-511c-4c29-82ab-a1c23892dcf8', '7431db99-9608-4d7a-bd11-c3d3d9a8d27b', '877c8041-a62a-404e-b1ff-3b0c66002897', '4771cc40-b92c-4544-9a7b-86d849235a01'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:26:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3fec7b71-5a0b-400a-8160-55fdc959e420 tempest-VolumesTransfersV357Test-539985400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:26:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3fec7b71-5a0b-400a-8160-55fdc959e420 tempest-VolumesTransfersV357Test-539985400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:26:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-3fec7b71-5a0b-400a-8160-55fdc959e420 tempest-VolumesTransfersV357Test-539985400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:26:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-3fec7b71-5a0b-400a-8160-55fdc959e420 tempest-VolumesTransfersV357Test-539985400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:26:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3fec7b71-5a0b-400a-8160-55fdc959e420 tempest-VolumesTransfersV357Test-539985400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:26:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3fec7b71-5a0b-400a-8160-55fdc959e420 tempest-VolumesTransfersV357Test-539985400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:24 devstack sudo[101885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:26:24 devstack sudo[101885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:24 devstack sudo[101885]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3fec7b71-5a0b-400a-8160-55fdc959e420 tempest-VolumesTransfersV357Test-539985400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.255s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:24 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-3fec7b71-5a0b-400a-8160-55fdc959e420 tempest-VolumesTransfersV357Test-539985400 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:26:24 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-3fec7b71-5a0b-400a-8160-55fdc959e420 tempest-VolumesTransfersV357Test-539985400 None] Deleted volume successfully. Sep 03 11:26:24 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3fec7b71-5a0b-400a-8160-55fdc959e420 tempest-VolumesTransfersV357Test-539985400 None] Lock "cinder-b5a907e4-dd39-4cc6-a532-2adf0f4aa541-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:26:25 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-a57880fc-7123-415e-9081-7a9060b71d7a tempest-VolumesTransfersV357Test-1425495785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:26:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a57880fc-7123-415e-9081-7a9060b71d7a tempest-VolumesTransfersV357Test-1425495785 None] Flow 'volume_create_manager' (412374c2-c1f0-4463-b3ae-c4aee58b73bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:26:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a57880fc-7123-415e-9081-7a9060b71d7a tempest-VolumesTransfersV357Test-1425495785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c67c79e6-b4f1-4298-a434-b4c0aa741008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a57880fc-7123-415e-9081-7a9060b71d7a tempest-VolumesTransfersV357Test-1425495785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c67c79e6-b4f1-4298-a434-b4c0aa741008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1330006490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76cff6cf-7150-4d3b-acb5-1e20d867ad62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1233d23339e54fcb98196a2d7ad1db6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:26:25Z,use_quota=True,user_id='458d8f0c1354417db7ea31eb9ba39507',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a57880fc-7123-415e-9081-7a9060b71d7a tempest-VolumesTransfersV357Test-1425495785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5655c03d-578d-4e06-abc8-e46ce986884d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a57880fc-7123-415e-9081-7a9060b71d7a tempest-VolumesTransfersV357Test-1425495785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5655c03d-578d-4e06-abc8-e46ce986884d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a57880fc-7123-415e-9081-7a9060b71d7a tempest-VolumesTransfersV357Test-1425495785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835ee9db-6e9a-4828-b02b-b6d035491502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a57880fc-7123-415e-9081-7a9060b71d7a tempest-VolumesTransfersV357Test-1425495785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835ee9db-6e9a-4828-b02b-b6d035491502) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76cff6cf-7150-4d3b-acb5-1e20d867ad62', 'volume_name': 'volume-76cff6cf-7150-4d3b-acb5-1e20d867ad62', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a57880fc-7123-415e-9081-7a9060b71d7a tempest-VolumesTransfersV357Test-1425495785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (173abb2f-86b9-498e-82ee-0fff09f2a738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a57880fc-7123-415e-9081-7a9060b71d7a tempest-VolumesTransfersV357Test-1425495785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (173abb2f-86b9-498e-82ee-0fff09f2a738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a57880fc-7123-415e-9081-7a9060b71d7a tempest-VolumesTransfersV357Test-1425495785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91eaf358-8d10-45e7-8165-1ec74d897971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:25 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-a57880fc-7123-415e-9081-7a9060b71d7a tempest-VolumesTransfersV357Test-1425495785 None] Volume 76cff6cf-7150-4d3b-acb5-1e20d867ad62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76cff6cf-7150-4d3b-acb5-1e20d867ad62', 'volume_size': 1} Sep 03 11:26:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a57880fc-7123-415e-9081-7a9060b71d7a tempest-VolumesTransfersV357Test-1425495785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:26:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a57880fc-7123-415e-9081-7a9060b71d7a tempest-VolumesTransfersV357Test-1425495785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:26:25 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a57880fc-7123-415e-9081-7a9060b71d7a tempest-VolumesTransfersV357Test-1425495785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1330006490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76cff6cf-7150-4d3b-acb5-1e20d867ad62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1233d23339e54fcb98196a2d7ad1db6c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:26:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:26:25Z,use_quota=True,user_id='458d8f0c1354417db7ea31eb9ba39507',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:26:25 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-a57880fc-7123-415e-9081-7a9060b71d7a tempest-VolumesTransfersV357Test-1425495785 None] Creating volume 76cff6cf-7150-4d3b-acb5-1e20d867ad62 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:26:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a57880fc-7123-415e-9081-7a9060b71d7a tempest-VolumesTransfersV357Test-1425495785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:26:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a57880fc-7123-415e-9081-7a9060b71d7a tempest-VolumesTransfersV357Test-1425495785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:26:25 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a57880fc-7123-415e-9081-7a9060b71d7a tempest-VolumesTransfersV357Test-1425495785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:26:25 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a57880fc-7123-415e-9081-7a9060b71d7a tempest-VolumesTransfersV357Test-1425495785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:26:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a57880fc-7123-415e-9081-7a9060b71d7a tempest-VolumesTransfersV357Test-1425495785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:26:25 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a57880fc-7123-415e-9081-7a9060b71d7a tempest-VolumesTransfersV357Test-1425495785 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:26:25 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-a57880fc-7123-415e-9081-7a9060b71d7a tempest-VolumesTransfersV357Test-1425495785 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:26:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a57880fc-7123-415e-9081-7a9060b71d7a tempest-VolumesTransfersV357Test-1425495785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-76cff6cf-7150-4d3b-acb5-1e20d867ad62 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:25 devstack sudo[101888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-76cff6cf-7150-4d3b-acb5-1e20d867ad62 1073741824 Sep 03 11:26:25 devstack sudo[101888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:25 devstack sudo[101888]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a57880fc-7123-415e-9081-7a9060b71d7a tempest-VolumesTransfersV357Test-1425495785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-76cff6cf-7150-4d3b-acb5-1e20d867ad62 1073741824" returned: 0 in 0.460s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a57880fc-7123-415e-9081-7a9060b71d7a tempest-VolumesTransfersV357Test-1425495785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-76cff6cf-7150-4d3b-acb5-1e20d867ad62 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:25 devstack sudo[101894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-76cff6cf-7150-4d3b-acb5-1e20d867ad62 Sep 03 11:26:25 devstack sudo[101894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:25 devstack sudo[101894]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a57880fc-7123-415e-9081-7a9060b71d7a tempest-VolumesTransfersV357Test-1425495785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-76cff6cf-7150-4d3b-acb5-1e20d867ad62" returned: 0 in 0.274s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:25 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a57880fc-7123-415e-9081-7a9060b71d7a tempest-VolumesTransfersV357Test-1425495785 None] <== create_volume: return (781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:26:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a57880fc-7123-415e-9081-7a9060b71d7a tempest-VolumesTransfersV357Test-1425495785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:26:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a57880fc-7123-415e-9081-7a9060b71d7a tempest-VolumesTransfersV357Test-1425495785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91eaf358-8d10-45e7-8165-1ec74d897971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76cff6cf-7150-4d3b-acb5-1e20d867ad62', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a57880fc-7123-415e-9081-7a9060b71d7a tempest-VolumesTransfersV357Test-1425495785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb6f7838-051f-4850-a91b-b256cd1a808c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:25 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-a57880fc-7123-415e-9081-7a9060b71d7a tempest-VolumesTransfersV357Test-1425495785 None] Volume volume-76cff6cf-7150-4d3b-acb5-1e20d867ad62 (76cff6cf-7150-4d3b-acb5-1e20d867ad62): created successfully Sep 03 11:26:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a57880fc-7123-415e-9081-7a9060b71d7a tempest-VolumesTransfersV357Test-1425495785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb6f7838-051f-4850-a91b-b256cd1a808c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a57880fc-7123-415e-9081-7a9060b71d7a tempest-VolumesTransfersV357Test-1425495785 None] Flow 'volume_create_manager' (412374c2-c1f0-4463-b3ae-c4aee58b73bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:26:25 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-a57880fc-7123-415e-9081-7a9060b71d7a tempest-VolumesTransfersV357Test-1425495785 None] Created volume successfully. Sep 03 11:26:26 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-6a75f282-a4c3-44a1-9841-253e0bdba2e4 tempest-VolumesTransfersV357Test-539985400 None] Acquiring lock "cinder-76cff6cf-7150-4d3b-acb5-1e20d867ad62-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:26:26 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-6a75f282-a4c3-44a1-9841-253e0bdba2e4 tempest-VolumesTransfersV357Test-539985400 None] Lock "cinder-76cff6cf-7150-4d3b-acb5-1e20d867ad62-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:26:26 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-6a75f282-a4c3-44a1-9841-253e0bdba2e4 tempest-VolumesTransfersV357Test-539985400 None] Acquiring lock "cinder-quobyte-76cff6cf-7150-4d3b-acb5-1e20d867ad62" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:26:26 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-6a75f282-a4c3-44a1-9841-253e0bdba2e4 tempest-VolumesTransfersV357Test-539985400 None] Lock "cinder-quobyte-76cff6cf-7150-4d3b-acb5-1e20d867ad62" acquired by "delete_volume" :: waited 0.019s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:26:26 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2d9ed8-d883-4eb1-bfc1-b098c8b85d02]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:26:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6a75f282-a4c3-44a1-9841-253e0bdba2e4 tempest-VolumesTransfersV357Test-539985400 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-76cff6cf-7150-4d3b-acb5-1e20d867ad62 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:26 devstack sudo[101897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-76cff6cf-7150-4d3b-acb5-1e20d867ad62 Sep 03 11:26:26 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:26 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6a75f282-a4c3-44a1-9841-253e0bdba2e4 tempest-VolumesTransfersV357Test-539985400 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-76cff6cf-7150-4d3b-acb5-1e20d867ad62" returned: 0 in 0.395s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6a75f282-a4c3-44a1-9841-253e0bdba2e4 tempest-VolumesTransfersV357Test-539985400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-76cff6cf-7150-4d3b-acb5-1e20d867ad62 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:26 devstack sudo[101902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-76cff6cf-7150-4d3b-acb5-1e20d867ad62 Sep 03 11:26:26 devstack sudo[101902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:27 devstack sudo[101902]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6a75f282-a4c3-44a1-9841-253e0bdba2e4 tempest-VolumesTransfersV357Test-539985400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-76cff6cf-7150-4d3b-acb5-1e20d867ad62" returned: 0 in 0.259s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:27 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-6a75f282-a4c3-44a1-9841-253e0bdba2e4 tempest-VolumesTransfersV357Test-539985400 None] Lock "cinder-quobyte-76cff6cf-7150-4d3b-acb5-1e20d867ad62" released by "delete_volume" :: held 0.707s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:26:27 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-6a75f282-a4c3-44a1-9841-253e0bdba2e4 tempest-VolumesTransfersV357Test-539985400 None] Created reservations ['5e48a8ff-a0b4-49dc-aa5d-2542598245b7', '61b751fc-aab9-49de-be15-18e336bb2d1f', '1694679e-dce6-4ed6-9746-b4c1cb964973', '5146ce37-777c-4664-8904-a1cc7e285504'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:26:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6a75f282-a4c3-44a1-9841-253e0bdba2e4 tempest-VolumesTransfersV357Test-539985400 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:26:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6a75f282-a4c3-44a1-9841-253e0bdba2e4 tempest-VolumesTransfersV357Test-539985400 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:26:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6a75f282-a4c3-44a1-9841-253e0bdba2e4 tempest-VolumesTransfersV357Test-539985400 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:26:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6a75f282-a4c3-44a1-9841-253e0bdba2e4 tempest-VolumesTransfersV357Test-539985400 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:26:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6a75f282-a4c3-44a1-9841-253e0bdba2e4 tempest-VolumesTransfersV357Test-539985400 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:26:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6a75f282-a4c3-44a1-9841-253e0bdba2e4 tempest-VolumesTransfersV357Test-539985400 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:27 devstack sudo[101905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:26:27 devstack sudo[101905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:27 devstack sudo[101905]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6a75f282-a4c3-44a1-9841-253e0bdba2e4 tempest-VolumesTransfersV357Test-539985400 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.276s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:27 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-6a75f282-a4c3-44a1-9841-253e0bdba2e4 tempest-VolumesTransfersV357Test-539985400 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:26:27 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-6a75f282-a4c3-44a1-9841-253e0bdba2e4 tempest-VolumesTransfersV357Test-539985400 None] Deleted volume successfully. Sep 03 11:26:27 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-6a75f282-a4c3-44a1-9841-253e0bdba2e4 tempest-VolumesTransfersV357Test-539985400 None] Lock "cinder-76cff6cf-7150-4d3b-acb5-1e20d867ad62-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:26:33 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b7b56b7-22b1-4c28-85b8-35050840d8a7 tempest-VolumesCloneNegativeTest-604209816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:26:33 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6b7b56b7-22b1-4c28-85b8-35050840d8a7 tempest-VolumesCloneNegativeTest-604209816 None] Flow 'volume_create_manager' (5151693c-1869-4963-b6ab-cd819c15133a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:26:33 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6b7b56b7-22b1-4c28-85b8-35050840d8a7 tempest-VolumesCloneNegativeTest-604209816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad209cc-c9ba-408d-9583-63f0964a42a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:33 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6b7b56b7-22b1-4c28-85b8-35050840d8a7 tempest-VolumesCloneNegativeTest-604209816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad209cc-c9ba-408d-9583-63f0964a42a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-748712093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e2e8252-b702-4198-9020-65f3e5e6ad65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5edf76d063444ae6a2b196d9e8b0c27b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:26:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:26:33Z,use_quota=True,user_id='89fdb9aa828243bea8b869b4e0ea72b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:33 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6b7b56b7-22b1-4c28-85b8-35050840d8a7 tempest-VolumesCloneNegativeTest-604209816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (740e9da1-8115-4f21-99e1-cebab51e0084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:33 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6b7b56b7-22b1-4c28-85b8-35050840d8a7 tempest-VolumesCloneNegativeTest-604209816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (740e9da1-8115-4f21-99e1-cebab51e0084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:33 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6b7b56b7-22b1-4c28-85b8-35050840d8a7 tempest-VolumesCloneNegativeTest-604209816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f95302a-935a-4b53-b6b0-ac25504f4c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:33 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6b7b56b7-22b1-4c28-85b8-35050840d8a7 tempest-VolumesCloneNegativeTest-604209816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f95302a-935a-4b53-b6b0-ac25504f4c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e2e8252-b702-4198-9020-65f3e5e6ad65', 'volume_name': 'volume-5e2e8252-b702-4198-9020-65f3e5e6ad65', 'volume_size': 2}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:33 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6b7b56b7-22b1-4c28-85b8-35050840d8a7 tempest-VolumesCloneNegativeTest-604209816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b16c62b-5896-4c78-898f-85b2d657a0d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:33 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6b7b56b7-22b1-4c28-85b8-35050840d8a7 tempest-VolumesCloneNegativeTest-604209816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b16c62b-5896-4c78-898f-85b2d657a0d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:33 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6b7b56b7-22b1-4c28-85b8-35050840d8a7 tempest-VolumesCloneNegativeTest-604209816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2434918-144d-488b-bfbe-c49e27e2cb0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:33 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-6b7b56b7-22b1-4c28-85b8-35050840d8a7 tempest-VolumesCloneNegativeTest-604209816 None] Volume 5e2e8252-b702-4198-9020-65f3e5e6ad65: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e2e8252-b702-4198-9020-65f3e5e6ad65', 'volume_size': 2} Sep 03 11:26:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6b7b56b7-22b1-4c28-85b8-35050840d8a7 tempest-VolumesCloneNegativeTest-604209816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:26:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6b7b56b7-22b1-4c28-85b8-35050840d8a7 tempest-VolumesCloneNegativeTest-604209816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:26:33 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6b7b56b7-22b1-4c28-85b8-35050840d8a7 tempest-VolumesCloneNegativeTest-604209816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-748712093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e2e8252-b702-4198-9020-65f3e5e6ad65,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5edf76d063444ae6a2b196d9e8b0c27b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:26:33Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:26:33Z,use_quota=True,user_id='89fdb9aa828243bea8b869b4e0ea72b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:26:33 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-6b7b56b7-22b1-4c28-85b8-35050840d8a7 tempest-VolumesCloneNegativeTest-604209816 None] Creating volume 5e2e8252-b702-4198-9020-65f3e5e6ad65 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:26:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6b7b56b7-22b1-4c28-85b8-35050840d8a7 tempest-VolumesCloneNegativeTest-604209816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:26:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6b7b56b7-22b1-4c28-85b8-35050840d8a7 tempest-VolumesCloneNegativeTest-604209816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:26:33 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6b7b56b7-22b1-4c28-85b8-35050840d8a7 tempest-VolumesCloneNegativeTest-604209816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:26:33 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6b7b56b7-22b1-4c28-85b8-35050840d8a7 tempest-VolumesCloneNegativeTest-604209816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:26:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6b7b56b7-22b1-4c28-85b8-35050840d8a7 tempest-VolumesCloneNegativeTest-604209816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:26:33 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6b7b56b7-22b1-4c28-85b8-35050840d8a7 tempest-VolumesCloneNegativeTest-604209816 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:26:33 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-6b7b56b7-22b1-4c28-85b8-35050840d8a7 tempest-VolumesCloneNegativeTest-604209816 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:26:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6b7b56b7-22b1-4c28-85b8-35050840d8a7 tempest-VolumesCloneNegativeTest-604209816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5e2e8252-b702-4198-9020-65f3e5e6ad65 2147483648 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:33 devstack sudo[101910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5e2e8252-b702-4198-9020-65f3e5e6ad65 2147483648 Sep 03 11:26:33 devstack sudo[101910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:33 devstack sudo[101910]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6b7b56b7-22b1-4c28-85b8-35050840d8a7 tempest-VolumesCloneNegativeTest-604209816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5e2e8252-b702-4198-9020-65f3e5e6ad65 2147483648" returned: 0 in 0.600s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6b7b56b7-22b1-4c28-85b8-35050840d8a7 tempest-VolumesCloneNegativeTest-604209816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5e2e8252-b702-4198-9020-65f3e5e6ad65 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:33 devstack sudo[101918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5e2e8252-b702-4198-9020-65f3e5e6ad65 Sep 03 11:26:33 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:34 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6b7b56b7-22b1-4c28-85b8-35050840d8a7 tempest-VolumesCloneNegativeTest-604209816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5e2e8252-b702-4198-9020-65f3e5e6ad65" returned: 0 in 0.252s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:34 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6b7b56b7-22b1-4c28-85b8-35050840d8a7 tempest-VolumesCloneNegativeTest-604209816 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:26:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6b7b56b7-22b1-4c28-85b8-35050840d8a7 tempest-VolumesCloneNegativeTest-604209816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.913s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:26:34 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6b7b56b7-22b1-4c28-85b8-35050840d8a7 tempest-VolumesCloneNegativeTest-604209816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2434918-144d-488b-bfbe-c49e27e2cb0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e2e8252-b702-4198-9020-65f3e5e6ad65', 'volume_size': 2}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:34 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6b7b56b7-22b1-4c28-85b8-35050840d8a7 tempest-VolumesCloneNegativeTest-604209816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b298a4ea-9f9f-4488-8bb6-2a20688eeabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:34 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-6b7b56b7-22b1-4c28-85b8-35050840d8a7 tempest-VolumesCloneNegativeTest-604209816 None] Volume volume-5e2e8252-b702-4198-9020-65f3e5e6ad65 (5e2e8252-b702-4198-9020-65f3e5e6ad65): created successfully Sep 03 11:26:34 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6b7b56b7-22b1-4c28-85b8-35050840d8a7 tempest-VolumesCloneNegativeTest-604209816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b298a4ea-9f9f-4488-8bb6-2a20688eeabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:34 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6b7b56b7-22b1-4c28-85b8-35050840d8a7 tempest-VolumesCloneNegativeTest-604209816 None] Flow 'volume_create_manager' (5151693c-1869-4963-b6ab-cd819c15133a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:26:34 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-6b7b56b7-22b1-4c28-85b8-35050840d8a7 tempest-VolumesCloneNegativeTest-604209816 None] Created volume successfully. Sep 03 11:26:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a95f6a41-ce94-43d5-a53f-078710c35740 tempest-VolumesCloneNegativeTest-604209816 None] Acquiring lock "cinder-5e2e8252-b702-4198-9020-65f3e5e6ad65-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:26:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a95f6a41-ce94-43d5-a53f-078710c35740 tempest-VolumesCloneNegativeTest-604209816 None] Lock "cinder-5e2e8252-b702-4198-9020-65f3e5e6ad65-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:26:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a95f6a41-ce94-43d5-a53f-078710c35740 tempest-VolumesCloneNegativeTest-604209816 None] Acquiring lock "cinder-quobyte-5e2e8252-b702-4198-9020-65f3e5e6ad65" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:26:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a95f6a41-ce94-43d5-a53f-078710c35740 tempest-VolumesCloneNegativeTest-604209816 None] Lock "cinder-quobyte-5e2e8252-b702-4198-9020-65f3e5e6ad65" acquired by "delete_volume" :: waited 0.016s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:26:35 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[d33b1006-79b5-4f63-b13e-42d32c0f26d0]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:26:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a95f6a41-ce94-43d5-a53f-078710c35740 tempest-VolumesCloneNegativeTest-604209816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5e2e8252-b702-4198-9020-65f3e5e6ad65 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:35 devstack sudo[101921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5e2e8252-b702-4198-9020-65f3e5e6ad65 Sep 03 11:26:35 devstack sudo[101921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:35 devstack sudo[101921]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a95f6a41-ce94-43d5-a53f-078710c35740 tempest-VolumesCloneNegativeTest-604209816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5e2e8252-b702-4198-9020-65f3e5e6ad65" returned: 0 in 0.371s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a95f6a41-ce94-43d5-a53f-078710c35740 tempest-VolumesCloneNegativeTest-604209816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5e2e8252-b702-4198-9020-65f3e5e6ad65 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:35 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5e2e8252-b702-4198-9020-65f3e5e6ad65 Sep 03 11:26:35 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:36 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a95f6a41-ce94-43d5-a53f-078710c35740 tempest-VolumesCloneNegativeTest-604209816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5e2e8252-b702-4198-9020-65f3e5e6ad65" returned: 0 in 0.264s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a95f6a41-ce94-43d5-a53f-078710c35740 tempest-VolumesCloneNegativeTest-604209816 None] Lock "cinder-quobyte-5e2e8252-b702-4198-9020-65f3e5e6ad65" released by "delete_volume" :: held 0.682s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:26:36 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-a95f6a41-ce94-43d5-a53f-078710c35740 tempest-VolumesCloneNegativeTest-604209816 None] Created reservations ['c0194b37-80f4-4248-aa56-516900e9bbb9', 'c7d32439-8ea8-4754-9726-425107fe9ffc', 'f6abe7c7-deb0-4837-86cb-8c669fd0d109', '46d86b7e-0991-4bd8-a69c-b80b613685fa'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:26:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a95f6a41-ce94-43d5-a53f-078710c35740 tempest-VolumesCloneNegativeTest-604209816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:26:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a95f6a41-ce94-43d5-a53f-078710c35740 tempest-VolumesCloneNegativeTest-604209816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:26:36 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a95f6a41-ce94-43d5-a53f-078710c35740 tempest-VolumesCloneNegativeTest-604209816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:26:36 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a95f6a41-ce94-43d5-a53f-078710c35740 tempest-VolumesCloneNegativeTest-604209816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:26:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a95f6a41-ce94-43d5-a53f-078710c35740 tempest-VolumesCloneNegativeTest-604209816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:26:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a95f6a41-ce94-43d5-a53f-078710c35740 tempest-VolumesCloneNegativeTest-604209816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:36 devstack sudo[101936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:26:36 devstack sudo[101936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:36 devstack sudo[101936]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a95f6a41-ce94-43d5-a53f-078710c35740 tempest-VolumesCloneNegativeTest-604209816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.302s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:36 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-a95f6a41-ce94-43d5-a53f-078710c35740 tempest-VolumesCloneNegativeTest-604209816 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:26:36 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-a95f6a41-ce94-43d5-a53f-078710c35740 tempest-VolumesCloneNegativeTest-604209816 None] Deleted volume successfully. Sep 03 11:26:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a95f6a41-ce94-43d5-a53f-078710c35740 tempest-VolumesCloneNegativeTest-604209816 None] Lock "cinder-5e2e8252-b702-4198-9020-65f3e5e6ad65-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:26:39 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ad141fc-e25c-483e-8cda-ba55f9167693 tempest-VolumesListTestJSON-1407157700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:26:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0ad141fc-e25c-483e-8cda-ba55f9167693 tempest-VolumesListTestJSON-1407157700 None] Flow 'volume_create_manager' (1924b66f-5c44-4684-a487-5096aec62270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:26:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0ad141fc-e25c-483e-8cda-ba55f9167693 tempest-VolumesListTestJSON-1407157700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf8c10c4-c574-4ef9-b5b8-81c12fecbf44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0ad141fc-e25c-483e-8cda-ba55f9167693 tempest-VolumesListTestJSON-1407157700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf8c10c4-c574-4ef9-b5b8-81c12fecbf44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1242824162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e012218-7619-47f4-a449-160d306265cd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a57a0efa5334356997243d3db7b7f9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:26:40Z,use_quota=True,user_id='516fe4f4fa4b457cb42b4de756115d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0ad141fc-e25c-483e-8cda-ba55f9167693 tempest-VolumesListTestJSON-1407157700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (623eea72-a202-4664-815b-1a9949f438fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0ad141fc-e25c-483e-8cda-ba55f9167693 tempest-VolumesListTestJSON-1407157700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (623eea72-a202-4664-815b-1a9949f438fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0ad141fc-e25c-483e-8cda-ba55f9167693 tempest-VolumesListTestJSON-1407157700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d51dcfc-30e0-45c4-9a98-631e0fa81325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0ad141fc-e25c-483e-8cda-ba55f9167693 tempest-VolumesListTestJSON-1407157700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d51dcfc-30e0-45c4-9a98-631e0fa81325) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e012218-7619-47f4-a449-160d306265cd', 'volume_name': 'volume-7e012218-7619-47f4-a449-160d306265cd', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0ad141fc-e25c-483e-8cda-ba55f9167693 tempest-VolumesListTestJSON-1407157700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f21c0e3a-3081-43d2-aa10-5afdf66b279c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0ad141fc-e25c-483e-8cda-ba55f9167693 tempest-VolumesListTestJSON-1407157700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f21c0e3a-3081-43d2-aa10-5afdf66b279c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:39 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0ad141fc-e25c-483e-8cda-ba55f9167693 tempest-VolumesListTestJSON-1407157700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a59877c-d7be-47d2-bbf2-98c9d44a746c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:39 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-0ad141fc-e25c-483e-8cda-ba55f9167693 tempest-VolumesListTestJSON-1407157700 None] Volume 7e012218-7619-47f4-a449-160d306265cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e012218-7619-47f4-a449-160d306265cd', 'volume_size': 1} Sep 03 11:26:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0ad141fc-e25c-483e-8cda-ba55f9167693 tempest-VolumesListTestJSON-1407157700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:26:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0ad141fc-e25c-483e-8cda-ba55f9167693 tempest-VolumesListTestJSON-1407157700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:26:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0ad141fc-e25c-483e-8cda-ba55f9167693 tempest-VolumesListTestJSON-1407157700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1242824162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e012218-7619-47f4-a449-160d306265cd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a57a0efa5334356997243d3db7b7f9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:26:40Z,use_quota=True,user_id='516fe4f4fa4b457cb42b4de756115d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:26:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-0ad141fc-e25c-483e-8cda-ba55f9167693 tempest-VolumesListTestJSON-1407157700 None] Creating volume 7e012218-7619-47f4-a449-160d306265cd {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:26:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0ad141fc-e25c-483e-8cda-ba55f9167693 tempest-VolumesListTestJSON-1407157700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:26:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0ad141fc-e25c-483e-8cda-ba55f9167693 tempest-VolumesListTestJSON-1407157700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:26:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0ad141fc-e25c-483e-8cda-ba55f9167693 tempest-VolumesListTestJSON-1407157700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:26:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0ad141fc-e25c-483e-8cda-ba55f9167693 tempest-VolumesListTestJSON-1407157700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:26:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0ad141fc-e25c-483e-8cda-ba55f9167693 tempest-VolumesListTestJSON-1407157700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:26:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0ad141fc-e25c-483e-8cda-ba55f9167693 tempest-VolumesListTestJSON-1407157700 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:26:39 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-0ad141fc-e25c-483e-8cda-ba55f9167693 tempest-VolumesListTestJSON-1407157700 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:26:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0ad141fc-e25c-483e-8cda-ba55f9167693 tempest-VolumesListTestJSON-1407157700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7e012218-7619-47f4-a449-160d306265cd 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:39 devstack sudo[101942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7e012218-7619-47f4-a449-160d306265cd 1073741824 Sep 03 11:26:39 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:40 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0ad141fc-e25c-483e-8cda-ba55f9167693 tempest-VolumesListTestJSON-1407157700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7e012218-7619-47f4-a449-160d306265cd 1073741824" returned: 0 in 0.465s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0ad141fc-e25c-483e-8cda-ba55f9167693 tempest-VolumesListTestJSON-1407157700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7e012218-7619-47f4-a449-160d306265cd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:40 devstack sudo[101947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7e012218-7619-47f4-a449-160d306265cd Sep 03 11:26:40 devstack sudo[101947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:40 devstack sudo[101947]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0ad141fc-e25c-483e-8cda-ba55f9167693 tempest-VolumesListTestJSON-1407157700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7e012218-7619-47f4-a449-160d306265cd" returned: 0 in 0.253s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:40 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0ad141fc-e25c-483e-8cda-ba55f9167693 tempest-VolumesListTestJSON-1407157700 None] <== create_volume: return (766ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:26:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0ad141fc-e25c-483e-8cda-ba55f9167693 tempest-VolumesListTestJSON-1407157700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:26:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0ad141fc-e25c-483e-8cda-ba55f9167693 tempest-VolumesListTestJSON-1407157700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a59877c-d7be-47d2-bbf2-98c9d44a746c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e012218-7619-47f4-a449-160d306265cd', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0ad141fc-e25c-483e-8cda-ba55f9167693 tempest-VolumesListTestJSON-1407157700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (261ec813-01ce-4b39-8b76-1c1e9b5362d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:40 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-0ad141fc-e25c-483e-8cda-ba55f9167693 tempest-VolumesListTestJSON-1407157700 None] Volume volume-7e012218-7619-47f4-a449-160d306265cd (7e012218-7619-47f4-a449-160d306265cd): created successfully Sep 03 11:26:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0ad141fc-e25c-483e-8cda-ba55f9167693 tempest-VolumesListTestJSON-1407157700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (261ec813-01ce-4b39-8b76-1c1e9b5362d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:40 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0ad141fc-e25c-483e-8cda-ba55f9167693 tempest-VolumesListTestJSON-1407157700 None] Flow 'volume_create_manager' (1924b66f-5c44-4684-a487-5096aec62270) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:26:40 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-0ad141fc-e25c-483e-8cda-ba55f9167693 tempest-VolumesListTestJSON-1407157700 None] Created volume successfully. Sep 03 11:26:42 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-032a2103-fc80-4a57-b935-c8dd6ea6f653 tempest-VolumesListTestJSON-1407157700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:26:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-032a2103-fc80-4a57-b935-c8dd6ea6f653 tempest-VolumesListTestJSON-1407157700 None] Flow 'volume_create_manager' (f88b9522-8d32-4648-b943-2fd9f94447d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:26:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-032a2103-fc80-4a57-b935-c8dd6ea6f653 tempest-VolumesListTestJSON-1407157700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8cf37b6-d50d-417c-a394-058a283706fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-032a2103-fc80-4a57-b935-c8dd6ea6f653 tempest-VolumesListTestJSON-1407157700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8cf37b6-d50d-417c-a394-058a283706fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1361670920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cd957e5-6e7e-41c4-b34a-df32be785ccc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a57a0efa5334356997243d3db7b7f9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:26:42Z,use_quota=True,user_id='516fe4f4fa4b457cb42b4de756115d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-032a2103-fc80-4a57-b935-c8dd6ea6f653 tempest-VolumesListTestJSON-1407157700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d27df623-7c9b-44bf-9965-3d0fbe8e9ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-032a2103-fc80-4a57-b935-c8dd6ea6f653 tempest-VolumesListTestJSON-1407157700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d27df623-7c9b-44bf-9965-3d0fbe8e9ce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-032a2103-fc80-4a57-b935-c8dd6ea6f653 tempest-VolumesListTestJSON-1407157700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a43c02-7151-40b0-b11b-38328b3d4586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-032a2103-fc80-4a57-b935-c8dd6ea6f653 tempest-VolumesListTestJSON-1407157700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a43c02-7151-40b0-b11b-38328b3d4586) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cd957e5-6e7e-41c4-b34a-df32be785ccc', 'volume_name': 'volume-6cd957e5-6e7e-41c4-b34a-df32be785ccc', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-032a2103-fc80-4a57-b935-c8dd6ea6f653 tempest-VolumesListTestJSON-1407157700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a56af5-5ae7-44d8-b0e8-02dfac703f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-032a2103-fc80-4a57-b935-c8dd6ea6f653 tempest-VolumesListTestJSON-1407157700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a56af5-5ae7-44d8-b0e8-02dfac703f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:42 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-032a2103-fc80-4a57-b935-c8dd6ea6f653 tempest-VolumesListTestJSON-1407157700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d960346-5a32-4f50-8203-bd7fbbaae805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:42 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-032a2103-fc80-4a57-b935-c8dd6ea6f653 tempest-VolumesListTestJSON-1407157700 None] Volume 6cd957e5-6e7e-41c4-b34a-df32be785ccc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cd957e5-6e7e-41c4-b34a-df32be785ccc', 'volume_size': 1} Sep 03 11:26:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-032a2103-fc80-4a57-b935-c8dd6ea6f653 tempest-VolumesListTestJSON-1407157700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:26:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-032a2103-fc80-4a57-b935-c8dd6ea6f653 tempest-VolumesListTestJSON-1407157700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:26:42 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-032a2103-fc80-4a57-b935-c8dd6ea6f653 tempest-VolumesListTestJSON-1407157700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:26:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1361670920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cd957e5-6e7e-41c4-b34a-df32be785ccc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a57a0efa5334356997243d3db7b7f9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:26:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:26:42Z,use_quota=True,user_id='516fe4f4fa4b457cb42b4de756115d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:26:42 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-032a2103-fc80-4a57-b935-c8dd6ea6f653 tempest-VolumesListTestJSON-1407157700 None] Creating volume 6cd957e5-6e7e-41c4-b34a-df32be785ccc {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:26:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-032a2103-fc80-4a57-b935-c8dd6ea6f653 tempest-VolumesListTestJSON-1407157700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:26:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-032a2103-fc80-4a57-b935-c8dd6ea6f653 tempest-VolumesListTestJSON-1407157700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:26:42 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-032a2103-fc80-4a57-b935-c8dd6ea6f653 tempest-VolumesListTestJSON-1407157700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:26:42 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-032a2103-fc80-4a57-b935-c8dd6ea6f653 tempest-VolumesListTestJSON-1407157700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:26:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-032a2103-fc80-4a57-b935-c8dd6ea6f653 tempest-VolumesListTestJSON-1407157700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:26:42 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-032a2103-fc80-4a57-b935-c8dd6ea6f653 tempest-VolumesListTestJSON-1407157700 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:26:42 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-032a2103-fc80-4a57-b935-c8dd6ea6f653 tempest-VolumesListTestJSON-1407157700 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:26:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-032a2103-fc80-4a57-b935-c8dd6ea6f653 tempest-VolumesListTestJSON-1407157700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6cd957e5-6e7e-41c4-b34a-df32be785ccc 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:42 devstack sudo[101950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6cd957e5-6e7e-41c4-b34a-df32be785ccc 1073741824 Sep 03 11:26:42 devstack sudo[101950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:42 devstack sudo[101950]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-032a2103-fc80-4a57-b935-c8dd6ea6f653 tempest-VolumesListTestJSON-1407157700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6cd957e5-6e7e-41c4-b34a-df32be785ccc 1073741824" returned: 0 in 0.425s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-032a2103-fc80-4a57-b935-c8dd6ea6f653 tempest-VolumesListTestJSON-1407157700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6cd957e5-6e7e-41c4-b34a-df32be785ccc {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:42 devstack sudo[101956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6cd957e5-6e7e-41c4-b34a-df32be785ccc Sep 03 11:26:42 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:43 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-032a2103-fc80-4a57-b935-c8dd6ea6f653 tempest-VolumesListTestJSON-1407157700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6cd957e5-6e7e-41c4-b34a-df32be785ccc" returned: 0 in 0.247s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-032a2103-fc80-4a57-b935-c8dd6ea6f653 tempest-VolumesListTestJSON-1407157700 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:26:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-032a2103-fc80-4a57-b935-c8dd6ea6f653 tempest-VolumesListTestJSON-1407157700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.719s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:26:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-032a2103-fc80-4a57-b935-c8dd6ea6f653 tempest-VolumesListTestJSON-1407157700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d960346-5a32-4f50-8203-bd7fbbaae805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cd957e5-6e7e-41c4-b34a-df32be785ccc', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-032a2103-fc80-4a57-b935-c8dd6ea6f653 tempest-VolumesListTestJSON-1407157700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbfb7c3d-0f3d-4ec8-95cd-4539b8e0fe2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:43 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-032a2103-fc80-4a57-b935-c8dd6ea6f653 tempest-VolumesListTestJSON-1407157700 None] Volume volume-6cd957e5-6e7e-41c4-b34a-df32be785ccc (6cd957e5-6e7e-41c4-b34a-df32be785ccc): created successfully Sep 03 11:26:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-032a2103-fc80-4a57-b935-c8dd6ea6f653 tempest-VolumesListTestJSON-1407157700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbfb7c3d-0f3d-4ec8-95cd-4539b8e0fe2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-032a2103-fc80-4a57-b935-c8dd6ea6f653 tempest-VolumesListTestJSON-1407157700 None] Flow 'volume_create_manager' (f88b9522-8d32-4648-b943-2fd9f94447d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:26:43 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-032a2103-fc80-4a57-b935-c8dd6ea6f653 tempest-VolumesListTestJSON-1407157700 None] Created volume successfully. Sep 03 11:26:43 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdcdac2d-653a-46f6-b2fc-77f52eb64190 tempest-VolumesListTestJSON-1407157700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:26:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bdcdac2d-653a-46f6-b2fc-77f52eb64190 tempest-VolumesListTestJSON-1407157700 None] Flow 'volume_create_manager' (4232d7a5-ad1a-4035-992d-ba7888160086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:26:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bdcdac2d-653a-46f6-b2fc-77f52eb64190 tempest-VolumesListTestJSON-1407157700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7411a4da-6eab-4622-b132-05f661d3989e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bdcdac2d-653a-46f6-b2fc-77f52eb64190 tempest-VolumesListTestJSON-1407157700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7411a4da-6eab-4622-b132-05f661d3989e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1265239247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32f92487-4e9c-411b-87cd-cdfd5c0300da,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a57a0efa5334356997243d3db7b7f9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:26:44Z,use_quota=True,user_id='516fe4f4fa4b457cb42b4de756115d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bdcdac2d-653a-46f6-b2fc-77f52eb64190 tempest-VolumesListTestJSON-1407157700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4844e83-261a-4746-b1da-12304870ecec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bdcdac2d-653a-46f6-b2fc-77f52eb64190 tempest-VolumesListTestJSON-1407157700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4844e83-261a-4746-b1da-12304870ecec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bdcdac2d-653a-46f6-b2fc-77f52eb64190 tempest-VolumesListTestJSON-1407157700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64a902f7-8c16-4079-8d24-b778a7b00e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bdcdac2d-653a-46f6-b2fc-77f52eb64190 tempest-VolumesListTestJSON-1407157700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64a902f7-8c16-4079-8d24-b778a7b00e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32f92487-4e9c-411b-87cd-cdfd5c0300da', 'volume_name': 'volume-32f92487-4e9c-411b-87cd-cdfd5c0300da', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bdcdac2d-653a-46f6-b2fc-77f52eb64190 tempest-VolumesListTestJSON-1407157700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14e0e245-3718-4862-bd64-24c36bf1bf15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bdcdac2d-653a-46f6-b2fc-77f52eb64190 tempest-VolumesListTestJSON-1407157700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14e0e245-3718-4862-bd64-24c36bf1bf15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bdcdac2d-653a-46f6-b2fc-77f52eb64190 tempest-VolumesListTestJSON-1407157700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7afeac69-645b-42d0-8f86-8adf93a2da2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:43 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-bdcdac2d-653a-46f6-b2fc-77f52eb64190 tempest-VolumesListTestJSON-1407157700 None] Volume 32f92487-4e9c-411b-87cd-cdfd5c0300da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32f92487-4e9c-411b-87cd-cdfd5c0300da', 'volume_size': 1} Sep 03 11:26:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bdcdac2d-653a-46f6-b2fc-77f52eb64190 tempest-VolumesListTestJSON-1407157700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:26:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bdcdac2d-653a-46f6-b2fc-77f52eb64190 tempest-VolumesListTestJSON-1407157700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:26:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-bdcdac2d-653a-46f6-b2fc-77f52eb64190 tempest-VolumesListTestJSON-1407157700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:26:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1265239247',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32f92487-4e9c-411b-87cd-cdfd5c0300da,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a57a0efa5334356997243d3db7b7f9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:26:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:26:44Z,use_quota=True,user_id='516fe4f4fa4b457cb42b4de756115d82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:26:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-bdcdac2d-653a-46f6-b2fc-77f52eb64190 tempest-VolumesListTestJSON-1407157700 None] Creating volume 32f92487-4e9c-411b-87cd-cdfd5c0300da {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:26:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bdcdac2d-653a-46f6-b2fc-77f52eb64190 tempest-VolumesListTestJSON-1407157700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:26:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bdcdac2d-653a-46f6-b2fc-77f52eb64190 tempest-VolumesListTestJSON-1407157700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:26:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-bdcdac2d-653a-46f6-b2fc-77f52eb64190 tempest-VolumesListTestJSON-1407157700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:26:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-bdcdac2d-653a-46f6-b2fc-77f52eb64190 tempest-VolumesListTestJSON-1407157700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:26:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bdcdac2d-653a-46f6-b2fc-77f52eb64190 tempest-VolumesListTestJSON-1407157700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:26:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-bdcdac2d-653a-46f6-b2fc-77f52eb64190 tempest-VolumesListTestJSON-1407157700 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:26:43 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-bdcdac2d-653a-46f6-b2fc-77f52eb64190 tempest-VolumesListTestJSON-1407157700 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:26:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bdcdac2d-653a-46f6-b2fc-77f52eb64190 tempest-VolumesListTestJSON-1407157700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-32f92487-4e9c-411b-87cd-cdfd5c0300da 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:43 devstack sudo[101959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-32f92487-4e9c-411b-87cd-cdfd5c0300da 1073741824 Sep 03 11:26:43 devstack sudo[101959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:44 devstack sudo[101959]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bdcdac2d-653a-46f6-b2fc-77f52eb64190 tempest-VolumesListTestJSON-1407157700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-32f92487-4e9c-411b-87cd-cdfd5c0300da 1073741824" returned: 0 in 0.468s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bdcdac2d-653a-46f6-b2fc-77f52eb64190 tempest-VolumesListTestJSON-1407157700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-32f92487-4e9c-411b-87cd-cdfd5c0300da {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:44 devstack sudo[101965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-32f92487-4e9c-411b-87cd-cdfd5c0300da Sep 03 11:26:44 devstack sudo[101965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:44 devstack sudo[101965]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bdcdac2d-653a-46f6-b2fc-77f52eb64190 tempest-VolumesListTestJSON-1407157700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-32f92487-4e9c-411b-87cd-cdfd5c0300da" returned: 0 in 0.253s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-bdcdac2d-653a-46f6-b2fc-77f52eb64190 tempest-VolumesListTestJSON-1407157700 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:26:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bdcdac2d-653a-46f6-b2fc-77f52eb64190 tempest-VolumesListTestJSON-1407157700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:26:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bdcdac2d-653a-46f6-b2fc-77f52eb64190 tempest-VolumesListTestJSON-1407157700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7afeac69-645b-42d0-8f86-8adf93a2da2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32f92487-4e9c-411b-87cd-cdfd5c0300da', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bdcdac2d-653a-46f6-b2fc-77f52eb64190 tempest-VolumesListTestJSON-1407157700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94fa7ac9-fc68-4210-9d0f-effa1dd9f02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:44 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-bdcdac2d-653a-46f6-b2fc-77f52eb64190 tempest-VolumesListTestJSON-1407157700 None] Volume volume-32f92487-4e9c-411b-87cd-cdfd5c0300da (32f92487-4e9c-411b-87cd-cdfd5c0300da): created successfully Sep 03 11:26:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bdcdac2d-653a-46f6-b2fc-77f52eb64190 tempest-VolumesListTestJSON-1407157700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94fa7ac9-fc68-4210-9d0f-effa1dd9f02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bdcdac2d-653a-46f6-b2fc-77f52eb64190 tempest-VolumesListTestJSON-1407157700 None] Flow 'volume_create_manager' (4232d7a5-ad1a-4035-992d-ba7888160086) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:26:44 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-bdcdac2d-653a-46f6-b2fc-77f52eb64190 tempest-VolumesListTestJSON-1407157700 None] Created volume successfully. Sep 03 11:26:46 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-64a93cac-e35a-44ec-a7d8-db91e3599de3 tempest-VolumesListTestJSON-1407157700 None] Acquiring lock "cinder-32f92487-4e9c-411b-87cd-cdfd5c0300da-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:26:46 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-64a93cac-e35a-44ec-a7d8-db91e3599de3 tempest-VolumesListTestJSON-1407157700 None] Lock "cinder-32f92487-4e9c-411b-87cd-cdfd5c0300da-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:26:47 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-64a93cac-e35a-44ec-a7d8-db91e3599de3 tempest-VolumesListTestJSON-1407157700 None] Acquiring lock "cinder-quobyte-32f92487-4e9c-411b-87cd-cdfd5c0300da" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:26:47 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-64a93cac-e35a-44ec-a7d8-db91e3599de3 tempest-VolumesListTestJSON-1407157700 None] Lock "cinder-quobyte-32f92487-4e9c-411b-87cd-cdfd5c0300da" acquired by "delete_volume" :: waited 0.022s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:26:47 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[2baac112-09b7-405c-b9a0-9daad7a253a5]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:26:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-64a93cac-e35a-44ec-a7d8-db91e3599de3 tempest-VolumesListTestJSON-1407157700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-32f92487-4e9c-411b-87cd-cdfd5c0300da {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:47 devstack sudo[101968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-32f92487-4e9c-411b-87cd-cdfd5c0300da Sep 03 11:26:47 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:47 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-64a93cac-e35a-44ec-a7d8-db91e3599de3 tempest-VolumesListTestJSON-1407157700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-32f92487-4e9c-411b-87cd-cdfd5c0300da" returned: 0 in 0.402s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-64a93cac-e35a-44ec-a7d8-db91e3599de3 tempest-VolumesListTestJSON-1407157700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-32f92487-4e9c-411b-87cd-cdfd5c0300da {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:47 devstack sudo[101976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-32f92487-4e9c-411b-87cd-cdfd5c0300da Sep 03 11:26:47 devstack sudo[101976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:47 devstack sudo[101976]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-64a93cac-e35a-44ec-a7d8-db91e3599de3 tempest-VolumesListTestJSON-1407157700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-32f92487-4e9c-411b-87cd-cdfd5c0300da" returned: 0 in 0.287s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:47 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-64a93cac-e35a-44ec-a7d8-db91e3599de3 tempest-VolumesListTestJSON-1407157700 None] Lock "cinder-quobyte-32f92487-4e9c-411b-87cd-cdfd5c0300da" released by "delete_volume" :: held 0.741s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:26:47 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-64a93cac-e35a-44ec-a7d8-db91e3599de3 tempest-VolumesListTestJSON-1407157700 None] Created reservations ['abdaa29f-c44a-483f-9f18-39d6a65898a6', '41bfa0ed-3064-4e9d-91d4-8a76c272d774', 'd9f89ea6-f6ee-4e09-a97b-189d77abca35', '7e315926-d70b-49e2-8d13-c1fdf74c0cb4'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:26:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-64a93cac-e35a-44ec-a7d8-db91e3599de3 tempest-VolumesListTestJSON-1407157700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:26:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-64a93cac-e35a-44ec-a7d8-db91e3599de3 tempest-VolumesListTestJSON-1407157700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:26:47 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-64a93cac-e35a-44ec-a7d8-db91e3599de3 tempest-VolumesListTestJSON-1407157700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:26:47 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-64a93cac-e35a-44ec-a7d8-db91e3599de3 tempest-VolumesListTestJSON-1407157700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:26:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-64a93cac-e35a-44ec-a7d8-db91e3599de3 tempest-VolumesListTestJSON-1407157700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:26:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-64a93cac-e35a-44ec-a7d8-db91e3599de3 tempest-VolumesListTestJSON-1407157700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:47 devstack sudo[101979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:26:47 devstack sudo[101979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:48 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d4730cb4-c83c-4bb0-ab47-6090e99de08e tempest-VolumesListTestJSON-1407157700 None] Acquiring lock "cinder-6cd957e5-6e7e-41c4-b34a-df32be785ccc-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:26:48 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d4730cb4-c83c-4bb0-ab47-6090e99de08e tempest-VolumesListTestJSON-1407157700 None] Lock "cinder-6cd957e5-6e7e-41c4-b34a-df32be785ccc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:26:48 devstack sudo[101979]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-64a93cac-e35a-44ec-a7d8-db91e3599de3 tempest-VolumesListTestJSON-1407157700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.353s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:48 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-64a93cac-e35a-44ec-a7d8-db91e3599de3 tempest-VolumesListTestJSON-1407157700 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:26:48 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d4730cb4-c83c-4bb0-ab47-6090e99de08e tempest-VolumesListTestJSON-1407157700 None] Acquiring lock "cinder-quobyte-6cd957e5-6e7e-41c4-b34a-df32be785ccc" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:26:48 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-64a93cac-e35a-44ec-a7d8-db91e3599de3 tempest-VolumesListTestJSON-1407157700 None] Deleted volume successfully. Sep 03 11:26:48 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d4730cb4-c83c-4bb0-ab47-6090e99de08e tempest-VolumesListTestJSON-1407157700 None] Lock "cinder-quobyte-6cd957e5-6e7e-41c4-b34a-df32be785ccc" acquired by "delete_volume" :: waited 0.019s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:26:48 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-64a93cac-e35a-44ec-a7d8-db91e3599de3 tempest-VolumesListTestJSON-1407157700 None] Lock "cinder-32f92487-4e9c-411b-87cd-cdfd5c0300da-delete_volume" released by "delete_volume" :: held 1.369s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:26:48 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0e5f88-98c2-429d-a168-dfbc65009c33]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:26:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d4730cb4-c83c-4bb0-ab47-6090e99de08e tempest-VolumesListTestJSON-1407157700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6cd957e5-6e7e-41c4-b34a-df32be785ccc {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:48 devstack sudo[101983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6cd957e5-6e7e-41c4-b34a-df32be785ccc Sep 03 11:26:48 devstack sudo[101983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:48 devstack sudo[101983]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d4730cb4-c83c-4bb0-ab47-6090e99de08e tempest-VolumesListTestJSON-1407157700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6cd957e5-6e7e-41c4-b34a-df32be785ccc" returned: 0 in 0.358s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d4730cb4-c83c-4bb0-ab47-6090e99de08e tempest-VolumesListTestJSON-1407157700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6cd957e5-6e7e-41c4-b34a-df32be785ccc {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:48 devstack sudo[101988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6cd957e5-6e7e-41c4-b34a-df32be785ccc Sep 03 11:26:48 devstack sudo[101988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:48 devstack sudo[101988]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d4730cb4-c83c-4bb0-ab47-6090e99de08e tempest-VolumesListTestJSON-1407157700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6cd957e5-6e7e-41c4-b34a-df32be785ccc" returned: 0 in 0.268s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:49 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d4730cb4-c83c-4bb0-ab47-6090e99de08e tempest-VolumesListTestJSON-1407157700 None] Lock "cinder-quobyte-6cd957e5-6e7e-41c4-b34a-df32be785ccc" released by "delete_volume" :: held 0.676s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:26:49 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-d4730cb4-c83c-4bb0-ab47-6090e99de08e tempest-VolumesListTestJSON-1407157700 None] Created reservations ['728fc177-6744-4f3e-922b-eb4d479eeea9', '7cdbc053-67b6-4e2e-8c84-bda28d21ca69', '06987826-1557-4e4b-b7a8-c788958b0423', '025202bd-c242-4f18-93c0-407757a67f1e'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:26:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d4730cb4-c83c-4bb0-ab47-6090e99de08e tempest-VolumesListTestJSON-1407157700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:26:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d4730cb4-c83c-4bb0-ab47-6090e99de08e tempest-VolumesListTestJSON-1407157700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:26:49 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d4730cb4-c83c-4bb0-ab47-6090e99de08e tempest-VolumesListTestJSON-1407157700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:26:49 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d4730cb4-c83c-4bb0-ab47-6090e99de08e tempest-VolumesListTestJSON-1407157700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:26:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d4730cb4-c83c-4bb0-ab47-6090e99de08e tempest-VolumesListTestJSON-1407157700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:26:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d4730cb4-c83c-4bb0-ab47-6090e99de08e tempest-VolumesListTestJSON-1407157700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:49 devstack sudo[101991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:26:49 devstack sudo[101991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:49 devstack sudo[101991]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d4730cb4-c83c-4bb0-ab47-6090e99de08e tempest-VolumesListTestJSON-1407157700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.281s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:49 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-d4730cb4-c83c-4bb0-ab47-6090e99de08e tempest-VolumesListTestJSON-1407157700 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:26:49 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-d4730cb4-c83c-4bb0-ab47-6090e99de08e tempest-VolumesListTestJSON-1407157700 None] Deleted volume successfully. Sep 03 11:26:49 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d4730cb4-c83c-4bb0-ab47-6090e99de08e tempest-VolumesListTestJSON-1407157700 None] Lock "cinder-6cd957e5-6e7e-41c4-b34a-df32be785ccc-delete_volume" released by "delete_volume" :: held 1.215s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:26:49 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-007d7312-5fe7-45c7-a45e-0b8d427f898f tempest-VolumesListTestJSON-1407157700 None] Acquiring lock "cinder-7e012218-7619-47f4-a449-160d306265cd-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:26:49 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-007d7312-5fe7-45c7-a45e-0b8d427f898f tempest-VolumesListTestJSON-1407157700 None] Lock "cinder-7e012218-7619-47f4-a449-160d306265cd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:26:49 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-007d7312-5fe7-45c7-a45e-0b8d427f898f tempest-VolumesListTestJSON-1407157700 None] Acquiring lock "cinder-quobyte-7e012218-7619-47f4-a449-160d306265cd" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:26:49 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-007d7312-5fe7-45c7-a45e-0b8d427f898f tempest-VolumesListTestJSON-1407157700 None] Lock "cinder-quobyte-7e012218-7619-47f4-a449-160d306265cd" acquired by "delete_volume" :: waited 0.016s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:26:49 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b2b031b-fd50-4860-97c8-f0f1479603bf]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:26:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-007d7312-5fe7-45c7-a45e-0b8d427f898f tempest-VolumesListTestJSON-1407157700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7e012218-7619-47f4-a449-160d306265cd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:49 devstack sudo[101994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7e012218-7619-47f4-a449-160d306265cd Sep 03 11:26:49 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:50 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-007d7312-5fe7-45c7-a45e-0b8d427f898f tempest-VolumesListTestJSON-1407157700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7e012218-7619-47f4-a449-160d306265cd" returned: 0 in 0.389s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-007d7312-5fe7-45c7-a45e-0b8d427f898f tempest-VolumesListTestJSON-1407157700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7e012218-7619-47f4-a449-160d306265cd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:50 devstack sudo[101999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7e012218-7619-47f4-a449-160d306265cd Sep 03 11:26:50 devstack sudo[101999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:50 devstack sudo[101999]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-007d7312-5fe7-45c7-a45e-0b8d427f898f tempest-VolumesListTestJSON-1407157700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7e012218-7619-47f4-a449-160d306265cd" returned: 0 in 0.262s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:50 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-007d7312-5fe7-45c7-a45e-0b8d427f898f tempest-VolumesListTestJSON-1407157700 None] Lock "cinder-quobyte-7e012218-7619-47f4-a449-160d306265cd" released by "delete_volume" :: held 0.693s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:26:50 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-007d7312-5fe7-45c7-a45e-0b8d427f898f tempest-VolumesListTestJSON-1407157700 None] Created reservations ['78afbe03-5478-4e08-b282-550f871441e2', 'c7e73272-0ecf-41ae-a52b-18965b76e5ed', '34075144-e031-48b1-8a35-b56a03cef093', '07e00922-fd61-4938-aa79-d6fb161fb2df'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:26:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-007d7312-5fe7-45c7-a45e-0b8d427f898f tempest-VolumesListTestJSON-1407157700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:26:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-007d7312-5fe7-45c7-a45e-0b8d427f898f tempest-VolumesListTestJSON-1407157700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:26:50 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-007d7312-5fe7-45c7-a45e-0b8d427f898f tempest-VolumesListTestJSON-1407157700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:26:50 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-007d7312-5fe7-45c7-a45e-0b8d427f898f tempest-VolumesListTestJSON-1407157700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:26:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-007d7312-5fe7-45c7-a45e-0b8d427f898f tempest-VolumesListTestJSON-1407157700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:26:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-007d7312-5fe7-45c7-a45e-0b8d427f898f tempest-VolumesListTestJSON-1407157700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:50 devstack sudo[102002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:26:50 devstack sudo[102002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:50 devstack sudo[102002]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-007d7312-5fe7-45c7-a45e-0b8d427f898f tempest-VolumesListTestJSON-1407157700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.242s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:50 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-007d7312-5fe7-45c7-a45e-0b8d427f898f tempest-VolumesListTestJSON-1407157700 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:26:50 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-007d7312-5fe7-45c7-a45e-0b8d427f898f tempest-VolumesListTestJSON-1407157700 None] Deleted volume successfully. Sep 03 11:26:50 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-007d7312-5fe7-45c7-a45e-0b8d427f898f tempest-VolumesListTestJSON-1407157700 None] Lock "cinder-7e012218-7619-47f4-a449-160d306265cd-delete_volume" released by "delete_volume" :: held 1.187s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:26:54 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:26:54 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Flow 'volume_create_manager' (1926810e-399b-4927-a1ff-afabf9344d12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:26:54 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f071bca4-7654-4a26-91f2-24f0f0997a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:54 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f071bca4-7654-4a26-91f2-24f0f0997a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1729020037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ffd4746-cd4b-4505-abd8-28dd84566e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcdf778d47cb4c86ac761209a17ea1fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:26:54Z,use_quota=True,user_id='177e3488520b48169d7cd5f6808a8367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:54 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (464233ca-71fe-46ca-aeb4-fb662b6dea8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:54 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (464233ca-71fe-46ca-aeb4-fb662b6dea8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:54 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2de90691-07fe-44eb-9e94-51203be44c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:54 devstack cinder-volume[87038]: DEBUG cinder.image.glance [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Creating Keystone auth plugin from conf {{(pid=87038) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 11:26:54 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2de90691-07fe-44eb-9e94-51203be44c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3ffd4746-cd4b-4505-abd8-28dd84566e22', 'volume_name': 'volume-3ffd4746-cd4b-4505-abd8-28dd84566e22', 'volume_size': 1, 'image_id': 'e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72db6f41ce954ca898cc9f539a1cd3c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'created_at': datetime.datetime(2026, 9, 3, 9, 7, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 7, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:54 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad9f8525-350e-4614-bdf6-fc59239d16f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:54 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad9f8525-350e-4614-bdf6-fc59239d16f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:54 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8098e81d-a717-4995-b36f-54ebf31e0a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:54 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Volume 3ffd4746-cd4b-4505-abd8-28dd84566e22: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3ffd4746-cd4b-4505-abd8-28dd84566e22', 'volume_size': 1, 'image_id': 'e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72db6f41ce954ca898cc9f539a1cd3c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'created_at': datetime.datetime(2026, 9, 3, 9, 7, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 7, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 03 11:26:54 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Trying to clone 3ffd4746-cd4b-4505-abd8-28dd84566e22 from image e1b59027-cb2e-4dc7-b35a-2801c7a053de at location (None, [{'url': 'file:///opt/stack/data/glance/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'metadata': {}}]). {{(pid=87038) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 11:26:54 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_tenv3y62devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87038) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 11:26:54 devstack cinder-volume[87038]: INFO cinder.image.image_utils [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Image download 20.69 MB at 20.69 MB/s Sep 03 11:26:54 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[82e561b8-8fbb-46a2-afce-9784ccb043b9]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:26:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_tenv3y62devstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:55 devstack sudo[102006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_tenv3y62devstack@QuobyteHD Sep 03 11:26:55 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:55 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_tenv3y62devstack@QuobyteHD" returned: 0 in 0.337s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:55 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Temporary image e1b59027-cb2e-4dc7-b35a-2801c7a053de is fetched for user 177e3488520b48169d7cd5f6808a8367. {{(pid=87038) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 11:26:55 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[234239ee-55f4-4147-9abb-4b322e90fdc1]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:26:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_tenv3y62devstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:55 devstack sudo[102011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_tenv3y62devstack@QuobyteHD Sep 03 11:26:55 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:55 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_tenv3y62devstack@QuobyteHD" returned: 0 in 0.332s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:26:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:26:55 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1729020037',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ffd4746-cd4b-4505-abd8-28dd84566e22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcdf778d47cb4c86ac761209a17ea1fe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:26:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:26:54Z,use_quota=True,user_id='177e3488520b48169d7cd5f6808a8367',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:26:55 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Creating volume 3ffd4746-cd4b-4505-abd8-28dd84566e22 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:26:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:26:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:26:55 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:26:55 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:26:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:26:55 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:26:55 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:26:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-3ffd4746-cd4b-4505-abd8-28dd84566e22 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:55 devstack sudo[102016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-3ffd4746-cd4b-4505-abd8-28dd84566e22 1073741824 Sep 03 11:26:55 devstack sudo[102016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:56 devstack sudo[102016]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-3ffd4746-cd4b-4505-abd8-28dd84566e22 1073741824" returned: 0 in 0.430s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-3ffd4746-cd4b-4505-abd8-28dd84566e22 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:56 devstack sudo[102022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-3ffd4746-cd4b-4505-abd8-28dd84566e22 Sep 03 11:26:56 devstack sudo[102022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:56 devstack sudo[102022]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-3ffd4746-cd4b-4505-abd8-28dd84566e22" returned: 0 in 0.259s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:26:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:26:56 devstack cinder-volume[87038]: DEBUG cinder.volume.volume_utils [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Attempting download of e1b59027-cb2e-4dc7-b35a-2801c7a053de ((None, [{'url': 'file:///opt/stack/data/glance/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'metadata': {}}])) to volume 3ffd4746-cd4b-4505-abd8-28dd84566e22. {{(pid=87038) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 11:26:56 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16d02b4-ffc1-4964-9c28-80aacc1e7be8]: (4, 'raw') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:26:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1b59027-cb2e-4dc7-b35a-2801c7a053de_rvr67qeo {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:56 devstack sudo[102025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1b59027-cb2e-4dc7-b35a-2801c7a053de_rvr67qeo Sep 03 11:26:56 devstack sudo[102025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:56 devstack sudo[102025]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e1b59027-cb2e-4dc7-b35a-2801c7a053de_rvr67qeo" returned: 0 in 0.320s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1b59027-cb2e-4dc7-b35a-2801c7a053de_rvr67qeo {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:56 devstack sudo[102029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1b59027-cb2e-4dc7-b35a-2801c7a053de_rvr67qeo Sep 03 11:26:56 devstack sudo[102029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:57 devstack sudo[102029]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1b59027-cb2e-4dc7-b35a-2801c7a053de_rvr67qeo" returned: 1 in 0.314s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e1b59027-cb2e-4dc7-b35a-2801c7a053de_rvr67qeo' failed. Not Retrying. {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:26:57 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef8b545-a3dd-46f2-a87b-c3a753c6745c]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:26:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_tenv3y62devstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:57 devstack sudo[102033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_tenv3y62devstack@QuobyteHD Sep 03 11:26:57 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:57 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_tenv3y62devstack@QuobyteHD" returned: 0 in 0.427s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:57 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] e1b59027-cb2e-4dc7-b35a-2801c7a053de was qcow2, converting to qcow2 {{(pid=87038) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 11:26:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_tenv3y62devstack@QuobyteHD /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-3ffd4746-cd4b-4505-abd8-28dd84566e22 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:57 devstack sudo[102038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_tenv3y62devstack@QuobyteHD /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-3ffd4746-cd4b-4505-abd8-28dd84566e22 Sep 03 11:26:57 devstack sudo[102038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:59 devstack sudo[102038]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_tenv3y62devstack@QuobyteHD /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-3ffd4746-cd4b-4505-abd8-28dd84566e22" returned: 0 in 1.791s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:59 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e1b59027-cb2e-4dc7-b35a-2801c7a053de_tenv3y62devstack@QuobyteHD, size 112.00 MB, duration 1.79 sec, destination /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-3ffd4746-cd4b-4505-abd8-28dd84566e22 {{(pid=87038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:26:59 devstack cinder-volume[87038]: INFO cinder.image.image_utils [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Converted 112.00 MB image at 62.50 MB/s Sep 03 11:26:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-3ffd4746-cd4b-4505-abd8-28dd84566e22 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:26:59 devstack sudo[102049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-3ffd4746-cd4b-4505-abd8-28dd84566e22 1G Sep 03 11:26:59 devstack sudo[102049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:26:59 devstack sudo[102049]: pam_unix(sudo:session): session closed for user root Sep 03 11:26:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-3ffd4746-cd4b-4505-abd8-28dd84566e22 1G" returned: 0 in 0.343s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:26:59 devstack cinder-volume[87038]: DEBUG cinder.volume.volume_utils [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Downloaded image e1b59027-cb2e-4dc7-b35a-2801c7a053de ((None, [{'url': 'file:///opt/stack/data/glance/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'metadata': {}}])) to volume 3ffd4746-cd4b-4505-abd8-28dd84566e22 successfully. {{(pid=87038) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 11:26:59 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Temporary image e1b59027-cb2e-4dc7-b35a-2801c7a053de for user 177e3488520b48169d7cd5f6808a8367 is deleted. {{(pid=87038) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 11:26:59 devstack cinder-volume[87038]: DEBUG cinder.volume.volume_utils [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Marking volume 3ffd4746-cd4b-4505-abd8-28dd84566e22 as bootable. {{(pid=87038) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 11:26:59 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Copying metadata from image e1b59027-cb2e-4dc7-b35a-2801c7a053de to 3ffd4746-cd4b-4505-abd8-28dd84566e22. {{(pid=87038) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 11:26:59 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Creating volume glance metadata for volume 3ffd4746-cd4b-4505-abd8-28dd84566e22 backed by image e1b59027-cb2e-4dc7-b35a-2801c7a053de with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87038) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 11:26:59 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8098e81d-a717-4995-b36f-54ebf31e0a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ffd4746-cd4b-4505-abd8-28dd84566e22', 'volume_size': 1, 'image_id': 'e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '72db6f41ce954ca898cc9f539a1cd3c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'e1b59027-cb2e-4dc7-b35a-2801c7a053de', 'created_at': datetime.datetime(2026, 9, 3, 9, 7, 4, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 7, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e1b59027-cb2e-4dc7-b35a-2801c7a053de/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:59 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c55b2132-d86e-4923-8413-5cf75317f0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:26:59 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Volume volume-3ffd4746-cd4b-4505-abd8-28dd84566e22 (3ffd4746-cd4b-4505-abd8-28dd84566e22): created successfully Sep 03 11:26:59 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c55b2132-d86e-4923-8413-5cf75317f0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:26:59 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Flow 'volume_create_manager' (1926810e-399b-4927-a1ff-afabf9344d12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:26:59 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-3723c051-1b42-445f-a023-e57987491761 tempest-TestShelveInstance-667082473 None] Created volume successfully. Sep 03 11:27:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-0fea4e9d-ae17-4d5b-a382-bf4bf5b4ca76 req-b7bb5e84-3ba0-458a-88a1-9051719169eb tempest-TestShelveInstance-667082473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:27:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-0fea4e9d-ae17-4d5b-a382-bf4bf5b4ca76 req-b7bb5e84-3ba0-458a-88a1-9051719169eb tempest-TestShelveInstance-667082473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:27:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-0fea4e9d-ae17-4d5b-a382-bf4bf5b4ca76 req-b7bb5e84-3ba0-458a-88a1-9051719169eb tempest-TestShelveInstance-667082473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:27:03 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-0fea4e9d-ae17-4d5b-a382-bf4bf5b4ca76 req-b7bb5e84-3ba0-458a-88a1-9051719169eb tempest-TestShelveInstance-667082473 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912', 'name': 'volume-3ffd4746-cd4b-4505-abd8-28dd84566e22', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd574d0a0-e2d6-4aef-a146-2a7c797a60db', 'enforce_multipath': True} {{(pid=87038) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:27:03 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-0fea4e9d-ae17-4d5b-a382-bf4bf5b4ca76 req-b7bb5e84-3ba0-458a-88a1-9051719169eb tempest-TestShelveInstance-667082473 None] attachment_update completed successfully. Sep 03 11:27:13 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=83,cinder:INSERT=37,cinder:UPDATE=110,cinder:DELETE=8 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:27:13 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:UPDATE=119,cinder:DELETE=11,cinder:SELECT=93,cinder:INSERT=29 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:27:15 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-503df772-b294-450c-982f-004698f108fa tempest-TestServerVolumeAttachmentScenario-313750458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:27:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-503df772-b294-450c-982f-004698f108fa tempest-TestServerVolumeAttachmentScenario-313750458 None] Flow 'volume_create_manager' (81ff51c2-48c8-493b-bd37-c5a01d23a121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:27:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-503df772-b294-450c-982f-004698f108fa tempest-TestServerVolumeAttachmentScenario-313750458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (944f36d9-aa34-4622-ba4a-2f37569f980c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:27:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-503df772-b294-450c-982f-004698f108fa tempest-TestServerVolumeAttachmentScenario-313750458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (944f36d9-aa34-4622-ba4a-2f37569f980c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-184418455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecb0faf4-1a68-4bbf-8705-105df18b7606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173f683aaf484219861ed35075e85112',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:27:15Z,use_quota=True,user_id='cf31941c2c0b46088aa0a603dd3f0aaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:27:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-503df772-b294-450c-982f-004698f108fa tempest-TestServerVolumeAttachmentScenario-313750458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01050f4a-a04b-4ced-ab45-111e16920d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:27:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-503df772-b294-450c-982f-004698f108fa tempest-TestServerVolumeAttachmentScenario-313750458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01050f4a-a04b-4ced-ab45-111e16920d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:27:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-503df772-b294-450c-982f-004698f108fa tempest-TestServerVolumeAttachmentScenario-313750458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66154608-d6a1-4b24-809a-aebb489c2095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:27:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-503df772-b294-450c-982f-004698f108fa tempest-TestServerVolumeAttachmentScenario-313750458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66154608-d6a1-4b24-809a-aebb489c2095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ecb0faf4-1a68-4bbf-8705-105df18b7606', 'volume_name': 'volume-ecb0faf4-1a68-4bbf-8705-105df18b7606', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:27:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-503df772-b294-450c-982f-004698f108fa tempest-TestServerVolumeAttachmentScenario-313750458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3205132-9a6b-425d-ac0b-bce00ead9edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:27:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-503df772-b294-450c-982f-004698f108fa tempest-TestServerVolumeAttachmentScenario-313750458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3205132-9a6b-425d-ac0b-bce00ead9edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:27:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-503df772-b294-450c-982f-004698f108fa tempest-TestServerVolumeAttachmentScenario-313750458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d879a5-d9a5-4746-9c29-cb4870a6621c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:27:15 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-503df772-b294-450c-982f-004698f108fa tempest-TestServerVolumeAttachmentScenario-313750458 None] Volume ecb0faf4-1a68-4bbf-8705-105df18b7606: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ecb0faf4-1a68-4bbf-8705-105df18b7606', 'volume_size': 1} Sep 03 11:27:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-503df772-b294-450c-982f-004698f108fa tempest-TestServerVolumeAttachmentScenario-313750458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:27:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-503df772-b294-450c-982f-004698f108fa tempest-TestServerVolumeAttachmentScenario-313750458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:27:15 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-503df772-b294-450c-982f-004698f108fa tempest-TestServerVolumeAttachmentScenario-313750458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-184418455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ecb0faf4-1a68-4bbf-8705-105df18b7606,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173f683aaf484219861ed35075e85112',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:27:15Z,use_quota=True,user_id='cf31941c2c0b46088aa0a603dd3f0aaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:27:15 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-503df772-b294-450c-982f-004698f108fa tempest-TestServerVolumeAttachmentScenario-313750458 None] Creating volume ecb0faf4-1a68-4bbf-8705-105df18b7606 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:27:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-503df772-b294-450c-982f-004698f108fa tempest-TestServerVolumeAttachmentScenario-313750458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:27:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-503df772-b294-450c-982f-004698f108fa tempest-TestServerVolumeAttachmentScenario-313750458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:27:15 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-503df772-b294-450c-982f-004698f108fa tempest-TestServerVolumeAttachmentScenario-313750458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:27:15 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-503df772-b294-450c-982f-004698f108fa tempest-TestServerVolumeAttachmentScenario-313750458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:27:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-503df772-b294-450c-982f-004698f108fa tempest-TestServerVolumeAttachmentScenario-313750458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:27:15 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-503df772-b294-450c-982f-004698f108fa tempest-TestServerVolumeAttachmentScenario-313750458 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:27:15 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-503df772-b294-450c-982f-004698f108fa tempest-TestServerVolumeAttachmentScenario-313750458 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:27:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-503df772-b294-450c-982f-004698f108fa tempest-TestServerVolumeAttachmentScenario-313750458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ecb0faf4-1a68-4bbf-8705-105df18b7606 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:27:15 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ecb0faf4-1a68-4bbf-8705-105df18b7606 1073741824 Sep 03 11:27:15 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:27:15 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-54e04cae-63e8-4696-97c5-57db6cae3a10 tempest-TestServerVolumeAttachmentScenario-313750458 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:27:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-54e04cae-63e8-4696-97c5-57db6cae3a10 tempest-TestServerVolumeAttachmentScenario-313750458 None] Flow 'volume_create_manager' (9d6849ba-5721-4c1b-81f6-461b363af3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:27:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-54e04cae-63e8-4696-97c5-57db6cae3a10 tempest-TestServerVolumeAttachmentScenario-313750458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68977180-044b-45cc-86aa-601b56ee80c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:27:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-54e04cae-63e8-4696-97c5-57db6cae3a10 tempest-TestServerVolumeAttachmentScenario-313750458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68977180-044b-45cc-86aa-601b56ee80c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1058863384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffd75883-30a9-472d-8ff5-6509b9afe037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173f683aaf484219861ed35075e85112',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:27:15Z,use_quota=True,user_id='cf31941c2c0b46088aa0a603dd3f0aaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:27:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-54e04cae-63e8-4696-97c5-57db6cae3a10 tempest-TestServerVolumeAttachmentScenario-313750458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bef2a96-bdb8-4115-a417-37e3a4ef70f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:27:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-54e04cae-63e8-4696-97c5-57db6cae3a10 tempest-TestServerVolumeAttachmentScenario-313750458 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bef2a96-bdb8-4115-a417-37e3a4ef70f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:27:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-54e04cae-63e8-4696-97c5-57db6cae3a10 tempest-TestServerVolumeAttachmentScenario-313750458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e16e6ad7-34f2-4014-84fa-8c1926972734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:27:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-54e04cae-63e8-4696-97c5-57db6cae3a10 tempest-TestServerVolumeAttachmentScenario-313750458 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e16e6ad7-34f2-4014-84fa-8c1926972734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffd75883-30a9-472d-8ff5-6509b9afe037', 'volume_name': 'volume-ffd75883-30a9-472d-8ff5-6509b9afe037', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:27:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-54e04cae-63e8-4696-97c5-57db6cae3a10 tempest-TestServerVolumeAttachmentScenario-313750458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba36922b-bbc1-4db6-a82f-f063636e9b1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:27:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-54e04cae-63e8-4696-97c5-57db6cae3a10 tempest-TestServerVolumeAttachmentScenario-313750458 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba36922b-bbc1-4db6-a82f-f063636e9b1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:27:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-54e04cae-63e8-4696-97c5-57db6cae3a10 tempest-TestServerVolumeAttachmentScenario-313750458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51754eda-76f8-404a-9f70-3b9906de2307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:27:15 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-54e04cae-63e8-4696-97c5-57db6cae3a10 tempest-TestServerVolumeAttachmentScenario-313750458 None] Volume ffd75883-30a9-472d-8ff5-6509b9afe037: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffd75883-30a9-472d-8ff5-6509b9afe037', 'volume_size': 1} Sep 03 11:27:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-54e04cae-63e8-4696-97c5-57db6cae3a10 tempest-TestServerVolumeAttachmentScenario-313750458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:27:15 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Sep 03 11:27:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-503df772-b294-450c-982f-004698f108fa tempest-TestServerVolumeAttachmentScenario-313750458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ecb0faf4-1a68-4bbf-8705-105df18b7606 1073741824" returned: 0 in 0.568s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:27:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-503df772-b294-450c-982f-004698f108fa tempest-TestServerVolumeAttachmentScenario-313750458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ecb0faf4-1a68-4bbf-8705-105df18b7606 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:27:15 devstack sudo[102522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ecb0faf4-1a68-4bbf-8705-105df18b7606 Sep 03 11:27:15 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:27:16 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root Sep 03 11:27:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-503df772-b294-450c-982f-004698f108fa tempest-TestServerVolumeAttachmentScenario-313750458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ecb0faf4-1a68-4bbf-8705-105df18b7606" returned: 0 in 0.278s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:27:16 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-503df772-b294-450c-982f-004698f108fa tempest-TestServerVolumeAttachmentScenario-313750458 None] <== create_volume: return (900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:27:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-503df772-b294-450c-982f-004698f108fa tempest-TestServerVolumeAttachmentScenario-313750458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:27:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-54e04cae-63e8-4696-97c5-57db6cae3a10 tempest-TestServerVolumeAttachmentScenario-313750458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.486s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:27:16 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-54e04cae-63e8-4696-97c5-57db6cae3a10 tempest-TestServerVolumeAttachmentScenario-313750458 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:27:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1058863384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffd75883-30a9-472d-8ff5-6509b9afe037,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='173f683aaf484219861ed35075e85112',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:27:15Z,use_quota=True,user_id='cf31941c2c0b46088aa0a603dd3f0aaa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:27:16 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-54e04cae-63e8-4696-97c5-57db6cae3a10 tempest-TestServerVolumeAttachmentScenario-313750458 None] Creating volume ffd75883-30a9-472d-8ff5-6509b9afe037 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:27:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-54e04cae-63e8-4696-97c5-57db6cae3a10 tempest-TestServerVolumeAttachmentScenario-313750458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:27:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-54e04cae-63e8-4696-97c5-57db6cae3a10 tempest-TestServerVolumeAttachmentScenario-313750458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:27:16 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-54e04cae-63e8-4696-97c5-57db6cae3a10 tempest-TestServerVolumeAttachmentScenario-313750458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:27:16 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-54e04cae-63e8-4696-97c5-57db6cae3a10 tempest-TestServerVolumeAttachmentScenario-313750458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:27:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-54e04cae-63e8-4696-97c5-57db6cae3a10 tempest-TestServerVolumeAttachmentScenario-313750458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:27:16 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-54e04cae-63e8-4696-97c5-57db6cae3a10 tempest-TestServerVolumeAttachmentScenario-313750458 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:27:16 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-54e04cae-63e8-4696-97c5-57db6cae3a10 tempest-TestServerVolumeAttachmentScenario-313750458 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:27:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-54e04cae-63e8-4696-97c5-57db6cae3a10 tempest-TestServerVolumeAttachmentScenario-313750458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ffd75883-30a9-472d-8ff5-6509b9afe037 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:27:16 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-503df772-b294-450c-982f-004698f108fa tempest-TestServerVolumeAttachmentScenario-313750458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36d879a5-d9a5-4746-9c29-cb4870a6621c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ecb0faf4-1a68-4bbf-8705-105df18b7606', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:27:16 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-503df772-b294-450c-982f-004698f108fa tempest-TestServerVolumeAttachmentScenario-313750458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9c16fff-8cab-4484-b6d0-32eb4aab793e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:27:16 devstack sudo[102525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ffd75883-30a9-472d-8ff5-6509b9afe037 1073741824 Sep 03 11:27:16 devstack sudo[102525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:27:16 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-503df772-b294-450c-982f-004698f108fa tempest-TestServerVolumeAttachmentScenario-313750458 None] Volume volume-ecb0faf4-1a68-4bbf-8705-105df18b7606 (ecb0faf4-1a68-4bbf-8705-105df18b7606): created successfully Sep 03 11:27:16 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-503df772-b294-450c-982f-004698f108fa tempest-TestServerVolumeAttachmentScenario-313750458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9c16fff-8cab-4484-b6d0-32eb4aab793e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:27:16 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-503df772-b294-450c-982f-004698f108fa tempest-TestServerVolumeAttachmentScenario-313750458 None] Flow 'volume_create_manager' (81ff51c2-48c8-493b-bd37-c5a01d23a121) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:27:16 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-503df772-b294-450c-982f-004698f108fa tempest-TestServerVolumeAttachmentScenario-313750458 None] Created volume successfully. Sep 03 11:27:16 devstack sudo[102525]: pam_unix(sudo:session): session closed for user root Sep 03 11:27:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-54e04cae-63e8-4696-97c5-57db6cae3a10 tempest-TestServerVolumeAttachmentScenario-313750458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ffd75883-30a9-472d-8ff5-6509b9afe037 1073741824" returned: 0 in 0.570s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:27:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-54e04cae-63e8-4696-97c5-57db6cae3a10 tempest-TestServerVolumeAttachmentScenario-313750458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ffd75883-30a9-472d-8ff5-6509b9afe037 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:27:16 devstack sudo[102532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ffd75883-30a9-472d-8ff5-6509b9afe037 Sep 03 11:27:16 devstack sudo[102532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:27:16 devstack sudo[102532]: pam_unix(sudo:session): session closed for user root Sep 03 11:27:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-54e04cae-63e8-4696-97c5-57db6cae3a10 tempest-TestServerVolumeAttachmentScenario-313750458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ffd75883-30a9-472d-8ff5-6509b9afe037" returned: 0 in 0.255s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:27:16 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-54e04cae-63e8-4696-97c5-57db6cae3a10 tempest-TestServerVolumeAttachmentScenario-313750458 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:27:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-54e04cae-63e8-4696-97c5-57db6cae3a10 tempest-TestServerVolumeAttachmentScenario-313750458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:27:16 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-54e04cae-63e8-4696-97c5-57db6cae3a10 tempest-TestServerVolumeAttachmentScenario-313750458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51754eda-76f8-404a-9f70-3b9906de2307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffd75883-30a9-472d-8ff5-6509b9afe037', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:27:16 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-54e04cae-63e8-4696-97c5-57db6cae3a10 tempest-TestServerVolumeAttachmentScenario-313750458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbcd05e6-aedc-482a-8b74-c2d2b8024e1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:27:16 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-54e04cae-63e8-4696-97c5-57db6cae3a10 tempest-TestServerVolumeAttachmentScenario-313750458 None] Volume volume-ffd75883-30a9-472d-8ff5-6509b9afe037 (ffd75883-30a9-472d-8ff5-6509b9afe037): created successfully Sep 03 11:27:16 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-54e04cae-63e8-4696-97c5-57db6cae3a10 tempest-TestServerVolumeAttachmentScenario-313750458 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbcd05e6-aedc-482a-8b74-c2d2b8024e1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:27:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-54e04cae-63e8-4696-97c5-57db6cae3a10 tempest-TestServerVolumeAttachmentScenario-313750458 None] Flow 'volume_create_manager' (9d6849ba-5721-4c1b-81f6-461b363af3ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:27:17 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-54e04cae-63e8-4696-97c5-57db6cae3a10 tempest-TestServerVolumeAttachmentScenario-313750458 None] Created volume successfully. Sep 03 11:27:17 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:27:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:27:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:27:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:27:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:27:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:27:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:27:17 devstack sudo[102535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:27:18 devstack sudo[102535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:27:18 devstack sudo[102535]: pam_unix(sudo:session): session closed for user root Sep 03 11:27:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.306s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:27:18 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:27:18 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:27:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread count: 28 {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:27:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread info: [<_MainThread(MainThread, started 139554943000704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:27:27 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=5,cinder:UPDATE=7,cinder:INSERT=1 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:27:27 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=3,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=2 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:27:36 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-bc2a7665-d9f0-4625-8b89-e02454149147 req-300f2559-6344-455f-babb-a4a46fbf9f55 tempest-TestShelveInstance-667082473 None] Terminate volume connection completed successfully. Sep 03 11:27:36 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-bc2a7665-d9f0-4625-8b89-e02454149147 req-300f2559-6344-455f-babb-a4a46fbf9f55 tempest-TestShelveInstance-667082473 None] Deleting attachment d574d0a0-e2d6-4aef-a146-2a7c797a60db. {{(pid=87038) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:27:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-665c8b2b-54eb-4570-8a4b-3fd05a6d00f5 req-85974744-87a9-4e8e-9d7c-fd12075c9d7d tempest-TestShelveInstance-667082473 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:27:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-665c8b2b-54eb-4570-8a4b-3fd05a6d00f5 req-85974744-87a9-4e8e-9d7c-fd12075c9d7d tempest-TestShelveInstance-667082473 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:27:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-665c8b2b-54eb-4570-8a4b-3fd05a6d00f5 req-85974744-87a9-4e8e-9d7c-fd12075c9d7d tempest-TestShelveInstance-667082473 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:27:38 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-665c8b2b-54eb-4570-8a4b-3fd05a6d00f5 req-85974744-87a9-4e8e-9d7c-fd12075c9d7d tempest-TestShelveInstance-667082473 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912', 'name': 'volume-3ffd4746-cd4b-4505-abd8-28dd84566e22', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '86d24a02-b94b-43d2-815e-498c07a4fbcf', 'enforce_multipath': True} {{(pid=87038) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:27:38 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-665c8b2b-54eb-4570-8a4b-3fd05a6d00f5 req-85974744-87a9-4e8e-9d7c-fd12075c9d7d tempest-TestShelveInstance-667082473 None] attachment_update completed successfully. Sep 03 11:27:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-72f1c23f-57ad-41ba-9a0e-b70664b791f9 req-9e7fd178-b83c-4741-aa26-654812e9fee8 tempest-TestServerVolumeAttachmentScenario-313750458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:27:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-72f1c23f-57ad-41ba-9a0e-b70664b791f9 req-9e7fd178-b83c-4741-aa26-654812e9fee8 tempest-TestServerVolumeAttachmentScenario-313750458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:27:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-72f1c23f-57ad-41ba-9a0e-b70664b791f9 req-9e7fd178-b83c-4741-aa26-654812e9fee8 tempest-TestServerVolumeAttachmentScenario-313750458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:27:46 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-72f1c23f-57ad-41ba-9a0e-b70664b791f9 req-9e7fd178-b83c-4741-aa26-654812e9fee8 tempest-TestServerVolumeAttachmentScenario-313750458 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912', 'name': 'volume-ecb0faf4-1a68-4bbf-8705-105df18b7606', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b4349ec-7123-44c4-a454-94b938e7cf47', 'enforce_multipath': True} {{(pid=87038) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:27:46 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-72f1c23f-57ad-41ba-9a0e-b70664b791f9 req-9e7fd178-b83c-4741-aa26-654812e9fee8 tempest-TestServerVolumeAttachmentScenario-313750458 None] attachment_update completed successfully. Sep 03 11:27:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-355a0b59-19ec-4945-aca7-d736924133b9 req-1865d651-b860-44b3-be7f-783388493915 tempest-TestServerVolumeAttachmentScenario-313750458 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:27:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-355a0b59-19ec-4945-aca7-d736924133b9 req-1865d651-b860-44b3-be7f-783388493915 tempest-TestServerVolumeAttachmentScenario-313750458 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:27:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-355a0b59-19ec-4945-aca7-d736924133b9 req-1865d651-b860-44b3-be7f-783388493915 tempest-TestServerVolumeAttachmentScenario-313750458 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:27:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-355a0b59-19ec-4945-aca7-d736924133b9 req-1865d651-b860-44b3-be7f-783388493915 tempest-TestServerVolumeAttachmentScenario-313750458 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912', 'name': 'volume-ffd75883-30a9-472d-8ff5-6509b9afe037', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f981ed35-bf7c-43f8-9399-be9addf9c8f6', 'enforce_multipath': True} {{(pid=87038) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:27:50 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-355a0b59-19ec-4945-aca7-d736924133b9 req-1865d651-b860-44b3-be7f-783388493915 tempest-TestServerVolumeAttachmentScenario-313750458 None] attachment_update completed successfully. Sep 03 11:27:51 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-37ec744a-ef65-47e6-b127-80c7d0bca36d req-b46f273f-9f33-4d44-ac9c-5cbc448571bf tempest-TestServerVolumeAttachmentScenario-313750458 None] Terminate volume connection completed successfully. Sep 03 11:27:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-37ec744a-ef65-47e6-b127-80c7d0bca36d req-b46f273f-9f33-4d44-ac9c-5cbc448571bf tempest-TestServerVolumeAttachmentScenario-313750458 None] Deleting attachment f981ed35-bf7c-43f8-9399-be9addf9c8f6. {{(pid=87038) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:27:53 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-e35140e5-e04b-4146-9bf3-73b893806e7e req-4dd6d9b5-44ab-4f0a-801f-21e03ca6b9ec tempest-TestServerVolumeAttachmentScenario-313750458 None] Terminate volume connection completed successfully. Sep 03 11:27:53 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-e35140e5-e04b-4146-9bf3-73b893806e7e req-4dd6d9b5-44ab-4f0a-801f-21e03ca6b9ec tempest-TestServerVolumeAttachmentScenario-313750458 None] Deleting attachment 2b4349ec-7123-44c4-a454-94b938e7cf47. {{(pid=87038) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:27:57 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-aff38823-c75d-4c01-a9fd-272039ae5f57 tempest-TestServerVolumeAttachmentScenario-313750458 None] Acquiring lock "cinder-ffd75883-30a9-472d-8ff5-6509b9afe037-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:27:57 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-aff38823-c75d-4c01-a9fd-272039ae5f57 tempest-TestServerVolumeAttachmentScenario-313750458 None] Lock "cinder-ffd75883-30a9-472d-8ff5-6509b9afe037-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:27:57 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-aff38823-c75d-4c01-a9fd-272039ae5f57 tempest-TestServerVolumeAttachmentScenario-313750458 None] Acquiring lock "cinder-quobyte-ffd75883-30a9-472d-8ff5-6509b9afe037" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:27:57 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-aff38823-c75d-4c01-a9fd-272039ae5f57 tempest-TestServerVolumeAttachmentScenario-313750458 None] Lock "cinder-quobyte-ffd75883-30a9-472d-8ff5-6509b9afe037" acquired by "delete_volume" :: waited 0.016s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:27:57 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[257da7d6-5604-4eba-9270-5272abaf4bed]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:27:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-aff38823-c75d-4c01-a9fd-272039ae5f57 tempest-TestServerVolumeAttachmentScenario-313750458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ffd75883-30a9-472d-8ff5-6509b9afe037 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:27:58 devstack sudo[103311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ffd75883-30a9-472d-8ff5-6509b9afe037 Sep 03 11:27:58 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:27:58 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root Sep 03 11:27:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-aff38823-c75d-4c01-a9fd-272039ae5f57 tempest-TestServerVolumeAttachmentScenario-313750458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ffd75883-30a9-472d-8ff5-6509b9afe037" returned: 0 in 0.357s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:27:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-aff38823-c75d-4c01-a9fd-272039ae5f57 tempest-TestServerVolumeAttachmentScenario-313750458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ffd75883-30a9-472d-8ff5-6509b9afe037 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:27:58 devstack sudo[103317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ffd75883-30a9-472d-8ff5-6509b9afe037 Sep 03 11:27:58 devstack sudo[103317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:27:58 devstack sudo[103317]: pam_unix(sudo:session): session closed for user root Sep 03 11:27:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-aff38823-c75d-4c01-a9fd-272039ae5f57 tempest-TestServerVolumeAttachmentScenario-313750458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ffd75883-30a9-472d-8ff5-6509b9afe037" returned: 0 in 0.254s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:27:58 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-aff38823-c75d-4c01-a9fd-272039ae5f57 tempest-TestServerVolumeAttachmentScenario-313750458 None] Lock "cinder-quobyte-ffd75883-30a9-472d-8ff5-6509b9afe037" released by "delete_volume" :: held 0.650s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:27:58 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-aff38823-c75d-4c01-a9fd-272039ae5f57 tempest-TestServerVolumeAttachmentScenario-313750458 None] Created reservations ['5a1fd752-ee9a-4048-94e7-ffe8a96ab27b', 'b6568d46-ee99-427d-afcf-cdcfbaa2d938', '6ae46e0d-6d53-422a-8310-a5f6fc88b13b', '7ebd8609-0565-4223-8ea7-4c0b1b77ea42'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:27:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-aff38823-c75d-4c01-a9fd-272039ae5f57 tempest-TestServerVolumeAttachmentScenario-313750458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:27:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-aff38823-c75d-4c01-a9fd-272039ae5f57 tempest-TestServerVolumeAttachmentScenario-313750458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:27:58 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-aff38823-c75d-4c01-a9fd-272039ae5f57 tempest-TestServerVolumeAttachmentScenario-313750458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:27:58 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-aff38823-c75d-4c01-a9fd-272039ae5f57 tempest-TestServerVolumeAttachmentScenario-313750458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:27:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-aff38823-c75d-4c01-a9fd-272039ae5f57 tempest-TestServerVolumeAttachmentScenario-313750458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:27:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-aff38823-c75d-4c01-a9fd-272039ae5f57 tempest-TestServerVolumeAttachmentScenario-313750458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:27:58 devstack sudo[103320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:27:58 devstack sudo[103320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:27:58 devstack sudo[103320]: pam_unix(sudo:session): session closed for user root Sep 03 11:27:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-aff38823-c75d-4c01-a9fd-272039ae5f57 tempest-TestServerVolumeAttachmentScenario-313750458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.243s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:27:58 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-aff38823-c75d-4c01-a9fd-272039ae5f57 tempest-TestServerVolumeAttachmentScenario-313750458 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:27:58 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-aff38823-c75d-4c01-a9fd-272039ae5f57 tempest-TestServerVolumeAttachmentScenario-313750458 None] Deleted volume successfully. Sep 03 11:27:58 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-aff38823-c75d-4c01-a9fd-272039ae5f57 tempest-TestServerVolumeAttachmentScenario-313750458 None] Lock "cinder-ffd75883-30a9-472d-8ff5-6509b9afe037-delete_volume" released by "delete_volume" :: held 1.079s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:27:58 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a8d902fa-930f-4835-9731-c67b334b8772 tempest-TestServerVolumeAttachmentScenario-313750458 None] Acquiring lock "cinder-ecb0faf4-1a68-4bbf-8705-105df18b7606-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:27:59 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a8d902fa-930f-4835-9731-c67b334b8772 tempest-TestServerVolumeAttachmentScenario-313750458 None] Lock "cinder-ecb0faf4-1a68-4bbf-8705-105df18b7606-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:27:59 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a8d902fa-930f-4835-9731-c67b334b8772 tempest-TestServerVolumeAttachmentScenario-313750458 None] Acquiring lock "cinder-quobyte-ecb0faf4-1a68-4bbf-8705-105df18b7606" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:27:59 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a8d902fa-930f-4835-9731-c67b334b8772 tempest-TestServerVolumeAttachmentScenario-313750458 None] Lock "cinder-quobyte-ecb0faf4-1a68-4bbf-8705-105df18b7606" acquired by "delete_volume" :: waited 0.021s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:27:59 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6995734-14a5-4d4e-b62a-ff149c79f9d1]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:27:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a8d902fa-930f-4835-9731-c67b334b8772 tempest-TestServerVolumeAttachmentScenario-313750458 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ecb0faf4-1a68-4bbf-8705-105df18b7606 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:27:59 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ecb0faf4-1a68-4bbf-8705-105df18b7606 Sep 03 11:27:59 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:27:59 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Sep 03 11:27:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a8d902fa-930f-4835-9731-c67b334b8772 tempest-TestServerVolumeAttachmentScenario-313750458 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ecb0faf4-1a68-4bbf-8705-105df18b7606" returned: 0 in 0.350s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:27:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a8d902fa-930f-4835-9731-c67b334b8772 tempest-TestServerVolumeAttachmentScenario-313750458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ecb0faf4-1a68-4bbf-8705-105df18b7606 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:27:59 devstack sudo[103328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ecb0faf4-1a68-4bbf-8705-105df18b7606 Sep 03 11:27:59 devstack sudo[103328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:27:59 devstack sudo[103328]: pam_unix(sudo:session): session closed for user root Sep 03 11:27:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a8d902fa-930f-4835-9731-c67b334b8772 tempest-TestServerVolumeAttachmentScenario-313750458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ecb0faf4-1a68-4bbf-8705-105df18b7606" returned: 0 in 0.246s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:27:59 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a8d902fa-930f-4835-9731-c67b334b8772 tempest-TestServerVolumeAttachmentScenario-313750458 None] Lock "cinder-quobyte-ecb0faf4-1a68-4bbf-8705-105df18b7606" released by "delete_volume" :: held 0.633s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:27:59 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-a8d902fa-930f-4835-9731-c67b334b8772 tempest-TestServerVolumeAttachmentScenario-313750458 None] Created reservations ['3282a056-f931-4d83-8b7d-c8154af5bd79', 'e27464e4-d5df-42e2-a006-415b3015feba', 'fb32cfeb-6906-4aa8-b8d9-cba972ef7408', '9207d3b7-d779-4819-8da2-23bfbbd45f6c'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:27:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a8d902fa-930f-4835-9731-c67b334b8772 tempest-TestServerVolumeAttachmentScenario-313750458 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:27:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a8d902fa-930f-4835-9731-c67b334b8772 tempest-TestServerVolumeAttachmentScenario-313750458 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:27:59 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a8d902fa-930f-4835-9731-c67b334b8772 tempest-TestServerVolumeAttachmentScenario-313750458 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:27:59 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a8d902fa-930f-4835-9731-c67b334b8772 tempest-TestServerVolumeAttachmentScenario-313750458 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:27:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a8d902fa-930f-4835-9731-c67b334b8772 tempest-TestServerVolumeAttachmentScenario-313750458 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:27:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a8d902fa-930f-4835-9731-c67b334b8772 tempest-TestServerVolumeAttachmentScenario-313750458 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:27:59 devstack sudo[103331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:27:59 devstack sudo[103331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:00 devstack sudo[103331]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a8d902fa-930f-4835-9731-c67b334b8772 tempest-TestServerVolumeAttachmentScenario-313750458 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.247s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:00 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-a8d902fa-930f-4835-9731-c67b334b8772 tempest-TestServerVolumeAttachmentScenario-313750458 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:28:00 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-a8d902fa-930f-4835-9731-c67b334b8772 tempest-TestServerVolumeAttachmentScenario-313750458 None] Deleted volume successfully. Sep 03 11:28:00 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a8d902fa-930f-4835-9731-c67b334b8772 tempest-TestServerVolumeAttachmentScenario-313750458 None] Lock "cinder-ecb0faf4-1a68-4bbf-8705-105df18b7606-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:28:08 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-cf64622b-a3bc-43e7-a6ee-483deadad9fd req-8e70a3dd-193a-4cce-a156-2056f215cee6 tempest-TestShelveInstance-667082473 None] Terminate volume connection completed successfully. Sep 03 11:28:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-cf64622b-a3bc-43e7-a6ee-483deadad9fd req-8e70a3dd-193a-4cce-a156-2056f215cee6 tempest-TestShelveInstance-667082473 None] Deleting attachment 86d24a02-b94b-43d2-815e-498c07a4fbcf. {{(pid=87038) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:28:09 devstack cinder-volume[87038]: DEBUG cinder.coordination [req-cf64622b-a3bc-43e7-a6ee-483deadad9fd req-183d7e34-26b8-43b6-a8c3-5e5319193932 tempest-TestShelveInstance-667082473 None] Acquiring lock "cinder-3ffd4746-cd4b-4505-abd8-28dd84566e22-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:28:09 devstack cinder-volume[87038]: DEBUG cinder.coordination [req-cf64622b-a3bc-43e7-a6ee-483deadad9fd req-183d7e34-26b8-43b6-a8c3-5e5319193932 tempest-TestShelveInstance-667082473 None] Lock "cinder-3ffd4746-cd4b-4505-abd8-28dd84566e22-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:28:09 devstack cinder-volume[87038]: DEBUG cinder.coordination [req-cf64622b-a3bc-43e7-a6ee-483deadad9fd req-183d7e34-26b8-43b6-a8c3-5e5319193932 tempest-TestShelveInstance-667082473 None] Acquiring lock "cinder-quobyte-3ffd4746-cd4b-4505-abd8-28dd84566e22" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:28:09 devstack cinder-volume[87038]: DEBUG cinder.coordination [req-cf64622b-a3bc-43e7-a6ee-483deadad9fd req-183d7e34-26b8-43b6-a8c3-5e5319193932 tempest-TestShelveInstance-667082473 None] Lock "cinder-quobyte-3ffd4746-cd4b-4505-abd8-28dd84566e22" acquired by "delete_volume" :: waited 0.019s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:28:09 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[07868733-4aed-4106-8aa0-289e957e6338]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:28:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-cf64622b-a3bc-43e7-a6ee-483deadad9fd req-183d7e34-26b8-43b6-a8c3-5e5319193932 tempest-TestShelveInstance-667082473 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-3ffd4746-cd4b-4505-abd8-28dd84566e22 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:09 devstack sudo[103394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-3ffd4746-cd4b-4505-abd8-28dd84566e22 Sep 03 11:28:09 devstack sudo[103394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:09 devstack sudo[103394]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-cf64622b-a3bc-43e7-a6ee-483deadad9fd req-183d7e34-26b8-43b6-a8c3-5e5319193932 tempest-TestShelveInstance-667082473 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-3ffd4746-cd4b-4505-abd8-28dd84566e22" returned: 0 in 0.425s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-cf64622b-a3bc-43e7-a6ee-483deadad9fd req-183d7e34-26b8-43b6-a8c3-5e5319193932 tempest-TestShelveInstance-667082473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-3ffd4746-cd4b-4505-abd8-28dd84566e22 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:09 devstack sudo[103399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-3ffd4746-cd4b-4505-abd8-28dd84566e22 Sep 03 11:28:09 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:09 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-cf64622b-a3bc-43e7-a6ee-483deadad9fd req-183d7e34-26b8-43b6-a8c3-5e5319193932 tempest-TestShelveInstance-667082473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-3ffd4746-cd4b-4505-abd8-28dd84566e22" returned: 0 in 0.252s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:09 devstack cinder-volume[87038]: DEBUG cinder.coordination [req-cf64622b-a3bc-43e7-a6ee-483deadad9fd req-183d7e34-26b8-43b6-a8c3-5e5319193932 tempest-TestShelveInstance-667082473 None] Lock "cinder-quobyte-3ffd4746-cd4b-4505-abd8-28dd84566e22" released by "delete_volume" :: held 0.733s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:28:10 devstack cinder-volume[87038]: DEBUG cinder.quota [req-cf64622b-a3bc-43e7-a6ee-483deadad9fd req-183d7e34-26b8-43b6-a8c3-5e5319193932 tempest-TestShelveInstance-667082473 None] Created reservations ['1cea1186-af7d-43e7-a62b-ed6c75351d7b', '5e4d5a12-cc4c-4ffc-b122-6e6edce864bf', '75661a72-357c-4ddd-9668-e922b6e1620c', '943e34ae-4f87-4092-b435-4c746b5d7520'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:28:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-cf64622b-a3bc-43e7-a6ee-483deadad9fd req-183d7e34-26b8-43b6-a8c3-5e5319193932 tempest-TestShelveInstance-667082473 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:28:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-cf64622b-a3bc-43e7-a6ee-483deadad9fd req-183d7e34-26b8-43b6-a8c3-5e5319193932 tempest-TestShelveInstance-667082473 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:28:10 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [req-cf64622b-a3bc-43e7-a6ee-483deadad9fd req-183d7e34-26b8-43b6-a8c3-5e5319193932 tempest-TestShelveInstance-667082473 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:28:10 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [req-cf64622b-a3bc-43e7-a6ee-483deadad9fd req-183d7e34-26b8-43b6-a8c3-5e5319193932 tempest-TestShelveInstance-667082473 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:28:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-cf64622b-a3bc-43e7-a6ee-483deadad9fd req-183d7e34-26b8-43b6-a8c3-5e5319193932 tempest-TestShelveInstance-667082473 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:28:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-cf64622b-a3bc-43e7-a6ee-483deadad9fd req-183d7e34-26b8-43b6-a8c3-5e5319193932 tempest-TestShelveInstance-667082473 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:10 devstack sudo[103402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:28:10 devstack sudo[103402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:10 devstack sudo[103402]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [req-cf64622b-a3bc-43e7-a6ee-483deadad9fd req-183d7e34-26b8-43b6-a8c3-5e5319193932 tempest-TestShelveInstance-667082473 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.360s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:10 devstack cinder-volume[87038]: DEBUG cinder.manager [req-cf64622b-a3bc-43e7-a6ee-483deadad9fd req-183d7e34-26b8-43b6-a8c3-5e5319193932 tempest-TestShelveInstance-667082473 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:28:10 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-cf64622b-a3bc-43e7-a6ee-483deadad9fd req-183d7e34-26b8-43b6-a8c3-5e5319193932 tempest-TestShelveInstance-667082473 None] Deleted volume successfully. Sep 03 11:28:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [req-cf64622b-a3bc-43e7-a6ee-483deadad9fd req-183d7e34-26b8-43b6-a8c3-5e5319193932 tempest-TestShelveInstance-667082473 None] Lock "cinder-3ffd4746-cd4b-4505-abd8-28dd84566e22-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:28:17 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:28:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:28:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:28:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:28:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:28:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:28:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:17 devstack sudo[103409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:28:17 devstack sudo[103409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:18 devstack sudo[103409]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.280s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:18 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:28:18 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:28:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread count: 28 {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:28:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread info: [<_MainThread(MainThread, started 139554943000704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:28:20 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=36,cinder:UPDATE=31,cinder:INSERT=6 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:28:20 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=42,cinder:UPDATE=27,cinder:INSERT=6,cinder:DELETE=3 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:28:31 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-997f11f2-c705-4022-ac82-e6344a30b4c4 tempest-TestStampPattern-415769870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:28:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-997f11f2-c705-4022-ac82-e6344a30b4c4 tempest-TestStampPattern-415769870 None] Flow 'volume_create_manager' (f7518837-74de-4d07-9bed-befaef96006d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:28:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-997f11f2-c705-4022-ac82-e6344a30b4c4 tempest-TestStampPattern-415769870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75a9c21f-e04b-461a-b545-4f1e0adab864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-997f11f2-c705-4022-ac82-e6344a30b4c4 tempest-TestStampPattern-415769870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75a9c21f-e04b-461a-b545-4f1e0adab864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-779170697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c63ecd4-5171-41ca-8f14-943222ffaba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2747b9c7f77244f88e8001cd60e1fe58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:28:32Z,use_quota=True,user_id='1d242d9365264321b2d70d5e0bd55c68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-997f11f2-c705-4022-ac82-e6344a30b4c4 tempest-TestStampPattern-415769870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2eef38-71b3-4028-bb6f-5c4e6d44c055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-997f11f2-c705-4022-ac82-e6344a30b4c4 tempest-TestStampPattern-415769870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2eef38-71b3-4028-bb6f-5c4e6d44c055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-997f11f2-c705-4022-ac82-e6344a30b4c4 tempest-TestStampPattern-415769870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63ac5907-a77f-4650-ad5c-e1f147f46864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-997f11f2-c705-4022-ac82-e6344a30b4c4 tempest-TestStampPattern-415769870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63ac5907-a77f-4650-ad5c-e1f147f46864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c63ecd4-5171-41ca-8f14-943222ffaba0', 'volume_name': 'volume-4c63ecd4-5171-41ca-8f14-943222ffaba0', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-997f11f2-c705-4022-ac82-e6344a30b4c4 tempest-TestStampPattern-415769870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56c79b84-01e8-4e8a-82c2-19ee49cd285a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-997f11f2-c705-4022-ac82-e6344a30b4c4 tempest-TestStampPattern-415769870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56c79b84-01e8-4e8a-82c2-19ee49cd285a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-997f11f2-c705-4022-ac82-e6344a30b4c4 tempest-TestStampPattern-415769870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b3dbac1-db85-40f5-98a2-6876ecab612f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:31 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-997f11f2-c705-4022-ac82-e6344a30b4c4 tempest-TestStampPattern-415769870 None] Volume 4c63ecd4-5171-41ca-8f14-943222ffaba0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c63ecd4-5171-41ca-8f14-943222ffaba0', 'volume_size': 1} Sep 03 11:28:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-997f11f2-c705-4022-ac82-e6344a30b4c4 tempest-TestStampPattern-415769870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:28:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-997f11f2-c705-4022-ac82-e6344a30b4c4 tempest-TestStampPattern-415769870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:28:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-997f11f2-c705-4022-ac82-e6344a30b4c4 tempest-TestStampPattern-415769870 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-779170697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c63ecd4-5171-41ca-8f14-943222ffaba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2747b9c7f77244f88e8001cd60e1fe58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:28:32Z,use_quota=True,user_id='1d242d9365264321b2d70d5e0bd55c68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:28:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-997f11f2-c705-4022-ac82-e6344a30b4c4 tempest-TestStampPattern-415769870 None] Creating volume 4c63ecd4-5171-41ca-8f14-943222ffaba0 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:28:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-997f11f2-c705-4022-ac82-e6344a30b4c4 tempest-TestStampPattern-415769870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:28:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-997f11f2-c705-4022-ac82-e6344a30b4c4 tempest-TestStampPattern-415769870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:28:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-997f11f2-c705-4022-ac82-e6344a30b4c4 tempest-TestStampPattern-415769870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:28:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-997f11f2-c705-4022-ac82-e6344a30b4c4 tempest-TestStampPattern-415769870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:28:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-997f11f2-c705-4022-ac82-e6344a30b4c4 tempest-TestStampPattern-415769870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:28:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-997f11f2-c705-4022-ac82-e6344a30b4c4 tempest-TestStampPattern-415769870 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:28:31 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-997f11f2-c705-4022-ac82-e6344a30b4c4 tempest-TestStampPattern-415769870 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:28:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-997f11f2-c705-4022-ac82-e6344a30b4c4 tempest-TestStampPattern-415769870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:31 devstack sudo[103453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0 1073741824 Sep 03 11:28:31 devstack sudo[103453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:31 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:28:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Flow 'volume_create_manager' (20fc3ba3-7c7a-4cf9-94e6-abb25373f750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:28:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ac86096-d60a-425a-99eb-bbbf5e88ae7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ac86096-d60a-425a-99eb-bbbf5e88ae7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f1e9b96-e299-468a-ad02-4c5fbff81413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cff7ad0ea4344eee9244393bbe8a30ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:28:32Z,use_quota=True,user_id='6c4a7d7dd1c944318b3e4c4b40bedb1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d554ed1-6382-4b1c-8f86-c96bf358ecbe),volume_type_id=4d554ed1-6382-4b1c-8f86-c96bf358ecbe)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e92a3846-cf4e-4145-b57d-362e38cc8d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e92a3846-cf4e-4145-b57d-362e38cc8d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57bb6d3c-c1cc-41cb-adae-d9f7849b4437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:31 devstack cinder-volume[87038]: DEBUG cinder.image.glance [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Creating Keystone auth plugin from conf {{(pid=87038) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 11:28:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57bb6d3c-c1cc-41cb-adae-d9f7849b4437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0f1e9b96-e299-468a-ad02-4c5fbff81413', 'volume_name': 'volume-0f1e9b96-e299-468a-ad02-4c5fbff81413', 'volume_size': 1, 'image_id': '80674c9b-c3c3-4c8b-9ced-68a0512e7267', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80674c9b-c3c3-4c8b-9ced-68a0512e7267', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '00dc83ee64046d3cb13d7999816e5c29', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cff7ad0ea4344eee9244393bbe8a30ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7f6edb78b171b92ece3dab5f20f043689381220ca5fada9c023ca8e06d3daf457dde39fa58806e2a35bd1b6fda82863b7f36dd6e9fe340f6359a837acc57a1a9', 'id': '80674c9b-c3c3-4c8b-9ced-68a0512e7267', 'created_at': datetime.datetime(2026, 9, 3, 9, 28, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 28, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80674c9b-c3c3-4c8b-9ced-68a0512e7267/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (763eb88e-899d-4f89-95c8-29348c4d9f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (763eb88e-899d-4f89-95c8-29348c4d9f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11c1ea75-b26b-4029-a84d-a08ea8839d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:32 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Volume 0f1e9b96-e299-468a-ad02-4c5fbff81413: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0f1e9b96-e299-468a-ad02-4c5fbff81413', 'volume_size': 1, 'image_id': '80674c9b-c3c3-4c8b-9ced-68a0512e7267', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80674c9b-c3c3-4c8b-9ced-68a0512e7267', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '00dc83ee64046d3cb13d7999816e5c29', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cff7ad0ea4344eee9244393bbe8a30ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7f6edb78b171b92ece3dab5f20f043689381220ca5fada9c023ca8e06d3daf457dde39fa58806e2a35bd1b6fda82863b7f36dd6e9fe340f6359a837acc57a1a9', 'id': '80674c9b-c3c3-4c8b-9ced-68a0512e7267', 'created_at': datetime.datetime(2026, 9, 3, 9, 28, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 28, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80674c9b-c3c3-4c8b-9ced-68a0512e7267/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 03 11:28:32 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Trying to clone 0f1e9b96-e299-468a-ad02-4c5fbff81413 from image 80674c9b-c3c3-4c8b-9ced-68a0512e7267 at location (None, [{'url': 'file:///opt/stack/data/glance/images/80674c9b-c3c3-4c8b-9ced-68a0512e7267', 'metadata': {}}]). {{(pid=87038) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 11:28:32 devstack sudo[103453]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-997f11f2-c705-4022-ac82-e6344a30b4c4 tempest-TestStampPattern-415769870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0 1073741824" returned: 0 in 0.521s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:32 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_80674c9b-c3c3-4c8b-9ced-68a0512e7267_zrx0eofxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87038) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 11:28:32 devstack cinder-volume[87038]: INFO cinder.image.image_utils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Image download 0.00 MB at 0.00 MB/s Sep 03 11:28:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-997f11f2-c705-4022-ac82-e6344a30b4c4 tempest-TestStampPattern-415769870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:32 devstack sudo[103459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0 Sep 03 11:28:32 devstack sudo[103459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:32 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e5606d-6b4c-4ef5-8c07-0dce214bc2df]: (4, 'raw') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:28:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80674c9b-c3c3-4c8b-9ced-68a0512e7267_zrx0eofxdevstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:32 devstack sudo[103464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80674c9b-c3c3-4c8b-9ced-68a0512e7267_zrx0eofxdevstack@QuobyteHD Sep 03 11:28:32 devstack sudo[103464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:32 devstack sudo[103459]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-997f11f2-c705-4022-ac82-e6344a30b4c4 tempest-TestStampPattern-415769870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0" returned: 0 in 0.306s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-997f11f2-c705-4022-ac82-e6344a30b4c4 tempest-TestStampPattern-415769870 None] <== create_volume: return (876ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:28:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-997f11f2-c705-4022-ac82-e6344a30b4c4 tempest-TestStampPattern-415769870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:28:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-997f11f2-c705-4022-ac82-e6344a30b4c4 tempest-TestStampPattern-415769870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b3dbac1-db85-40f5-98a2-6876ecab612f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c63ecd4-5171-41ca-8f14-943222ffaba0', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-997f11f2-c705-4022-ac82-e6344a30b4c4 tempest-TestStampPattern-415769870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1cddedd-cc3c-4bbf-a71d-ce1c934c79ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:32 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-997f11f2-c705-4022-ac82-e6344a30b4c4 tempest-TestStampPattern-415769870 None] Volume volume-4c63ecd4-5171-41ca-8f14-943222ffaba0 (4c63ecd4-5171-41ca-8f14-943222ffaba0): created successfully Sep 03 11:28:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-997f11f2-c705-4022-ac82-e6344a30b4c4 tempest-TestStampPattern-415769870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1cddedd-cc3c-4bbf-a71d-ce1c934c79ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-997f11f2-c705-4022-ac82-e6344a30b4c4 tempest-TestStampPattern-415769870 None] Flow 'volume_create_manager' (f7518837-74de-4d07-9bed-befaef96006d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:28:32 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-997f11f2-c705-4022-ac82-e6344a30b4c4 tempest-TestStampPattern-415769870 None] Created volume successfully. Sep 03 11:28:32 devstack sudo[103464]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80674c9b-c3c3-4c8b-9ced-68a0512e7267_zrx0eofxdevstack@QuobyteHD" returned: 0 in 0.384s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80674c9b-c3c3-4c8b-9ced-68a0512e7267_zrx0eofxdevstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:32 devstack sudo[103469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80674c9b-c3c3-4c8b-9ced-68a0512e7267_zrx0eofxdevstack@QuobyteHD Sep 03 11:28:32 devstack sudo[103469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:33 devstack sudo[103469]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80674c9b-c3c3-4c8b-9ced-68a0512e7267_zrx0eofxdevstack@QuobyteHD" returned: 1 in 0.344s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80674c9b-c3c3-4c8b-9ced-68a0512e7267_zrx0eofxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:28:33 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Temporary image 80674c9b-c3c3-4c8b-9ced-68a0512e7267 is fetched for user 6c4a7d7dd1c944318b3e4c4b40bedb1a. {{(pid=87038) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 11:28:33 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ca1afca-0da8-4a12-a779-66d9c007e8ff]: (4, 'raw') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:28:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80674c9b-c3c3-4c8b-9ced-68a0512e7267_zrx0eofxdevstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:33 devstack sudo[103474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80674c9b-c3c3-4c8b-9ced-68a0512e7267_zrx0eofxdevstack@QuobyteHD Sep 03 11:28:33 devstack sudo[103474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:33 devstack sudo[103474]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80674c9b-c3c3-4c8b-9ced-68a0512e7267_zrx0eofxdevstack@QuobyteHD" returned: 0 in 0.369s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80674c9b-c3c3-4c8b-9ced-68a0512e7267_zrx0eofxdevstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:33 devstack sudo[103478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80674c9b-c3c3-4c8b-9ced-68a0512e7267_zrx0eofxdevstack@QuobyteHD Sep 03 11:28:33 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:33 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80674c9b-c3c3-4c8b-9ced-68a0512e7267_zrx0eofxdevstack@QuobyteHD" returned: 1 in 0.379s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80674c9b-c3c3-4c8b-9ced-68a0512e7267_zrx0eofxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:28:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:28:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:28:33 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:28:31Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f1e9b96-e299-468a-ad02-4c5fbff81413,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cff7ad0ea4344eee9244393bbe8a30ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:28:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:28:32Z,use_quota=True,user_id='6c4a7d7dd1c944318b3e4c4b40bedb1a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d554ed1-6382-4b1c-8f86-c96bf358ecbe),volume_type_id=4d554ed1-6382-4b1c-8f86-c96bf358ecbe)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:28:33 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Creating volume 0f1e9b96-e299-468a-ad02-4c5fbff81413 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:28:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:28:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:28:33 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:28:33 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:28:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:28:33 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:28:33 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:28:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0f1e9b96-e299-468a-ad02-4c5fbff81413 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:33 devstack sudo[103486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0f1e9b96-e299-468a-ad02-4c5fbff81413 1073741824 Sep 03 11:28:33 devstack sudo[103486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:34 devstack sudo[103486]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0f1e9b96-e299-468a-ad02-4c5fbff81413 1073741824" returned: 0 in 0.561s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0f1e9b96-e299-468a-ad02-4c5fbff81413 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:34 devstack sudo[103507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0f1e9b96-e299-468a-ad02-4c5fbff81413 Sep 03 11:28:34 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:34 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0f1e9b96-e299-468a-ad02-4c5fbff81413" returned: 0 in 0.297s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:34 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:28:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:28:34 devstack cinder-volume[87038]: DEBUG cinder.volume.volume_utils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Attempting download of 80674c9b-c3c3-4c8b-9ced-68a0512e7267 ((None, [{'url': 'file:///opt/stack/data/glance/images/80674c9b-c3c3-4c8b-9ced-68a0512e7267', 'metadata': {}}])) to volume 0f1e9b96-e299-468a-ad02-4c5fbff81413. {{(pid=87038) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 11:28:34 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7faf64-26d6-4681-b5a4-f407d6e2b277]: (4, 'raw') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:28:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80674c9b-c3c3-4c8b-9ced-68a0512e7267_epjimhy9 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:34 devstack sudo[103510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80674c9b-c3c3-4c8b-9ced-68a0512e7267_epjimhy9 Sep 03 11:28:34 devstack sudo[103510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:35 devstack sudo[103510]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_80674c9b-c3c3-4c8b-9ced-68a0512e7267_epjimhy9" returned: 0 in 0.352s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80674c9b-c3c3-4c8b-9ced-68a0512e7267_epjimhy9 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:35 devstack sudo[103514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80674c9b-c3c3-4c8b-9ced-68a0512e7267_epjimhy9 Sep 03 11:28:35 devstack sudo[103514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:35 devstack sudo[103514]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80674c9b-c3c3-4c8b-9ced-68a0512e7267_epjimhy9" returned: 1 in 0.369s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_80674c9b-c3c3-4c8b-9ced-68a0512e7267_epjimhy9' failed. Not Retrying. {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:28:35 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16e5911-2b7c-4b61-a00e-7db6ad851b9e]: (4, 'raw') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:28:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80674c9b-c3c3-4c8b-9ced-68a0512e7267_zrx0eofxdevstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:35 devstack sudo[103519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80674c9b-c3c3-4c8b-9ced-68a0512e7267_zrx0eofxdevstack@QuobyteHD Sep 03 11:28:35 devstack sudo[103519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:35 devstack sudo[103519]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_80674c9b-c3c3-4c8b-9ced-68a0512e7267_zrx0eofxdevstack@QuobyteHD" returned: 0 in 0.358s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80674c9b-c3c3-4c8b-9ced-68a0512e7267_zrx0eofxdevstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:36 devstack sudo[103529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80674c9b-c3c3-4c8b-9ced-68a0512e7267_zrx0eofxdevstack@QuobyteHD Sep 03 11:28:36 devstack sudo[103529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:36 devstack sudo[103529]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80674c9b-c3c3-4c8b-9ced-68a0512e7267_zrx0eofxdevstack@QuobyteHD" returned: 1 in 0.505s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_80674c9b-c3c3-4c8b-9ced-68a0512e7267_zrx0eofxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:28:36 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] 80674c9b-c3c3-4c8b-9ced-68a0512e7267 was raw, converting to qcow2 {{(pid=87038) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 11:28:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_80674c9b-c3c3-4c8b-9ced-68a0512e7267_zrx0eofxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0f1e9b96-e299-468a-ad02-4c5fbff81413 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:36 devstack sudo[103570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_80674c9b-c3c3-4c8b-9ced-68a0512e7267_zrx0eofxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0f1e9b96-e299-468a-ad02-4c5fbff81413 Sep 03 11:28:36 devstack sudo[103570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:37 devstack sudo[103570]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_80674c9b-c3c3-4c8b-9ced-68a0512e7267_zrx0eofxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0f1e9b96-e299-468a-ad02-4c5fbff81413" returned: 0 in 0.817s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:37 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_80674c9b-c3c3-4c8b-9ced-68a0512e7267_zrx0eofxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0f1e9b96-e299-468a-ad02-4c5fbff81413 {{(pid=87038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:28:37 devstack cinder-volume[87038]: INFO cinder.image.image_utils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Converted 0.00 MB image at 0.00 MB/s Sep 03 11:28:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0f1e9b96-e299-468a-ad02-4c5fbff81413 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:37 devstack sudo[103606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0f1e9b96-e299-468a-ad02-4c5fbff81413 1G Sep 03 11:28:37 devstack sudo[103606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:37 devstack sudo[103606]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0f1e9b96-e299-468a-ad02-4c5fbff81413 1G" returned: 0 in 0.318s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:37 devstack cinder-volume[87038]: DEBUG cinder.volume.volume_utils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Downloaded image 80674c9b-c3c3-4c8b-9ced-68a0512e7267 ((None, [{'url': 'file:///opt/stack/data/glance/images/80674c9b-c3c3-4c8b-9ced-68a0512e7267', 'metadata': {}}])) to volume 0f1e9b96-e299-468a-ad02-4c5fbff81413 successfully. {{(pid=87038) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 11:28:37 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Temporary image 80674c9b-c3c3-4c8b-9ced-68a0512e7267 for user 6c4a7d7dd1c944318b3e4c4b40bedb1a is deleted. {{(pid=87038) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 11:28:37 devstack cinder-volume[87038]: DEBUG cinder.volume.volume_utils [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Marking volume 0f1e9b96-e299-468a-ad02-4c5fbff81413 as bootable. {{(pid=87038) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 11:28:37 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Copying metadata from image 80674c9b-c3c3-4c8b-9ced-68a0512e7267 to 0f1e9b96-e299-468a-ad02-4c5fbff81413. {{(pid=87038) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 11:28:37 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Creating volume glance metadata for volume 0f1e9b96-e299-468a-ad02-4c5fbff81413 backed by image 80674c9b-c3c3-4c8b-9ced-68a0512e7267 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '80674c9b-c3c3-4c8b-9ced-68a0512e7267', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '00dc83ee64046d3cb13d7999816e5c29', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87038) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 11:28:37 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11c1ea75-b26b-4029-a84d-a08ea8839d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f1e9b96-e299-468a-ad02-4c5fbff81413', 'volume_size': 1, 'image_id': '80674c9b-c3c3-4c8b-9ced-68a0512e7267', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/80674c9b-c3c3-4c8b-9ced-68a0512e7267', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '00dc83ee64046d3cb13d7999816e5c29', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cff7ad0ea4344eee9244393bbe8a30ff', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7f6edb78b171b92ece3dab5f20f043689381220ca5fada9c023ca8e06d3daf457dde39fa58806e2a35bd1b6fda82863b7f36dd6e9fe340f6359a837acc57a1a9', 'id': '80674c9b-c3c3-4c8b-9ced-68a0512e7267', 'created_at': datetime.datetime(2026, 9, 3, 9, 28, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 28, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/80674c9b-c3c3-4c8b-9ced-68a0512e7267/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:37 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (657ef5e2-9a7b-4d66-a63c-1ef9d113f886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:37 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Volume volume-0f1e9b96-e299-468a-ad02-4c5fbff81413 (0f1e9b96-e299-468a-ad02-4c5fbff81413): created successfully Sep 03 11:28:37 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (657ef5e2-9a7b-4d66-a63c-1ef9d113f886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:37 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Flow 'volume_create_manager' (20fc3ba3-7c7a-4cf9-94e6-abb25373f750) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:28:37 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-2c07bfe5-3fdb-4ddd-a774-06672f73ce21 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Created volume successfully. Sep 03 11:28:38 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ce73deb2-afb1-429e-a134-02c61578f3b9 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Acquiring lock "cinder-0f1e9b96-e299-468a-ad02-4c5fbff81413-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:28:38 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ce73deb2-afb1-429e-a134-02c61578f3b9 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Lock "cinder-0f1e9b96-e299-468a-ad02-4c5fbff81413-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:28:38 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ce73deb2-afb1-429e-a134-02c61578f3b9 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Acquiring lock "cinder-quobyte-0f1e9b96-e299-468a-ad02-4c5fbff81413" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:28:38 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ce73deb2-afb1-429e-a134-02c61578f3b9 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Lock "cinder-quobyte-0f1e9b96-e299-468a-ad02-4c5fbff81413" acquired by "delete_volume" :: waited 0.022s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:28:38 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[4274b7b2-9509-49a3-be23-55968a4fae0f]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:28:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ce73deb2-afb1-429e-a134-02c61578f3b9 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0f1e9b96-e299-468a-ad02-4c5fbff81413 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:38 devstack sudo[103614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0f1e9b96-e299-468a-ad02-4c5fbff81413 Sep 03 11:28:38 devstack sudo[103614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:38 devstack sudo[103614]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ce73deb2-afb1-429e-a134-02c61578f3b9 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0f1e9b96-e299-468a-ad02-4c5fbff81413" returned: 0 in 0.377s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ce73deb2-afb1-429e-a134-02c61578f3b9 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0f1e9b96-e299-468a-ad02-4c5fbff81413 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:38 devstack sudo[103620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0f1e9b96-e299-468a-ad02-4c5fbff81413 Sep 03 11:28:38 devstack sudo[103620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:38 devstack sudo[103620]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ce73deb2-afb1-429e-a134-02c61578f3b9 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0f1e9b96-e299-468a-ad02-4c5fbff81413" returned: 0 in 0.289s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:38 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ce73deb2-afb1-429e-a134-02c61578f3b9 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Lock "cinder-quobyte-0f1e9b96-e299-468a-ad02-4c5fbff81413" released by "delete_volume" :: held 0.710s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:28:38 devstack cinder-volume[87038]: WARNING cinder.quota [None req-ce73deb2-afb1-429e-a134-02c61578f3b9 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:28:38 devstack cinder-volume[87038]: WARNING cinder.quota [None req-ce73deb2-afb1-429e-a134-02c61578f3b9 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:28:38 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-ce73deb2-afb1-429e-a134-02c61578f3b9 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Created reservations ['fc33f9d2-b790-4692-9347-30745fb7d814', '258776a8-fc63-4473-bd8f-90996fd6a7de', '10963eb6-8dab-4735-a8a3-f6b6d554254a', 'b50dafe0-712a-4488-bd55-21bf17952512'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:28:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ce73deb2-afb1-429e-a134-02c61578f3b9 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:28:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ce73deb2-afb1-429e-a134-02c61578f3b9 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:28:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ce73deb2-afb1-429e-a134-02c61578f3b9 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:28:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ce73deb2-afb1-429e-a134-02c61578f3b9 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:28:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ce73deb2-afb1-429e-a134-02c61578f3b9 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:28:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ce73deb2-afb1-429e-a134-02c61578f3b9 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:39 devstack sudo[103623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:28:39 devstack sudo[103623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:39 devstack sudo[103623]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ce73deb2-afb1-429e-a134-02c61578f3b9 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.321s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:39 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-ce73deb2-afb1-429e-a134-02c61578f3b9 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:28:39 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-ce73deb2-afb1-429e-a134-02c61578f3b9 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Deleted volume successfully. Sep 03 11:28:39 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-ce73deb2-afb1-429e-a134-02c61578f3b9 tempest-VolumeAndVolumeTypeFromImageTest-1070497588 None] Lock "cinder-0f1e9b96-e299-468a-ad02-4c5fbff81413-delete_volume" released by "delete_volume" :: held 1.296s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:28:44 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-9642de99-50ab-482d-888d-c827db9d48a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:28:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9642de99-50ab-482d-888d-c827db9d48a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Flow 'volume_create_manager' (aeb200fe-afd1-4c5c-bc3b-d9b0e9d03a6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:28:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9642de99-50ab-482d-888d-c827db9d48a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b854f4c4-8d41-4a39-9461-fb14a5b9fe1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9642de99-50ab-482d-888d-c827db9d48a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b854f4c4-8d41-4a39-9461-fb14a5b9fe1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1608736775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=694b98ba-1f2b-470a-9f0d-9816b73c01c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa54f29ea3e3475fbf79bc6f8ce9a4c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:28:44Z,use_quota=True,user_id='de04aab59f214a4a914a309bf62c7007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9642de99-50ab-482d-888d-c827db9d48a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ce70cf0-ced3-47b7-ad28-ed1f475e8572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9642de99-50ab-482d-888d-c827db9d48a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ce70cf0-ced3-47b7-ad28-ed1f475e8572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9642de99-50ab-482d-888d-c827db9d48a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14e53c35-1ced-4996-86a0-22148d642f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9642de99-50ab-482d-888d-c827db9d48a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14e53c35-1ced-4996-86a0-22148d642f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '694b98ba-1f2b-470a-9f0d-9816b73c01c1', 'volume_name': 'volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9642de99-50ab-482d-888d-c827db9d48a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c76729f-3195-4ad7-80c5-05d2553450a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9642de99-50ab-482d-888d-c827db9d48a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c76729f-3195-4ad7-80c5-05d2553450a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9642de99-50ab-482d-888d-c827db9d48a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e03dccd-a7c1-4689-af53-170bf9f12dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:44 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-9642de99-50ab-482d-888d-c827db9d48a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Volume 694b98ba-1f2b-470a-9f0d-9816b73c01c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1', 'volume_size': 1} Sep 03 11:28:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9642de99-50ab-482d-888d-c827db9d48a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:28:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9642de99-50ab-482d-888d-c827db9d48a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:28:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-9642de99-50ab-482d-888d-c827db9d48a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:28:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1608736775',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=694b98ba-1f2b-470a-9f0d-9816b73c01c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa54f29ea3e3475fbf79bc6f8ce9a4c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:28:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:28:44Z,use_quota=True,user_id='de04aab59f214a4a914a309bf62c7007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:28:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-9642de99-50ab-482d-888d-c827db9d48a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Creating volume 694b98ba-1f2b-470a-9f0d-9816b73c01c1 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:28:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9642de99-50ab-482d-888d-c827db9d48a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:28:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9642de99-50ab-482d-888d-c827db9d48a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:28:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-9642de99-50ab-482d-888d-c827db9d48a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:28:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-9642de99-50ab-482d-888d-c827db9d48a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:28:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9642de99-50ab-482d-888d-c827db9d48a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:28:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-9642de99-50ab-482d-888d-c827db9d48a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:28:44 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-9642de99-50ab-482d-888d-c827db9d48a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:28:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9642de99-50ab-482d-888d-c827db9d48a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:44 devstack sudo[103628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1 1073741824 Sep 03 11:28:44 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:44 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9642de99-50ab-482d-888d-c827db9d48a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1 1073741824" returned: 0 in 0.421s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9642de99-50ab-482d-888d-c827db9d48a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:44 devstack sudo[103633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1 Sep 03 11:28:44 devstack sudo[103633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:44 devstack sudo[103633]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9642de99-50ab-482d-888d-c827db9d48a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1" returned: 0 in 0.247s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-9642de99-50ab-482d-888d-c827db9d48a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:28:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9642de99-50ab-482d-888d-c827db9d48a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:28:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9642de99-50ab-482d-888d-c827db9d48a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e03dccd-a7c1-4689-af53-170bf9f12dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9642de99-50ab-482d-888d-c827db9d48a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4c0d922-0ec8-42dc-9e91-4447966892e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:44 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-9642de99-50ab-482d-888d-c827db9d48a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Volume volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1 (694b98ba-1f2b-470a-9f0d-9816b73c01c1): created successfully Sep 03 11:28:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9642de99-50ab-482d-888d-c827db9d48a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4c0d922-0ec8-42dc-9e91-4447966892e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9642de99-50ab-482d-888d-c827db9d48a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Flow 'volume_create_manager' (aeb200fe-afd1-4c5c-bc3b-d9b0e9d03a6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:28:44 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-9642de99-50ab-482d-888d-c827db9d48a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Created volume successfully. Sep 03 11:28:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-75c2ff28-5675-4c41-8087-b5774c57d1f5 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:28:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-75c2ff28-5675-4c41-8087-b5774c57d1f5 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:28:45 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-75c2ff28-5675-4c41-8087-b5774c57d1f5 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Creating offline snapshot a588c046-5d14-4618-84d2-f899678437f1 of volume 694b98ba-1f2b-470a-9f0d-9816b73c01c1 {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:28:45 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26776ed-3c9b-40f0-bc85-d5892ef40526]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:28:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-75c2ff28-5675-4c41-8087-b5774c57d1f5 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:45 devstack sudo[103636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1 Sep 03 11:28:45 devstack sudo[103636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:45 devstack sudo[103636]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-75c2ff28-5675-4c41-8087-b5774c57d1f5 tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1" returned: 0 in 0.358s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-75c2ff28-5675-4c41-8087-b5774c57d1f5 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1.a588c046-5d14-4618-84d2-f899678437f1 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:45 devstack sudo[103641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1.a588c046-5d14-4618-84d2-f899678437f1 1G Sep 03 11:28:45 devstack sudo[103641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:46 devstack sudo[103641]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-75c2ff28-5675-4c41-8087-b5774c57d1f5 tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1.a588c046-5d14-4618-84d2-f899678437f1 1G" returned: 0 in 0.382s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-75c2ff28-5675-4c41-8087-b5774c57d1f5 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1.a588c046-5d14-4618-84d2-f899678437f1 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:46 devstack sudo[103646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1.a588c046-5d14-4618-84d2-f899678437f1 Sep 03 11:28:46 devstack sudo[103646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:46 devstack sudo[103646]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-75c2ff28-5675-4c41-8087-b5774c57d1f5 tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1.a588c046-5d14-4618-84d2-f899678437f1" returned: 0 in 0.298s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:46 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-75c2ff28-5675-4c41-8087-b5774c57d1f5 tempest-CreateVolumesFromSnapshotTest-1305569996 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1.a588c046-5d14-4618-84d2-f899678437f1 is being set with open permissions: ugo+rw Sep 03 11:28:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-75c2ff28-5675-4c41-8087-b5774c57d1f5 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1.a588c046-5d14-4618-84d2-f899678437f1 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:46 devstack sudo[103651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1.a588c046-5d14-4618-84d2-f899678437f1 Sep 03 11:28:46 devstack sudo[103651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:46 devstack sudo[103651]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-75c2ff28-5675-4c41-8087-b5774c57d1f5 tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1.a588c046-5d14-4618-84d2-f899678437f1" returned: 0 in 0.245s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-75c2ff28-5675-4c41-8087-b5774c57d1f5 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:46 devstack sudo[103654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1.info Sep 03 11:28:46 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:46 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-75c2ff28-5675-4c41-8087-b5774c57d1f5 tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1.info" returned: 0 in 0.249s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:46 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-75c2ff28-5675-4c41-8087-b5774c57d1f5 tempest-CreateVolumesFromSnapshotTest-1305569996 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1.info is being set with open permissions: ugo+rw Sep 03 11:28:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-75c2ff28-5675-4c41-8087-b5774c57d1f5 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:46 devstack sudo[103657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1.info Sep 03 11:28:46 devstack sudo[103657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:47 devstack sudo[103657]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-75c2ff28-5675-4c41-8087-b5774c57d1f5 tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1.info" returned: 0 in 0.252s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-75c2ff28-5675-4c41-8087-b5774c57d1f5 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.875s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:28:47 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-75c2ff28-5675-4c41-8087-b5774c57d1f5 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Create snapshot completed successfully Sep 03 11:28:47 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-467da4b3-eea1-4d84-9b7d-8f3baf55d30a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:28:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-467da4b3-eea1-4d84-9b7d-8f3baf55d30a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Flow 'volume_create_manager' (25bc515f-bc5b-4c1b-be3a-51bec0f2caa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:28:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-467da4b3-eea1-4d84-9b7d-8f3baf55d30a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82e01290-084f-4d2c-be8e-2ec8c46970a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-467da4b3-eea1-4d84-9b7d-8f3baf55d30a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82e01290-084f-4d2c-be8e-2ec8c46970a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1974662456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18b17a58-32b6-4d72-8e08-13a46a343879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa54f29ea3e3475fbf79bc6f8ce9a4c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:28:48Z,use_quota=True,user_id='de04aab59f214a4a914a309bf62c7007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-467da4b3-eea1-4d84-9b7d-8f3baf55d30a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d673e336-c169-4110-b8ac-c802d5a51766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-467da4b3-eea1-4d84-9b7d-8f3baf55d30a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d673e336-c169-4110-b8ac-c802d5a51766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-467da4b3-eea1-4d84-9b7d-8f3baf55d30a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c76b06-fb8b-4dc0-b4c5-bc2293e86664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-467da4b3-eea1-4d84-9b7d-8f3baf55d30a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4c76b06-fb8b-4dc0-b4c5-bc2293e86664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18b17a58-32b6-4d72-8e08-13a46a343879', 'volume_name': 'volume-18b17a58-32b6-4d72-8e08-13a46a343879', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-467da4b3-eea1-4d84-9b7d-8f3baf55d30a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa2f911-857c-4a34-894f-3c07d04fcccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-467da4b3-eea1-4d84-9b7d-8f3baf55d30a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eaa2f911-857c-4a34-894f-3c07d04fcccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-467da4b3-eea1-4d84-9b7d-8f3baf55d30a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c37ddd6-5d72-43b0-a2be-f6519393987d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:47 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-467da4b3-eea1-4d84-9b7d-8f3baf55d30a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Volume 18b17a58-32b6-4d72-8e08-13a46a343879: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18b17a58-32b6-4d72-8e08-13a46a343879', 'volume_size': 1} Sep 03 11:28:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-467da4b3-eea1-4d84-9b7d-8f3baf55d30a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:28:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-467da4b3-eea1-4d84-9b7d-8f3baf55d30a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:28:47 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-467da4b3-eea1-4d84-9b7d-8f3baf55d30a tempest-CreateVolumesFromSnapshotTest-1305569996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1974662456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18b17a58-32b6-4d72-8e08-13a46a343879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa54f29ea3e3475fbf79bc6f8ce9a4c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:28:48Z,use_quota=True,user_id='de04aab59f214a4a914a309bf62c7007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:28:47 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-467da4b3-eea1-4d84-9b7d-8f3baf55d30a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Creating volume 18b17a58-32b6-4d72-8e08-13a46a343879 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:28:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-467da4b3-eea1-4d84-9b7d-8f3baf55d30a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:28:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-467da4b3-eea1-4d84-9b7d-8f3baf55d30a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:28:47 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-467da4b3-eea1-4d84-9b7d-8f3baf55d30a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:28:47 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-467da4b3-eea1-4d84-9b7d-8f3baf55d30a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:28:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-467da4b3-eea1-4d84-9b7d-8f3baf55d30a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:28:47 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-467da4b3-eea1-4d84-9b7d-8f3baf55d30a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:28:47 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-467da4b3-eea1-4d84-9b7d-8f3baf55d30a tempest-CreateVolumesFromSnapshotTest-1305569996 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:28:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-467da4b3-eea1-4d84-9b7d-8f3baf55d30a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-18b17a58-32b6-4d72-8e08-13a46a343879 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:48 devstack sudo[103660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-18b17a58-32b6-4d72-8e08-13a46a343879 1073741824 Sep 03 11:28:48 devstack sudo[103660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-28010f01-0c08-469f-baa7-ad17b071a117 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-28010f01-0c08-469f-baa7-ad17b071a117 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Flow 'volume_create_manager' (a5dcd8dd-2b42-41af-959c-67d1b9480ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-28010f01-0c08-469f-baa7-ad17b071a117 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b18d300-2bed-4ffd-96e8-c3829de43abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-28010f01-0c08-469f-baa7-ad17b071a117 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b18d300-2bed-4ffd-96e8-c3829de43abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-858214428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e80641a-6c6e-4358-96ba-715cf51f8f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa54f29ea3e3475fbf79bc6f8ce9a4c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:28:48Z,use_quota=True,user_id='de04aab59f214a4a914a309bf62c7007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-28010f01-0c08-469f-baa7-ad17b071a117 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a30027-554b-4560-9fe6-98d2e3158320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-28010f01-0c08-469f-baa7-ad17b071a117 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a30027-554b-4560-9fe6-98d2e3158320) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-28010f01-0c08-469f-baa7-ad17b071a117 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c62f0bf-7b6c-40c7-860d-2acdd66e9926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-28010f01-0c08-469f-baa7-ad17b071a117 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c62f0bf-7b6c-40c7-860d-2acdd66e9926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e80641a-6c6e-4358-96ba-715cf51f8f63', 'volume_name': 'volume-7e80641a-6c6e-4358-96ba-715cf51f8f63', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-28010f01-0c08-469f-baa7-ad17b071a117 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c07f4774-61fa-428f-b4a1-2fa90ea1b9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-28010f01-0c08-469f-baa7-ad17b071a117 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c07f4774-61fa-428f-b4a1-2fa90ea1b9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-28010f01-0c08-469f-baa7-ad17b071a117 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (526f96e5-5ba3-47bf-87cc-173aa7904b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:48 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-28010f01-0c08-469f-baa7-ad17b071a117 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Volume 7e80641a-6c6e-4358-96ba-715cf51f8f63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e80641a-6c6e-4358-96ba-715cf51f8f63', 'volume_size': 1} Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-28010f01-0c08-469f-baa7-ad17b071a117 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:28:48 devstack sudo[103660]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-467da4b3-eea1-4d84-9b7d-8f3baf55d30a tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-18b17a58-32b6-4d72-8e08-13a46a343879 1073741824" returned: 0 in 0.614s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-467da4b3-eea1-4d84-9b7d-8f3baf55d30a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-18b17a58-32b6-4d72-8e08-13a46a343879 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:48 devstack sudo[103667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-18b17a58-32b6-4d72-8e08-13a46a343879 Sep 03 11:28:48 devstack sudo[103667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e16f260-dbf8-4cb5-b145-316ed66ef41f tempest-CreateVolumesFromSnapshotTest-1305569996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4e16f260-dbf8-4cb5-b145-316ed66ef41f tempest-CreateVolumesFromSnapshotTest-1305569996 None] Flow 'volume_create_manager' (e340a4af-bdf6-4970-83ba-ef4651fcd52c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4e16f260-dbf8-4cb5-b145-316ed66ef41f tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c1cef8c-df82-4713-b8e2-eec124d363ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4e16f260-dbf8-4cb5-b145-316ed66ef41f tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c1cef8c-df82-4713-b8e2-eec124d363ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-970186012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=598519ca-40ce-4176-bf80-d06b006acf90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa54f29ea3e3475fbf79bc6f8ce9a4c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:28:49Z,use_quota=True,user_id='de04aab59f214a4a914a309bf62c7007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4e16f260-dbf8-4cb5-b145-316ed66ef41f tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d74e4e6-8b9a-4617-9ec8-496f5e1d272e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4e16f260-dbf8-4cb5-b145-316ed66ef41f tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d74e4e6-8b9a-4617-9ec8-496f5e1d272e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4e16f260-dbf8-4cb5-b145-316ed66ef41f tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b8d37df-f805-4731-899e-15f7c2d8cb8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4e16f260-dbf8-4cb5-b145-316ed66ef41f tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b8d37df-f805-4731-899e-15f7c2d8cb8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '598519ca-40ce-4176-bf80-d06b006acf90', 'volume_name': 'volume-598519ca-40ce-4176-bf80-d06b006acf90', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4e16f260-dbf8-4cb5-b145-316ed66ef41f tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8caae15-b53c-4ae2-8e51-bf5aa0226fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4e16f260-dbf8-4cb5-b145-316ed66ef41f tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8caae15-b53c-4ae2-8e51-bf5aa0226fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4e16f260-dbf8-4cb5-b145-316ed66ef41f tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31cc1254-95c9-41fc-bfa1-0514192d6bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:48 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-4e16f260-dbf8-4cb5-b145-316ed66ef41f tempest-CreateVolumesFromSnapshotTest-1305569996 None] Volume 598519ca-40ce-4176-bf80-d06b006acf90: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-598519ca-40ce-4176-bf80-d06b006acf90', 'volume_size': 1} Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4e16f260-dbf8-4cb5-b145-316ed66ef41f tempest-CreateVolumesFromSnapshotTest-1305569996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:28:48 devstack sudo[103667]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-467da4b3-eea1-4d84-9b7d-8f3baf55d30a tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-18b17a58-32b6-4d72-8e08-13a46a343879" returned: 0 in 0.291s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-467da4b3-eea1-4d84-9b7d-8f3baf55d30a tempest-CreateVolumesFromSnapshotTest-1305569996 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-467da4b3-eea1-4d84-9b7d-8f3baf55d30a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-28010f01-0c08-469f-baa7-ad17b071a117 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.577s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-28010f01-0c08-469f-baa7-ad17b071a117 tempest-CreateVolumesFromSnapshotTest-1305569996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-858214428',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e80641a-6c6e-4358-96ba-715cf51f8f63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa54f29ea3e3475fbf79bc6f8ce9a4c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:28:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:28:48Z,use_quota=True,user_id='de04aab59f214a4a914a309bf62c7007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-28010f01-0c08-469f-baa7-ad17b071a117 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Creating volume 7e80641a-6c6e-4358-96ba-715cf51f8f63 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-28010f01-0c08-469f-baa7-ad17b071a117 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-28010f01-0c08-469f-baa7-ad17b071a117 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-28010f01-0c08-469f-baa7-ad17b071a117 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-28010f01-0c08-469f-baa7-ad17b071a117 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-28010f01-0c08-469f-baa7-ad17b071a117 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-28010f01-0c08-469f-baa7-ad17b071a117 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:28:48 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-28010f01-0c08-469f-baa7-ad17b071a117 tempest-CreateVolumesFromSnapshotTest-1305569996 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-28010f01-0c08-469f-baa7-ad17b071a117 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7e80641a-6c6e-4358-96ba-715cf51f8f63 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-467da4b3-eea1-4d84-9b7d-8f3baf55d30a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c37ddd6-5d72-43b0-a2be-f6519393987d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18b17a58-32b6-4d72-8e08-13a46a343879', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-467da4b3-eea1-4d84-9b7d-8f3baf55d30a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e1302a-a781-458e-82a9-092ba06976ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:49 devstack sudo[103670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7e80641a-6c6e-4358-96ba-715cf51f8f63 1073741824 Sep 03 11:28:49 devstack sudo[103670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:49 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-467da4b3-eea1-4d84-9b7d-8f3baf55d30a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Volume volume-18b17a58-32b6-4d72-8e08-13a46a343879 (18b17a58-32b6-4d72-8e08-13a46a343879): created successfully Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-467da4b3-eea1-4d84-9b7d-8f3baf55d30a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e1302a-a781-458e-82a9-092ba06976ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-467da4b3-eea1-4d84-9b7d-8f3baf55d30a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Flow 'volume_create_manager' (25bc515f-bc5b-4c1b-be3a-51bec0f2caa9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:28:49 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-467da4b3-eea1-4d84-9b7d-8f3baf55d30a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Created volume successfully. Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-48ddab27-3255-4f73-bb97-b1341e5af1a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-48ddab27-3255-4f73-bb97-b1341e5af1a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Flow 'volume_create_manager' (06e1020b-a903-41bb-ac29-cb5aa75b9fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-48ddab27-3255-4f73-bb97-b1341e5af1a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68d9c99c-6c12-4366-881c-83082c3cdbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-48ddab27-3255-4f73-bb97-b1341e5af1a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68d9c99c-6c12-4366-881c-83082c3cdbac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1124380830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1371898e-6142-4368-a9c9-87a0f5288428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa54f29ea3e3475fbf79bc6f8ce9a4c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:28:49Z,use_quota=True,user_id='de04aab59f214a4a914a309bf62c7007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:49 devstack sudo[103670]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-48ddab27-3255-4f73-bb97-b1341e5af1a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a259f0d-d1ed-41a3-ba13-85f59d2b26a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-48ddab27-3255-4f73-bb97-b1341e5af1a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a259f0d-d1ed-41a3-ba13-85f59d2b26a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-48ddab27-3255-4f73-bb97-b1341e5af1a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (915bb917-5408-4348-9f25-a0d34ef291c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-48ddab27-3255-4f73-bb97-b1341e5af1a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (915bb917-5408-4348-9f25-a0d34ef291c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1371898e-6142-4368-a9c9-87a0f5288428', 'volume_name': 'volume-1371898e-6142-4368-a9c9-87a0f5288428', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-48ddab27-3255-4f73-bb97-b1341e5af1a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7318b48e-8d7a-476c-89db-ddf0bfd2f1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-48ddab27-3255-4f73-bb97-b1341e5af1a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7318b48e-8d7a-476c-89db-ddf0bfd2f1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-48ddab27-3255-4f73-bb97-b1341e5af1a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b8fc0b3-ab14-4dfb-9358-6f52a89aabe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:49 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-48ddab27-3255-4f73-bb97-b1341e5af1a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Volume 1371898e-6142-4368-a9c9-87a0f5288428: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1371898e-6142-4368-a9c9-87a0f5288428', 'volume_size': 1} Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-48ddab27-3255-4f73-bb97-b1341e5af1a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-28010f01-0c08-469f-baa7-ad17b071a117 tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7e80641a-6c6e-4358-96ba-715cf51f8f63 1073741824" returned: 0 in 0.685s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-28010f01-0c08-469f-baa7-ad17b071a117 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7e80641a-6c6e-4358-96ba-715cf51f8f63 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:49 devstack sudo[103676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7e80641a-6c6e-4358-96ba-715cf51f8f63 Sep 03 11:28:49 devstack sudo[103676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-557104cb-ee52-4cbb-ad82-f49b2b9d8863 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-557104cb-ee52-4cbb-ad82-f49b2b9d8863 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Flow 'volume_create_manager' (bf312fb3-754a-4dbf-bee8-10362d52fc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-557104cb-ee52-4cbb-ad82-f49b2b9d8863 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b7f2336-e197-4a88-896b-9869d85f6bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-557104cb-ee52-4cbb-ad82-f49b2b9d8863 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b7f2336-e197-4a88-896b-9869d85f6bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-582358864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=748a8538-8154-4936-96cd-279efbdcdefd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa54f29ea3e3475fbf79bc6f8ce9a4c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:28:50Z,use_quota=True,user_id='de04aab59f214a4a914a309bf62c7007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-557104cb-ee52-4cbb-ad82-f49b2b9d8863 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a36e0f36-148a-4ea0-97ed-99717531e2cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-557104cb-ee52-4cbb-ad82-f49b2b9d8863 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a36e0f36-148a-4ea0-97ed-99717531e2cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-557104cb-ee52-4cbb-ad82-f49b2b9d8863 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c33a0d78-cd44-414c-b2d5-04951d49c6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-557104cb-ee52-4cbb-ad82-f49b2b9d8863 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c33a0d78-cd44-414c-b2d5-04951d49c6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '748a8538-8154-4936-96cd-279efbdcdefd', 'volume_name': 'volume-748a8538-8154-4936-96cd-279efbdcdefd', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-557104cb-ee52-4cbb-ad82-f49b2b9d8863 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6a5f41a-12e8-4f33-a856-0ab4b3ebb718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-557104cb-ee52-4cbb-ad82-f49b2b9d8863 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6a5f41a-12e8-4f33-a856-0ab4b3ebb718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-557104cb-ee52-4cbb-ad82-f49b2b9d8863 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (218fcddd-66b7-4577-8a0e-20bbfeb2489c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:49 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-557104cb-ee52-4cbb-ad82-f49b2b9d8863 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Volume 748a8538-8154-4936-96cd-279efbdcdefd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-748a8538-8154-4936-96cd-279efbdcdefd', 'volume_size': 1} Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-557104cb-ee52-4cbb-ad82-f49b2b9d8863 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:28:49 devstack sudo[103676]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-28010f01-0c08-469f-baa7-ad17b071a117 tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7e80641a-6c6e-4358-96ba-715cf51f8f63" returned: 0 in 0.295s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-28010f01-0c08-469f-baa7-ad17b071a117 tempest-CreateVolumesFromSnapshotTest-1305569996 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-28010f01-0c08-469f-baa7-ad17b071a117 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4e16f260-dbf8-4cb5-b145-316ed66ef41f tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.134s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4e16f260-dbf8-4cb5-b145-316ed66ef41f tempest-CreateVolumesFromSnapshotTest-1305569996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-970186012',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=598519ca-40ce-4176-bf80-d06b006acf90,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa54f29ea3e3475fbf79bc6f8ce9a4c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:28:49Z,use_quota=True,user_id='de04aab59f214a4a914a309bf62c7007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-4e16f260-dbf8-4cb5-b145-316ed66ef41f tempest-CreateVolumesFromSnapshotTest-1305569996 None] Creating volume 598519ca-40ce-4176-bf80-d06b006acf90 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4e16f260-dbf8-4cb5-b145-316ed66ef41f tempest-CreateVolumesFromSnapshotTest-1305569996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4e16f260-dbf8-4cb5-b145-316ed66ef41f tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4e16f260-dbf8-4cb5-b145-316ed66ef41f tempest-CreateVolumesFromSnapshotTest-1305569996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4e16f260-dbf8-4cb5-b145-316ed66ef41f tempest-CreateVolumesFromSnapshotTest-1305569996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4e16f260-dbf8-4cb5-b145-316ed66ef41f tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4e16f260-dbf8-4cb5-b145-316ed66ef41f tempest-CreateVolumesFromSnapshotTest-1305569996 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:28:49 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-4e16f260-dbf8-4cb5-b145-316ed66ef41f tempest-CreateVolumesFromSnapshotTest-1305569996 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:28:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4e16f260-dbf8-4cb5-b145-316ed66ef41f tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-598519ca-40ce-4176-bf80-d06b006acf90 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-28010f01-0c08-469f-baa7-ad17b071a117 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (526f96e5-5ba3-47bf-87cc-173aa7904b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e80641a-6c6e-4358-96ba-715cf51f8f63', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-28010f01-0c08-469f-baa7-ad17b071a117 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc35a927-97d4-49b9-86a7-c018a15c7fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:50 devstack sudo[103695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-598519ca-40ce-4176-bf80-d06b006acf90 1073741824 Sep 03 11:28:50 devstack sudo[103695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:50 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-28010f01-0c08-469f-baa7-ad17b071a117 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Volume volume-7e80641a-6c6e-4358-96ba-715cf51f8f63 (7e80641a-6c6e-4358-96ba-715cf51f8f63): created successfully Sep 03 11:28:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-28010f01-0c08-469f-baa7-ad17b071a117 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc35a927-97d4-49b9-86a7-c018a15c7fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-28010f01-0c08-469f-baa7-ad17b071a117 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Flow 'volume_create_manager' (a5dcd8dd-2b42-41af-959c-67d1b9480ea6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:28:50 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-28010f01-0c08-469f-baa7-ad17b071a117 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Created volume successfully. Sep 03 11:28:50 devstack sudo[103695]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4e16f260-dbf8-4cb5-b145-316ed66ef41f tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-598519ca-40ce-4176-bf80-d06b006acf90 1073741824" returned: 0 in 0.428s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4e16f260-dbf8-4cb5-b145-316ed66ef41f tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-598519ca-40ce-4176-bf80-d06b006acf90 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:50 devstack sudo[103702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-598519ca-40ce-4176-bf80-d06b006acf90 Sep 03 11:28:50 devstack sudo[103702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:50 devstack sudo[103702]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4e16f260-dbf8-4cb5-b145-316ed66ef41f tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-598519ca-40ce-4176-bf80-d06b006acf90" returned: 0 in 0.254s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:50 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4e16f260-dbf8-4cb5-b145-316ed66ef41f tempest-CreateVolumesFromSnapshotTest-1305569996 None] <== create_volume: return (725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:28:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4e16f260-dbf8-4cb5-b145-316ed66ef41f tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.728s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:28:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-48ddab27-3255-4f73-bb97-b1341e5af1a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.062s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:28:50 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-48ddab27-3255-4f73-bb97-b1341e5af1a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1124380830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1371898e-6142-4368-a9c9-87a0f5288428,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa54f29ea3e3475fbf79bc6f8ce9a4c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:28:49Z,use_quota=True,user_id='de04aab59f214a4a914a309bf62c7007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:28:50 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-48ddab27-3255-4f73-bb97-b1341e5af1a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Creating volume 1371898e-6142-4368-a9c9-87a0f5288428 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:28:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-48ddab27-3255-4f73-bb97-b1341e5af1a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:28:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-48ddab27-3255-4f73-bb97-b1341e5af1a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:28:50 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-48ddab27-3255-4f73-bb97-b1341e5af1a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:28:50 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-48ddab27-3255-4f73-bb97-b1341e5af1a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:28:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-48ddab27-3255-4f73-bb97-b1341e5af1a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:28:50 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-48ddab27-3255-4f73-bb97-b1341e5af1a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:28:50 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-48ddab27-3255-4f73-bb97-b1341e5af1a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:28:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-48ddab27-3255-4f73-bb97-b1341e5af1a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1371898e-6142-4368-a9c9-87a0f5288428 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4e16f260-dbf8-4cb5-b145-316ed66ef41f tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31cc1254-95c9-41fc-bfa1-0514192d6bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-598519ca-40ce-4176-bf80-d06b006acf90', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:50 devstack sudo[103705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1371898e-6142-4368-a9c9-87a0f5288428 1073741824 Sep 03 11:28:50 devstack sudo[103705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4e16f260-dbf8-4cb5-b145-316ed66ef41f tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73562f75-a244-42ae-8d3e-c4c8bdb9b14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:50 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-4e16f260-dbf8-4cb5-b145-316ed66ef41f tempest-CreateVolumesFromSnapshotTest-1305569996 None] Volume volume-598519ca-40ce-4176-bf80-d06b006acf90 (598519ca-40ce-4176-bf80-d06b006acf90): created successfully Sep 03 11:28:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4e16f260-dbf8-4cb5-b145-316ed66ef41f tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73562f75-a244-42ae-8d3e-c4c8bdb9b14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4e16f260-dbf8-4cb5-b145-316ed66ef41f tempest-CreateVolumesFromSnapshotTest-1305569996 None] Flow 'volume_create_manager' (e340a4af-bdf6-4970-83ba-ef4651fcd52c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:28:50 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-4e16f260-dbf8-4cb5-b145-316ed66ef41f tempest-CreateVolumesFromSnapshotTest-1305569996 None] Created volume successfully. Sep 03 11:28:51 devstack sudo[103705]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-48ddab27-3255-4f73-bb97-b1341e5af1a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1371898e-6142-4368-a9c9-87a0f5288428 1073741824" returned: 0 in 0.412s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-48ddab27-3255-4f73-bb97-b1341e5af1a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1371898e-6142-4368-a9c9-87a0f5288428 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:51 devstack sudo[103710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1371898e-6142-4368-a9c9-87a0f5288428 Sep 03 11:28:51 devstack sudo[103710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:51 devstack sudo[103710]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-48ddab27-3255-4f73-bb97-b1341e5af1a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1371898e-6142-4368-a9c9-87a0f5288428" returned: 0 in 0.251s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:51 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-48ddab27-3255-4f73-bb97-b1341e5af1a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:28:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-48ddab27-3255-4f73-bb97-b1341e5af1a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:28:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-557104cb-ee52-4cbb-ad82-f49b2b9d8863 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.516s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:28:51 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-557104cb-ee52-4cbb-ad82-f49b2b9d8863 tempest-CreateVolumesFromSnapshotTest-1305569996 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-582358864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=748a8538-8154-4936-96cd-279efbdcdefd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa54f29ea3e3475fbf79bc6f8ce9a4c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:28:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:28:50Z,use_quota=True,user_id='de04aab59f214a4a914a309bf62c7007',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:28:51 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-557104cb-ee52-4cbb-ad82-f49b2b9d8863 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Creating volume 748a8538-8154-4936-96cd-279efbdcdefd {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:28:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-557104cb-ee52-4cbb-ad82-f49b2b9d8863 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:28:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-557104cb-ee52-4cbb-ad82-f49b2b9d8863 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:28:51 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-557104cb-ee52-4cbb-ad82-f49b2b9d8863 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:28:51 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-557104cb-ee52-4cbb-ad82-f49b2b9d8863 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:28:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-557104cb-ee52-4cbb-ad82-f49b2b9d8863 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:28:51 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-557104cb-ee52-4cbb-ad82-f49b2b9d8863 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:28:51 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-557104cb-ee52-4cbb-ad82-f49b2b9d8863 tempest-CreateVolumesFromSnapshotTest-1305569996 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:28:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-557104cb-ee52-4cbb-ad82-f49b2b9d8863 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-748a8538-8154-4936-96cd-279efbdcdefd 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:51 devstack sudo[103714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-748a8538-8154-4936-96cd-279efbdcdefd 1073741824 Sep 03 11:28:51 devstack sudo[103714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-48ddab27-3255-4f73-bb97-b1341e5af1a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b8fc0b3-ab14-4dfb-9358-6f52a89aabe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1371898e-6142-4368-a9c9-87a0f5288428', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-48ddab27-3255-4f73-bb97-b1341e5af1a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b8ee3d-dba9-47c6-8c90-49fcdbd33e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:51 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-48ddab27-3255-4f73-bb97-b1341e5af1a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Volume volume-1371898e-6142-4368-a9c9-87a0f5288428 (1371898e-6142-4368-a9c9-87a0f5288428): created successfully Sep 03 11:28:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-48ddab27-3255-4f73-bb97-b1341e5af1a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b8ee3d-dba9-47c6-8c90-49fcdbd33e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:51 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-48ddab27-3255-4f73-bb97-b1341e5af1a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Flow 'volume_create_manager' (06e1020b-a903-41bb-ac29-cb5aa75b9fb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:28:51 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-48ddab27-3255-4f73-bb97-b1341e5af1a9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Created volume successfully. Sep 03 11:28:51 devstack sudo[103714]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-557104cb-ee52-4cbb-ad82-f49b2b9d8863 tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-748a8538-8154-4936-96cd-279efbdcdefd 1073741824" returned: 0 in 0.430s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-557104cb-ee52-4cbb-ad82-f49b2b9d8863 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-748a8538-8154-4936-96cd-279efbdcdefd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:51 devstack sudo[103726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-748a8538-8154-4936-96cd-279efbdcdefd Sep 03 11:28:51 devstack sudo[103726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:52 devstack sudo[103726]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-557104cb-ee52-4cbb-ad82-f49b2b9d8863 tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-748a8538-8154-4936-96cd-279efbdcdefd" returned: 0 in 0.254s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:52 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-557104cb-ee52-4cbb-ad82-f49b2b9d8863 tempest-CreateVolumesFromSnapshotTest-1305569996 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:28:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-557104cb-ee52-4cbb-ad82-f49b2b9d8863 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:28:52 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-557104cb-ee52-4cbb-ad82-f49b2b9d8863 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (218fcddd-66b7-4577-8a0e-20bbfeb2489c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-748a8538-8154-4936-96cd-279efbdcdefd', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:52 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-557104cb-ee52-4cbb-ad82-f49b2b9d8863 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f230ce6c-61ce-4a48-87a3-45a0df94a784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:28:52 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-557104cb-ee52-4cbb-ad82-f49b2b9d8863 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Volume volume-748a8538-8154-4936-96cd-279efbdcdefd (748a8538-8154-4936-96cd-279efbdcdefd): created successfully Sep 03 11:28:52 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-557104cb-ee52-4cbb-ad82-f49b2b9d8863 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f230ce6c-61ce-4a48-87a3-45a0df94a784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:28:52 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-557104cb-ee52-4cbb-ad82-f49b2b9d8863 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Flow 'volume_create_manager' (bf312fb3-754a-4dbf-bee8-10362d52fc18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:28:52 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-557104cb-ee52-4cbb-ad82-f49b2b9d8863 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Created volume successfully. Sep 03 11:28:53 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d83c84c7-9e7e-4e04-af7f-bc3613facd86 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Acquiring lock "cinder-748a8538-8154-4936-96cd-279efbdcdefd-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:28:53 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d83c84c7-9e7e-4e04-af7f-bc3613facd86 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "cinder-748a8538-8154-4936-96cd-279efbdcdefd-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:28:53 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d83c84c7-9e7e-4e04-af7f-bc3613facd86 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Acquiring lock "cinder-quobyte-748a8538-8154-4936-96cd-279efbdcdefd" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:28:53 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d83c84c7-9e7e-4e04-af7f-bc3613facd86 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "cinder-quobyte-748a8538-8154-4936-96cd-279efbdcdefd" acquired by "delete_volume" :: waited 0.014s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:28:53 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[68d588b2-92e3-4b01-9a4f-6a2c007c1ebf]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:28:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d83c84c7-9e7e-4e04-af7f-bc3613facd86 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-748a8538-8154-4936-96cd-279efbdcdefd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:53 devstack sudo[103729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-748a8538-8154-4936-96cd-279efbdcdefd Sep 03 11:28:53 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:53 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d83c84c7-9e7e-4e04-af7f-bc3613facd86 tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-748a8538-8154-4936-96cd-279efbdcdefd" returned: 0 in 0.354s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d83c84c7-9e7e-4e04-af7f-bc3613facd86 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-748a8538-8154-4936-96cd-279efbdcdefd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:53 devstack sudo[103734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-748a8538-8154-4936-96cd-279efbdcdefd Sep 03 11:28:53 devstack sudo[103734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:53 devstack sudo[103734]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d83c84c7-9e7e-4e04-af7f-bc3613facd86 tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-748a8538-8154-4936-96cd-279efbdcdefd" returned: 0 in 0.235s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:53 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d83c84c7-9e7e-4e04-af7f-bc3613facd86 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "cinder-quobyte-748a8538-8154-4936-96cd-279efbdcdefd" released by "delete_volume" :: held 0.624s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:28:53 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-d83c84c7-9e7e-4e04-af7f-bc3613facd86 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Created reservations ['2ce5d6cd-eacc-4427-bb4b-f6745145e962', '55403fc6-5108-4eb8-a762-d6163cda526c', '79c9fd18-8024-455c-9c11-084df227bd67', 'e4355796-638e-49ca-b93d-2d9755a9ff86'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:28:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d83c84c7-9e7e-4e04-af7f-bc3613facd86 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:28:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d83c84c7-9e7e-4e04-af7f-bc3613facd86 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:28:53 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d83c84c7-9e7e-4e04-af7f-bc3613facd86 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:28:53 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d83c84c7-9e7e-4e04-af7f-bc3613facd86 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:28:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d83c84c7-9e7e-4e04-af7f-bc3613facd86 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:28:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d83c84c7-9e7e-4e04-af7f-bc3613facd86 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:53 devstack sudo[103737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:28:53 devstack sudo[103737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:54 devstack sudo[103737]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d83c84c7-9e7e-4e04-af7f-bc3613facd86 tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.241s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:54 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-d83c84c7-9e7e-4e04-af7f-bc3613facd86 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:28:54 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-d83c84c7-9e7e-4e04-af7f-bc3613facd86 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Deleted volume successfully. Sep 03 11:28:54 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d83c84c7-9e7e-4e04-af7f-bc3613facd86 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "cinder-748a8538-8154-4936-96cd-279efbdcdefd-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:28:54 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-0d217dc5-6706-4971-a3c5-c8a3e7ec5654 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Acquiring lock "cinder-1371898e-6142-4368-a9c9-87a0f5288428-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:28:54 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-0d217dc5-6706-4971-a3c5-c8a3e7ec5654 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "cinder-1371898e-6142-4368-a9c9-87a0f5288428-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:28:54 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-0d217dc5-6706-4971-a3c5-c8a3e7ec5654 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Acquiring lock "cinder-quobyte-1371898e-6142-4368-a9c9-87a0f5288428" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:28:54 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-0d217dc5-6706-4971-a3c5-c8a3e7ec5654 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "cinder-quobyte-1371898e-6142-4368-a9c9-87a0f5288428" acquired by "delete_volume" :: waited 0.014s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:28:54 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[a061f45a-342f-4bfb-acfe-2dbea108d5a9]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:28:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0d217dc5-6706-4971-a3c5-c8a3e7ec5654 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1371898e-6142-4368-a9c9-87a0f5288428 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:54 devstack sudo[103740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1371898e-6142-4368-a9c9-87a0f5288428 Sep 03 11:28:54 devstack sudo[103740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:54 devstack sudo[103740]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0d217dc5-6706-4971-a3c5-c8a3e7ec5654 tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1371898e-6142-4368-a9c9-87a0f5288428" returned: 0 in 0.345s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0d217dc5-6706-4971-a3c5-c8a3e7ec5654 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1371898e-6142-4368-a9c9-87a0f5288428 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:54 devstack sudo[103745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1371898e-6142-4368-a9c9-87a0f5288428 Sep 03 11:28:54 devstack sudo[103745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:54 devstack sudo[103745]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0d217dc5-6706-4971-a3c5-c8a3e7ec5654 tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1371898e-6142-4368-a9c9-87a0f5288428" returned: 0 in 0.234s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:54 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-0d217dc5-6706-4971-a3c5-c8a3e7ec5654 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "cinder-quobyte-1371898e-6142-4368-a9c9-87a0f5288428" released by "delete_volume" :: held 0.615s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:28:55 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-0d217dc5-6706-4971-a3c5-c8a3e7ec5654 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Created reservations ['5ce0934d-316e-43c3-9574-ef53d86453b9', 'f43ae224-3d8c-4d73-8094-9bcf925fe04b', '7bfad318-5331-4495-9c60-19d369266ced', 'bf7b8839-4981-4f1e-81fe-dbe0181adbe0'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:28:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0d217dc5-6706-4971-a3c5-c8a3e7ec5654 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:28:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0d217dc5-6706-4971-a3c5-c8a3e7ec5654 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:28:55 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0d217dc5-6706-4971-a3c5-c8a3e7ec5654 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:28:55 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0d217dc5-6706-4971-a3c5-c8a3e7ec5654 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:28:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0d217dc5-6706-4971-a3c5-c8a3e7ec5654 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:28:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0d217dc5-6706-4971-a3c5-c8a3e7ec5654 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:55 devstack sudo[103748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:28:55 devstack sudo[103748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:55 devstack sudo[103748]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0d217dc5-6706-4971-a3c5-c8a3e7ec5654 tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.237s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:55 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-0d217dc5-6706-4971-a3c5-c8a3e7ec5654 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:28:55 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-0d217dc5-6706-4971-a3c5-c8a3e7ec5654 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Deleted volume successfully. Sep 03 11:28:55 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-0d217dc5-6706-4971-a3c5-c8a3e7ec5654 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "cinder-1371898e-6142-4368-a9c9-87a0f5288428-delete_volume" released by "delete_volume" :: held 1.031s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:28:55 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-023f3dfe-642a-4ed9-bd03-341121c925f9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Acquiring lock "cinder-598519ca-40ce-4176-bf80-d06b006acf90-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:28:55 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-023f3dfe-642a-4ed9-bd03-341121c925f9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "cinder-598519ca-40ce-4176-bf80-d06b006acf90-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:28:55 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-023f3dfe-642a-4ed9-bd03-341121c925f9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Acquiring lock "cinder-quobyte-598519ca-40ce-4176-bf80-d06b006acf90" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:28:55 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-023f3dfe-642a-4ed9-bd03-341121c925f9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "cinder-quobyte-598519ca-40ce-4176-bf80-d06b006acf90" acquired by "delete_volume" :: waited 0.019s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:28:55 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[339d5c29-c971-462d-91d8-843d414e1b34]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:28:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-023f3dfe-642a-4ed9-bd03-341121c925f9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-598519ca-40ce-4176-bf80-d06b006acf90 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:55 devstack sudo[103751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-598519ca-40ce-4176-bf80-d06b006acf90 Sep 03 11:28:55 devstack sudo[103751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:55 devstack sudo[103751]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-023f3dfe-642a-4ed9-bd03-341121c925f9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-598519ca-40ce-4176-bf80-d06b006acf90" returned: 0 in 0.350s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-023f3dfe-642a-4ed9-bd03-341121c925f9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-598519ca-40ce-4176-bf80-d06b006acf90 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:55 devstack sudo[103756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-598519ca-40ce-4176-bf80-d06b006acf90 Sep 03 11:28:55 devstack sudo[103756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:56 devstack sudo[103756]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-023f3dfe-642a-4ed9-bd03-341121c925f9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-598519ca-40ce-4176-bf80-d06b006acf90" returned: 0 in 0.244s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:56 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-023f3dfe-642a-4ed9-bd03-341121c925f9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "cinder-quobyte-598519ca-40ce-4176-bf80-d06b006acf90" released by "delete_volume" :: held 0.633s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:28:56 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-023f3dfe-642a-4ed9-bd03-341121c925f9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Created reservations ['bbf5be43-8f97-44b6-af84-75327200ae70', '47451e03-2be3-4825-96cd-7e7f82744da8', '1646c3f9-5e1b-4ba1-9216-0abacb003b13', 'a1929f52-82cc-46e6-92ab-685102e2d35f'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:28:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-023f3dfe-642a-4ed9-bd03-341121c925f9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:28:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-023f3dfe-642a-4ed9-bd03-341121c925f9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:28:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-023f3dfe-642a-4ed9-bd03-341121c925f9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:28:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-023f3dfe-642a-4ed9-bd03-341121c925f9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:28:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-023f3dfe-642a-4ed9-bd03-341121c925f9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:28:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-023f3dfe-642a-4ed9-bd03-341121c925f9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:56 devstack sudo[103759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:28:56 devstack sudo[103759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:56 devstack sudo[103759]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-023f3dfe-642a-4ed9-bd03-341121c925f9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.246s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:56 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-023f3dfe-642a-4ed9-bd03-341121c925f9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:28:56 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-023f3dfe-642a-4ed9-bd03-341121c925f9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Deleted volume successfully. Sep 03 11:28:56 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-023f3dfe-642a-4ed9-bd03-341121c925f9 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "cinder-598519ca-40ce-4176-bf80-d06b006acf90-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:28:56 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d46ff8dd-1921-4c58-bdfb-63465214c33e tempest-CreateVolumesFromSnapshotTest-1305569996 None] Acquiring lock "cinder-7e80641a-6c6e-4358-96ba-715cf51f8f63-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:28:56 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d46ff8dd-1921-4c58-bdfb-63465214c33e tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "cinder-7e80641a-6c6e-4358-96ba-715cf51f8f63-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:28:56 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d46ff8dd-1921-4c58-bdfb-63465214c33e tempest-CreateVolumesFromSnapshotTest-1305569996 None] Acquiring lock "cinder-quobyte-7e80641a-6c6e-4358-96ba-715cf51f8f63" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:28:56 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d46ff8dd-1921-4c58-bdfb-63465214c33e tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "cinder-quobyte-7e80641a-6c6e-4358-96ba-715cf51f8f63" acquired by "delete_volume" :: waited 0.016s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:28:56 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[130309a5-dc0f-41dc-883e-5e42cf7109ac]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:28:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d46ff8dd-1921-4c58-bdfb-63465214c33e tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7e80641a-6c6e-4358-96ba-715cf51f8f63 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:56 devstack sudo[103762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7e80641a-6c6e-4358-96ba-715cf51f8f63 Sep 03 11:28:56 devstack sudo[103762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:57 devstack sudo[103762]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d46ff8dd-1921-4c58-bdfb-63465214c33e tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7e80641a-6c6e-4358-96ba-715cf51f8f63" returned: 0 in 0.392s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d46ff8dd-1921-4c58-bdfb-63465214c33e tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7e80641a-6c6e-4358-96ba-715cf51f8f63 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:57 devstack sudo[103767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7e80641a-6c6e-4358-96ba-715cf51f8f63 Sep 03 11:28:57 devstack sudo[103767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:57 devstack sudo[103767]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d46ff8dd-1921-4c58-bdfb-63465214c33e tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7e80641a-6c6e-4358-96ba-715cf51f8f63" returned: 0 in 0.256s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:57 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d46ff8dd-1921-4c58-bdfb-63465214c33e tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "cinder-quobyte-7e80641a-6c6e-4358-96ba-715cf51f8f63" released by "delete_volume" :: held 0.686s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:28:57 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-d46ff8dd-1921-4c58-bdfb-63465214c33e tempest-CreateVolumesFromSnapshotTest-1305569996 None] Created reservations ['d4bdf7f4-bc16-4e19-8bf8-7c594b320216', 'a735458b-439e-411b-9dbe-40863aa23119', '35d42ec1-a3a3-4de3-a91a-107cf329d531', '93ff0c08-872d-4fea-a402-422162d3f0ac'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:28:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d46ff8dd-1921-4c58-bdfb-63465214c33e tempest-CreateVolumesFromSnapshotTest-1305569996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:28:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d46ff8dd-1921-4c58-bdfb-63465214c33e tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:28:57 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d46ff8dd-1921-4c58-bdfb-63465214c33e tempest-CreateVolumesFromSnapshotTest-1305569996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:28:57 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d46ff8dd-1921-4c58-bdfb-63465214c33e tempest-CreateVolumesFromSnapshotTest-1305569996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:28:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d46ff8dd-1921-4c58-bdfb-63465214c33e tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:28:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d46ff8dd-1921-4c58-bdfb-63465214c33e tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:57 devstack sudo[103770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:28:57 devstack sudo[103770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:57 devstack sudo[103770]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d46ff8dd-1921-4c58-bdfb-63465214c33e tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.262s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:57 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-d46ff8dd-1921-4c58-bdfb-63465214c33e tempest-CreateVolumesFromSnapshotTest-1305569996 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:28:57 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-d46ff8dd-1921-4c58-bdfb-63465214c33e tempest-CreateVolumesFromSnapshotTest-1305569996 None] Deleted volume successfully. Sep 03 11:28:57 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e8a54283-4cd0-4b6e-a228-e7b2356057e3 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Acquiring lock "cinder-18b17a58-32b6-4d72-8e08-13a46a343879-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:28:57 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e8a54283-4cd0-4b6e-a228-e7b2356057e3 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "cinder-18b17a58-32b6-4d72-8e08-13a46a343879-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:28:57 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d46ff8dd-1921-4c58-bdfb-63465214c33e tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "cinder-7e80641a-6c6e-4358-96ba-715cf51f8f63-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:28:57 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e8a54283-4cd0-4b6e-a228-e7b2356057e3 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Acquiring lock "cinder-quobyte-18b17a58-32b6-4d72-8e08-13a46a343879" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:28:57 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e8a54283-4cd0-4b6e-a228-e7b2356057e3 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "cinder-quobyte-18b17a58-32b6-4d72-8e08-13a46a343879" acquired by "delete_volume" :: waited 0.019s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:28:57 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7babc2-5a5d-43cb-91d4-ce222c4c595a]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:28:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e8a54283-4cd0-4b6e-a228-e7b2356057e3 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-18b17a58-32b6-4d72-8e08-13a46a343879 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:57 devstack sudo[103773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-18b17a58-32b6-4d72-8e08-13a46a343879 Sep 03 11:28:57 devstack sudo[103773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:58 devstack sudo[103773]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e8a54283-4cd0-4b6e-a228-e7b2356057e3 tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-18b17a58-32b6-4d72-8e08-13a46a343879" returned: 0 in 0.357s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e8a54283-4cd0-4b6e-a228-e7b2356057e3 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-18b17a58-32b6-4d72-8e08-13a46a343879 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:58 devstack sudo[103778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-18b17a58-32b6-4d72-8e08-13a46a343879 Sep 03 11:28:58 devstack sudo[103778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:58 devstack sudo[103778]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e8a54283-4cd0-4b6e-a228-e7b2356057e3 tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-18b17a58-32b6-4d72-8e08-13a46a343879" returned: 0 in 0.249s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:58 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e8a54283-4cd0-4b6e-a228-e7b2356057e3 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "cinder-quobyte-18b17a58-32b6-4d72-8e08-13a46a343879" released by "delete_volume" :: held 0.650s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:28:58 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-e8a54283-4cd0-4b6e-a228-e7b2356057e3 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Created reservations ['0129e988-2e94-4468-9f63-7971f989c3da', '1d7823af-1b47-4e1a-9614-299f00f88a71', 'd9daacb5-e4be-4205-a2a7-c36ae027447e', '47e7f1fb-484d-46eb-bb36-ddeddd8f8f9d'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:28:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e8a54283-4cd0-4b6e-a228-e7b2356057e3 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:28:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e8a54283-4cd0-4b6e-a228-e7b2356057e3 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:28:58 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e8a54283-4cd0-4b6e-a228-e7b2356057e3 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:28:58 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e8a54283-4cd0-4b6e-a228-e7b2356057e3 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:28:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e8a54283-4cd0-4b6e-a228-e7b2356057e3 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:28:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e8a54283-4cd0-4b6e-a228-e7b2356057e3 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:58 devstack sudo[103782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:28:58 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:58 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e8a54283-4cd0-4b6e-a228-e7b2356057e3 tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.239s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:58 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-e8a54283-4cd0-4b6e-a228-e7b2356057e3 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:28:58 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-e8a54283-4cd0-4b6e-a228-e7b2356057e3 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Deleted volume successfully. Sep 03 11:28:58 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e8a54283-4cd0-4b6e-a228-e7b2356057e3 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "cinder-18b17a58-32b6-4d72-8e08-13a46a343879-delete_volume" released by "delete_volume" :: held 1.092s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:28:59 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5be5ac6e-2ad6-45aa-832e-582ec5369004 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Acquiring lock "cinder-a588c046-5d14-4618-84d2-f899678437f1-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:28:59 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5be5ac6e-2ad6-45aa-832e-582ec5369004 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "cinder-a588c046-5d14-4618-84d2-f899678437f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:28:59 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5be5ac6e-2ad6-45aa-832e-582ec5369004 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Acquiring lock "cinder-quobyte-694b98ba-1f2b-470a-9f0d-9816b73c01c1" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:28:59 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5be5ac6e-2ad6-45aa-832e-582ec5369004 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "cinder-quobyte-694b98ba-1f2b-470a-9f0d-9816b73c01c1" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:28:59 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5be5ac6e-2ad6-45aa-832e-582ec5369004 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Acquiring lock "cinder-quobyte-a588c046-5d14-4618-84d2-f899678437f1" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:28:59 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5be5ac6e-2ad6-45aa-832e-582ec5369004 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "cinder-quobyte-a588c046-5d14-4618-84d2-f899678437f1" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:28:59 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-5be5ac6e-2ad6-45aa-832e-582ec5369004 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Deleting offline snapshot a588c046-5d14-4618-84d2-f899678437f1 of volume 694b98ba-1f2b-470a-9f0d-9816b73c01c1 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:28:59 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-5be5ac6e-2ad6-45aa-832e-582ec5369004 tempest-CreateVolumesFromSnapshotTest-1305569996 None] snapshot_file for this snap is: volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1.a588c046-5d14-4618-84d2-f899678437f1 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:28:59 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e815395-8c5a-4e3f-bfcc-1e59d2726fdd]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:28:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5be5ac6e-2ad6-45aa-832e-582ec5369004 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1.a588c046-5d14-4618-84d2-f899678437f1 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:59 devstack sudo[103785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1.a588c046-5d14-4618-84d2-f899678437f1 Sep 03 11:28:59 devstack sudo[103785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:59 devstack sudo[103785]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5be5ac6e-2ad6-45aa-832e-582ec5369004 tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1.a588c046-5d14-4618-84d2-f899678437f1" returned: 0 in 0.342s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:59 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-5be5ac6e-2ad6-45aa-832e-582ec5369004 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:28:59 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae0ad11-e6fb-4f02-88c0-aa7681eed8d3]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:28:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5be5ac6e-2ad6-45aa-832e-582ec5369004 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:59 devstack sudo[103790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1 Sep 03 11:28:59 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:28:59 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root Sep 03 11:28:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5be5ac6e-2ad6-45aa-832e-582ec5369004 tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1" returned: 0 in 0.349s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:28:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5be5ac6e-2ad6-45aa-832e-582ec5369004 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1.a588c046-5d14-4618-84d2-f899678437f1 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:28:59 devstack sudo[103795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1.a588c046-5d14-4618-84d2-f899678437f1 Sep 03 11:28:59 devstack sudo[103795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:00 devstack sudo[103795]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5be5ac6e-2ad6-45aa-832e-582ec5369004 tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1.a588c046-5d14-4618-84d2-f899678437f1" returned: 0 in 0.326s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5be5ac6e-2ad6-45aa-832e-582ec5369004 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1.a588c046-5d14-4618-84d2-f899678437f1 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:00 devstack sudo[103801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1.a588c046-5d14-4618-84d2-f899678437f1 Sep 03 11:29:00 devstack sudo[103801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:00 devstack sudo[103801]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5be5ac6e-2ad6-45aa-832e-582ec5369004 tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1.a588c046-5d14-4618-84d2-f899678437f1" returned: 0 in 0.247s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:00 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5be5ac6e-2ad6-45aa-832e-582ec5369004 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "cinder-quobyte-a588c046-5d14-4618-84d2-f899678437f1" released by "_delete_snapshot" :: held 1.359s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:29:00 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5be5ac6e-2ad6-45aa-832e-582ec5369004 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "cinder-quobyte-694b98ba-1f2b-470a-9f0d-9816b73c01c1" released by "delete_snapshot" :: held 1.379s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:29:00 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-5be5ac6e-2ad6-45aa-832e-582ec5369004 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Created reservations ['cd16d1e0-232e-4981-bce4-263016273cbb', '39b685d8-86e1-4fbf-b9f4-270cddf68dfc', '52747ff5-e194-42b3-ba30-ee05f53574d7', 'a231eb5f-0d04-4752-8464-33c49cc9f48d'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:29:00 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-5be5ac6e-2ad6-45aa-832e-582ec5369004 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Delete snapshot completed successfully. Sep 03 11:29:00 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5be5ac6e-2ad6-45aa-832e-582ec5369004 tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "cinder-a588c046-5d14-4618-84d2-f899678437f1-delete_snapshot" released by "delete_snapshot" :: held 1.503s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:29:01 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-554fa8ff-b2ea-433f-bd64-4b1e2ad3e03a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Acquiring lock "cinder-694b98ba-1f2b-470a-9f0d-9816b73c01c1-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:29:01 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-554fa8ff-b2ea-433f-bd64-4b1e2ad3e03a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "cinder-694b98ba-1f2b-470a-9f0d-9816b73c01c1-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:29:01 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-554fa8ff-b2ea-433f-bd64-4b1e2ad3e03a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Acquiring lock "cinder-quobyte-694b98ba-1f2b-470a-9f0d-9816b73c01c1" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:29:01 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-554fa8ff-b2ea-433f-bd64-4b1e2ad3e03a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "cinder-quobyte-694b98ba-1f2b-470a-9f0d-9816b73c01c1" acquired by "delete_volume" :: waited 0.016s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:29:01 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea98570-e47a-4119-81a8-0fe5db8118b5]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:29:01 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-554fa8ff-b2ea-433f-bd64-4b1e2ad3e03a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:01 devstack sudo[103804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1 Sep 03 11:29:01 devstack sudo[103804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:01 devstack sudo[103804]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:01 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-554fa8ff-b2ea-433f-bd64-4b1e2ad3e03a tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1" returned: 0 in 0.367s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:01 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-554fa8ff-b2ea-433f-bd64-4b1e2ad3e03a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:01 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1 Sep 03 11:29:01 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:02 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-554fa8ff-b2ea-433f-bd64-4b1e2ad3e03a tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-694b98ba-1f2b-470a-9f0d-9816b73c01c1" returned: 0 in 0.260s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:02 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-554fa8ff-b2ea-433f-bd64-4b1e2ad3e03a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "cinder-quobyte-694b98ba-1f2b-470a-9f0d-9816b73c01c1" released by "delete_volume" :: held 0.684s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:29:02 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-554fa8ff-b2ea-433f-bd64-4b1e2ad3e03a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Created reservations ['b27104b7-6819-4e43-af60-c47140069c05', '1c7736a8-765c-4f30-8ae4-61c040a712e8', '33a7e6c6-89e3-44f6-a87e-d2ab45ec3336', '72c10679-8e38-4d32-8a0d-d4c478de3532'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:29:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-554fa8ff-b2ea-433f-bd64-4b1e2ad3e03a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:29:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-554fa8ff-b2ea-433f-bd64-4b1e2ad3e03a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:29:02 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-554fa8ff-b2ea-433f-bd64-4b1e2ad3e03a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:29:02 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-554fa8ff-b2ea-433f-bd64-4b1e2ad3e03a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:29:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-554fa8ff-b2ea-433f-bd64-4b1e2ad3e03a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:29:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-554fa8ff-b2ea-433f-bd64-4b1e2ad3e03a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:02 devstack sudo[103816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:29:02 devstack sudo[103816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:02 devstack sudo[103816]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-554fa8ff-b2ea-433f-bd64-4b1e2ad3e03a tempest-CreateVolumesFromSnapshotTest-1305569996 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.246s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:02 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-554fa8ff-b2ea-433f-bd64-4b1e2ad3e03a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:29:02 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-554fa8ff-b2ea-433f-bd64-4b1e2ad3e03a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Deleted volume successfully. Sep 03 11:29:02 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-554fa8ff-b2ea-433f-bd64-4b1e2ad3e03a tempest-CreateVolumesFromSnapshotTest-1305569996 None] Lock "cinder-694b98ba-1f2b-470a-9f0d-9816b73c01c1-delete_volume" released by "delete_volume" :: held 1.152s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:29:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-6c66c2c5-b27a-48c9-b46c-0cde3425358d req-02080d37-262f-4e2d-bdb4-ad5ef887da17 tempest-TestStampPattern-415769870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:29:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-6c66c2c5-b27a-48c9-b46c-0cde3425358d req-02080d37-262f-4e2d-bdb4-ad5ef887da17 tempest-TestStampPattern-415769870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:29:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-6c66c2c5-b27a-48c9-b46c-0cde3425358d req-02080d37-262f-4e2d-bdb4-ad5ef887da17 tempest-TestStampPattern-415769870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:29:02 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-6c66c2c5-b27a-48c9-b46c-0cde3425358d req-02080d37-262f-4e2d-bdb4-ad5ef887da17 tempest-TestStampPattern-415769870 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912', 'name': 'volume-4c63ecd4-5171-41ca-8f14-943222ffaba0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1e23ded2-93cd-4c8d-934b-d9094f62a5e3', 'enforce_multipath': True} {{(pid=87038) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:29:02 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-6c66c2c5-b27a-48c9-b46c-0cde3425358d req-02080d37-262f-4e2d-bdb4-ad5ef887da17 tempest-TestStampPattern-415769870 None] attachment_update completed successfully. Sep 03 11:29:05 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-c075d91b-9500-4554-9a93-3d623a2d7e8f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:29:05 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c075d91b-9500-4554-9a93-3d623a2d7e8f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Flow 'volume_create_manager' (23a4edef-9083-436c-a709-25a4a9b52efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:29:05 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c075d91b-9500-4554-9a93-3d623a2d7e8f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae2aa07-eee2-4052-8b1c-548a7a9ed1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:05 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c075d91b-9500-4554-9a93-3d623a2d7e8f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ae2aa07-eee2-4052-8b1c-548a7a9ed1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-844085478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e05f6b-792d-48e9-888e-08f9cadc0c23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00f7c2174a7436cb39fb6a21f3a0bfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:29:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:29:05Z,use_quota=True,user_id='b113fb49da984673a3ca92f94731d602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:05 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c075d91b-9500-4554-9a93-3d623a2d7e8f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b537b73-adec-406f-805d-64c2f8950b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:05 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c075d91b-9500-4554-9a93-3d623a2d7e8f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b537b73-adec-406f-805d-64c2f8950b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:05 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c075d91b-9500-4554-9a93-3d623a2d7e8f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2de763ae-cebc-4917-b286-fd409d877994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:05 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c075d91b-9500-4554-9a93-3d623a2d7e8f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2de763ae-cebc-4917-b286-fd409d877994) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99e05f6b-792d-48e9-888e-08f9cadc0c23', 'volume_name': 'volume-99e05f6b-792d-48e9-888e-08f9cadc0c23', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:05 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c075d91b-9500-4554-9a93-3d623a2d7e8f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9792cfa3-e831-465b-a56c-265e7cc4700e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:05 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c075d91b-9500-4554-9a93-3d623a2d7e8f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9792cfa3-e831-465b-a56c-265e7cc4700e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:05 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c075d91b-9500-4554-9a93-3d623a2d7e8f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c96b912-0756-4e2e-ae20-a3969849a4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:05 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-c075d91b-9500-4554-9a93-3d623a2d7e8f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Volume 99e05f6b-792d-48e9-888e-08f9cadc0c23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99e05f6b-792d-48e9-888e-08f9cadc0c23', 'volume_size': 1} Sep 03 11:29:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-c075d91b-9500-4554-9a93-3d623a2d7e8f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:29:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-c075d91b-9500-4554-9a93-3d623a2d7e8f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:29:05 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-c075d91b-9500-4554-9a93-3d623a2d7e8f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:29:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-844085478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99e05f6b-792d-48e9-888e-08f9cadc0c23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00f7c2174a7436cb39fb6a21f3a0bfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:29:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:29:05Z,use_quota=True,user_id='b113fb49da984673a3ca92f94731d602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:29:05 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-c075d91b-9500-4554-9a93-3d623a2d7e8f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Creating volume 99e05f6b-792d-48e9-888e-08f9cadc0c23 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:29:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-c075d91b-9500-4554-9a93-3d623a2d7e8f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:29:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-c075d91b-9500-4554-9a93-3d623a2d7e8f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:29:05 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-c075d91b-9500-4554-9a93-3d623a2d7e8f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:29:05 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-c075d91b-9500-4554-9a93-3d623a2d7e8f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:29:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-c075d91b-9500-4554-9a93-3d623a2d7e8f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:29:05 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-c075d91b-9500-4554-9a93-3d623a2d7e8f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:29:05 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-c075d91b-9500-4554-9a93-3d623a2d7e8f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:29:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c075d91b-9500-4554-9a93-3d623a2d7e8f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99e05f6b-792d-48e9-888e-08f9cadc0c23 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:05 devstack sudo[104223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99e05f6b-792d-48e9-888e-08f9cadc0c23 1073741824 Sep 03 11:29:05 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:05 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c075d91b-9500-4554-9a93-3d623a2d7e8f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99e05f6b-792d-48e9-888e-08f9cadc0c23 1073741824" returned: 0 in 0.422s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c075d91b-9500-4554-9a93-3d623a2d7e8f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99e05f6b-792d-48e9-888e-08f9cadc0c23 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:05 devstack sudo[104229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99e05f6b-792d-48e9-888e-08f9cadc0c23 Sep 03 11:29:05 devstack sudo[104229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:05 devstack sudo[104229]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c075d91b-9500-4554-9a93-3d623a2d7e8f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99e05f6b-792d-48e9-888e-08f9cadc0c23" returned: 0 in 0.238s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:05 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-c075d91b-9500-4554-9a93-3d623a2d7e8f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:29:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-c075d91b-9500-4554-9a93-3d623a2d7e8f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:29:06 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c075d91b-9500-4554-9a93-3d623a2d7e8f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c96b912-0756-4e2e-ae20-a3969849a4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99e05f6b-792d-48e9-888e-08f9cadc0c23', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:06 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c075d91b-9500-4554-9a93-3d623a2d7e8f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36c4536-8bca-468f-8b8c-da4b95e517bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:06 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-c075d91b-9500-4554-9a93-3d623a2d7e8f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Volume volume-99e05f6b-792d-48e9-888e-08f9cadc0c23 (99e05f6b-792d-48e9-888e-08f9cadc0c23): created successfully Sep 03 11:29:06 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c075d91b-9500-4554-9a93-3d623a2d7e8f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d36c4536-8bca-468f-8b8c-da4b95e517bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:06 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-c075d91b-9500-4554-9a93-3d623a2d7e8f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Flow 'volume_create_manager' (23a4edef-9083-436c-a709-25a4a9b52efb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:29:06 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-c075d91b-9500-4554-9a93-3d623a2d7e8f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Created volume successfully. Sep 03 11:29:06 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac15d4d6-f981-4633-b1a2-d7ef73d66d62 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:29:06 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ac15d4d6-f981-4633-b1a2-d7ef73d66d62 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Flow 'volume_create_manager' (a97016c4-4011-48aa-a670-59202c6ce3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:29:06 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ac15d4d6-f981-4633-b1a2-d7ef73d66d62 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc10c824-05ff-4fd7-a8d6-ccf631e17878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:06 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ac15d4d6-f981-4633-b1a2-d7ef73d66d62 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc10c824-05ff-4fd7-a8d6-ccf631e17878) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-723589723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37af89e6-ebcf-4d37-8183-82557d22fd1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00f7c2174a7436cb39fb6a21f3a0bfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:29:07Z,use_quota=True,user_id='b113fb49da984673a3ca92f94731d602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:06 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ac15d4d6-f981-4633-b1a2-d7ef73d66d62 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b8481a1-c869-4ea7-a4bf-d82292c1bf38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:06 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ac15d4d6-f981-4633-b1a2-d7ef73d66d62 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b8481a1-c869-4ea7-a4bf-d82292c1bf38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:06 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ac15d4d6-f981-4633-b1a2-d7ef73d66d62 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0df5b26-cefb-4c88-869a-bbc4e1fbf366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:06 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ac15d4d6-f981-4633-b1a2-d7ef73d66d62 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0df5b26-cefb-4c88-869a-bbc4e1fbf366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37af89e6-ebcf-4d37-8183-82557d22fd1d', 'volume_name': 'volume-37af89e6-ebcf-4d37-8183-82557d22fd1d', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:06 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ac15d4d6-f981-4633-b1a2-d7ef73d66d62 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ff1cf34-00e2-43f8-a224-97f46572c216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:06 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ac15d4d6-f981-4633-b1a2-d7ef73d66d62 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ff1cf34-00e2-43f8-a224-97f46572c216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:06 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ac15d4d6-f981-4633-b1a2-d7ef73d66d62 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10876cae-67bd-40fd-80f0-341c4530ce0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:06 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-ac15d4d6-f981-4633-b1a2-d7ef73d66d62 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Volume 37af89e6-ebcf-4d37-8183-82557d22fd1d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37af89e6-ebcf-4d37-8183-82557d22fd1d', 'volume_size': 1} Sep 03 11:29:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ac15d4d6-f981-4633-b1a2-d7ef73d66d62 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:29:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ac15d4d6-f981-4633-b1a2-d7ef73d66d62 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:29:06 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ac15d4d6-f981-4633-b1a2-d7ef73d66d62 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-723589723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37af89e6-ebcf-4d37-8183-82557d22fd1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00f7c2174a7436cb39fb6a21f3a0bfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:29:07Z,use_quota=True,user_id='b113fb49da984673a3ca92f94731d602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:29:06 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-ac15d4d6-f981-4633-b1a2-d7ef73d66d62 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Creating volume 37af89e6-ebcf-4d37-8183-82557d22fd1d {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:29:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ac15d4d6-f981-4633-b1a2-d7ef73d66d62 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:29:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ac15d4d6-f981-4633-b1a2-d7ef73d66d62 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:29:06 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ac15d4d6-f981-4633-b1a2-d7ef73d66d62 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:29:06 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ac15d4d6-f981-4633-b1a2-d7ef73d66d62 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:29:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ac15d4d6-f981-4633-b1a2-d7ef73d66d62 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:29:06 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ac15d4d6-f981-4633-b1a2-d7ef73d66d62 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:29:06 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-ac15d4d6-f981-4633-b1a2-d7ef73d66d62 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:29:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ac15d4d6-f981-4633-b1a2-d7ef73d66d62 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-37af89e6-ebcf-4d37-8183-82557d22fd1d 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:06 devstack sudo[104237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-37af89e6-ebcf-4d37-8183-82557d22fd1d 1073741824 Sep 03 11:29:06 devstack sudo[104237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-3694ab8f-6ef2-4475-b76e-80b2fdc3e065 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3694ab8f-6ef2-4475-b76e-80b2fdc3e065 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Flow 'volume_create_manager' (8dafa2b5-5960-4005-9385-72d6abf80b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3694ab8f-6ef2-4475-b76e-80b2fdc3e065 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4958552-fafe-406e-b310-d3482768118c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3694ab8f-6ef2-4475-b76e-80b2fdc3e065 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4958552-fafe-406e-b310-d3482768118c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-687125929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab2ca967-5e40-44ba-ac6c-1c56fdab946d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00f7c2174a7436cb39fb6a21f3a0bfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:29:07Z,use_quota=True,user_id='b113fb49da984673a3ca92f94731d602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3694ab8f-6ef2-4475-b76e-80b2fdc3e065 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626c3e99-e49b-47ec-aed2-8f0a6e9a04ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3694ab8f-6ef2-4475-b76e-80b2fdc3e065 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626c3e99-e49b-47ec-aed2-8f0a6e9a04ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3694ab8f-6ef2-4475-b76e-80b2fdc3e065 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67941037-7d0a-44f8-b4d0-30cbb3f9cf16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3694ab8f-6ef2-4475-b76e-80b2fdc3e065 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67941037-7d0a-44f8-b4d0-30cbb3f9cf16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab2ca967-5e40-44ba-ac6c-1c56fdab946d', 'volume_name': 'volume-ab2ca967-5e40-44ba-ac6c-1c56fdab946d', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3694ab8f-6ef2-4475-b76e-80b2fdc3e065 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce1b1aa2-effd-4e77-9dd2-042a5017dd3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3694ab8f-6ef2-4475-b76e-80b2fdc3e065 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce1b1aa2-effd-4e77-9dd2-042a5017dd3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3694ab8f-6ef2-4475-b76e-80b2fdc3e065 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e58d8afd-bcbf-4332-b7f5-388e3df25770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:07 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-3694ab8f-6ef2-4475-b76e-80b2fdc3e065 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Volume ab2ca967-5e40-44ba-ac6c-1c56fdab946d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab2ca967-5e40-44ba-ac6c-1c56fdab946d', 'volume_size': 1} Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3694ab8f-6ef2-4475-b76e-80b2fdc3e065 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:29:07 devstack sudo[104237]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ac15d4d6-f981-4633-b1a2-d7ef73d66d62 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-37af89e6-ebcf-4d37-8183-82557d22fd1d 1073741824" returned: 0 in 0.526s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ac15d4d6-f981-4633-b1a2-d7ef73d66d62 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-37af89e6-ebcf-4d37-8183-82557d22fd1d {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:07 devstack sudo[104250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-37af89e6-ebcf-4d37-8183-82557d22fd1d Sep 03 11:29:07 devstack sudo[104250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e4cb0c6-622a-4979-9973-8fad6617d7b4 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4e4cb0c6-622a-4979-9973-8fad6617d7b4 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Flow 'volume_create_manager' (1e49b3ab-d6f5-459e-9da5-8eefdaeb4fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4e4cb0c6-622a-4979-9973-8fad6617d7b4 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (979f6327-b73b-4ce8-8dc2-9e02b47f1947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4e4cb0c6-622a-4979-9973-8fad6617d7b4 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (979f6327-b73b-4ce8-8dc2-9e02b47f1947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1863288228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7df5289d-3d60-4b19-8099-715d7d07327c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00f7c2174a7436cb39fb6a21f3a0bfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:29:08Z,use_quota=True,user_id='b113fb49da984673a3ca92f94731d602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4e4cb0c6-622a-4979-9973-8fad6617d7b4 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1da9b6a9-773d-4aa1-8a70-b722c190b96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4e4cb0c6-622a-4979-9973-8fad6617d7b4 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1da9b6a9-773d-4aa1-8a70-b722c190b96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:07 devstack sudo[104250]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4e4cb0c6-622a-4979-9973-8fad6617d7b4 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe77ef7-eb9c-46bb-b75b-85aec7d84b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4e4cb0c6-622a-4979-9973-8fad6617d7b4 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbe77ef7-eb9c-46bb-b75b-85aec7d84b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7df5289d-3d60-4b19-8099-715d7d07327c', 'volume_name': 'volume-7df5289d-3d60-4b19-8099-715d7d07327c', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4e4cb0c6-622a-4979-9973-8fad6617d7b4 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39119244-9086-4712-8408-17c4327bbc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4e4cb0c6-622a-4979-9973-8fad6617d7b4 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39119244-9086-4712-8408-17c4327bbc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4e4cb0c6-622a-4979-9973-8fad6617d7b4 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0192222-c54d-4259-8640-a28543b47047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:07 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-4e4cb0c6-622a-4979-9973-8fad6617d7b4 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Volume 7df5289d-3d60-4b19-8099-715d7d07327c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7df5289d-3d60-4b19-8099-715d7d07327c', 'volume_size': 1} Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4e4cb0c6-622a-4979-9973-8fad6617d7b4 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ac15d4d6-f981-4633-b1a2-d7ef73d66d62 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-37af89e6-ebcf-4d37-8183-82557d22fd1d" returned: 0 in 0.390s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ac15d4d6-f981-4633-b1a2-d7ef73d66d62 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ac15d4d6-f981-4633-b1a2-d7ef73d66d62 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3694ab8f-6ef2-4475-b76e-80b2fdc3e065 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.602s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-3694ab8f-6ef2-4475-b76e-80b2fdc3e065 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-687125929',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab2ca967-5e40-44ba-ac6c-1c56fdab946d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00f7c2174a7436cb39fb6a21f3a0bfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:29:07Z,use_quota=True,user_id='b113fb49da984673a3ca92f94731d602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-3694ab8f-6ef2-4475-b76e-80b2fdc3e065 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Creating volume ab2ca967-5e40-44ba-ac6c-1c56fdab946d {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3694ab8f-6ef2-4475-b76e-80b2fdc3e065 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3694ab8f-6ef2-4475-b76e-80b2fdc3e065 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-3694ab8f-6ef2-4475-b76e-80b2fdc3e065 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-3694ab8f-6ef2-4475-b76e-80b2fdc3e065 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3694ab8f-6ef2-4475-b76e-80b2fdc3e065 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-3694ab8f-6ef2-4475-b76e-80b2fdc3e065 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:29:07 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-3694ab8f-6ef2-4475-b76e-80b2fdc3e065 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3694ab8f-6ef2-4475-b76e-80b2fdc3e065 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2ca967-5e40-44ba-ac6c-1c56fdab946d 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ac15d4d6-f981-4633-b1a2-d7ef73d66d62 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10876cae-67bd-40fd-80f0-341c4530ce0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37af89e6-ebcf-4d37-8183-82557d22fd1d', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:07 devstack sudo[104253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2ca967-5e40-44ba-ac6c-1c56fdab946d 1073741824 Sep 03 11:29:07 devstack sudo[104253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ac15d4d6-f981-4633-b1a2-d7ef73d66d62 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb963c5f-22c5-410e-bf37-db3997edcb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:07 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-ac15d4d6-f981-4633-b1a2-d7ef73d66d62 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Volume volume-37af89e6-ebcf-4d37-8183-82557d22fd1d (37af89e6-ebcf-4d37-8183-82557d22fd1d): created successfully Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ac15d4d6-f981-4633-b1a2-d7ef73d66d62 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb963c5f-22c5-410e-bf37-db3997edcb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ac15d4d6-f981-4633-b1a2-d7ef73d66d62 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Flow 'volume_create_manager' (a97016c4-4011-48aa-a670-59202c6ce3e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:29:07 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-ac15d4d6-f981-4633-b1a2-d7ef73d66d62 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Created volume successfully. Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-04c92a9e-0d61-4f2b-a7e9-201a1610ff7c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-04c92a9e-0d61-4f2b-a7e9-201a1610ff7c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Flow 'volume_create_manager' (4a4cb6c9-824a-40db-afe0-f83c1a744ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-04c92a9e-0d61-4f2b-a7e9-201a1610ff7c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b026bd3d-3cd2-4a2e-9f4a-8dac684c2021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-04c92a9e-0d61-4f2b-a7e9-201a1610ff7c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b026bd3d-3cd2-4a2e-9f4a-8dac684c2021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1791944242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e245ddb1-3bf8-4142-85b8-6ffe17428f97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00f7c2174a7436cb39fb6a21f3a0bfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:29:08Z,use_quota=True,user_id='b113fb49da984673a3ca92f94731d602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-04c92a9e-0d61-4f2b-a7e9-201a1610ff7c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be862195-beca-48ab-8228-3066ccebadcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-04c92a9e-0d61-4f2b-a7e9-201a1610ff7c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be862195-beca-48ab-8228-3066ccebadcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-04c92a9e-0d61-4f2b-a7e9-201a1610ff7c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4967755-5dff-4654-b417-eb9bcc71b969) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-04c92a9e-0d61-4f2b-a7e9-201a1610ff7c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4967755-5dff-4654-b417-eb9bcc71b969) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e245ddb1-3bf8-4142-85b8-6ffe17428f97', 'volume_name': 'volume-e245ddb1-3bf8-4142-85b8-6ffe17428f97', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-04c92a9e-0d61-4f2b-a7e9-201a1610ff7c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd36dd03-aa9b-4355-b5f1-993d296d1bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-04c92a9e-0d61-4f2b-a7e9-201a1610ff7c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd36dd03-aa9b-4355-b5f1-993d296d1bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-04c92a9e-0d61-4f2b-a7e9-201a1610ff7c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64693860-7bbd-49d6-b95a-9f8959a50d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:08 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-04c92a9e-0d61-4f2b-a7e9-201a1610ff7c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Volume e245ddb1-3bf8-4142-85b8-6ffe17428f97: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e245ddb1-3bf8-4142-85b8-6ffe17428f97', 'volume_size': 1} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-04c92a9e-0d61-4f2b-a7e9-201a1610ff7c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:29:08 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-803b9669-75d2-4fdf-bafa-4b2503916fb4 req-e7bdf14e-cdc6-4d72-bb7e-352147b6a611 tempest-TestStampPattern-415769870 None] Terminate volume connection completed successfully. Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-803b9669-75d2-4fdf-bafa-4b2503916fb4 req-e7bdf14e-cdc6-4d72-bb7e-352147b6a611 tempest-TestStampPattern-415769870 None] Deleting attachment 1e23ded2-93cd-4c8d-934b-d9094f62a5e3. {{(pid=87038) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:29:08 devstack sudo[104253]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3694ab8f-6ef2-4475-b76e-80b2fdc3e065 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2ca967-5e40-44ba-ac6c-1c56fdab946d 1073741824" returned: 0 in 0.724s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-02bd5f31-499b-4e01-a49a-5dc9c5456ee9 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-02bd5f31-499b-4e01-a49a-5dc9c5456ee9 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Flow 'volume_create_manager' (b298562e-eddc-4d8a-9876-6ccb37c93c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-02bd5f31-499b-4e01-a49a-5dc9c5456ee9 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb4b2291-6c19-431a-a575-b66695b96222) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-02bd5f31-499b-4e01-a49a-5dc9c5456ee9 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb4b2291-6c19-431a-a575-b66695b96222) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-808294795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22b92a75-c0cc-45df-8893-8069db427e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00f7c2174a7436cb39fb6a21f3a0bfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:29:08Z,use_quota=True,user_id='b113fb49da984673a3ca92f94731d602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-02bd5f31-499b-4e01-a49a-5dc9c5456ee9 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edae4e43-dd36-43cc-a90d-6340c0a62cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-02bd5f31-499b-4e01-a49a-5dc9c5456ee9 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edae4e43-dd36-43cc-a90d-6340c0a62cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-02bd5f31-499b-4e01-a49a-5dc9c5456ee9 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac4e3296-550f-4b8e-8b8c-c45d53db0618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-02bd5f31-499b-4e01-a49a-5dc9c5456ee9 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac4e3296-550f-4b8e-8b8c-c45d53db0618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22b92a75-c0cc-45df-8893-8069db427e5b', 'volume_name': 'volume-22b92a75-c0cc-45df-8893-8069db427e5b', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-02bd5f31-499b-4e01-a49a-5dc9c5456ee9 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5121f5b-d643-469c-8d3f-5a6960415114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-02bd5f31-499b-4e01-a49a-5dc9c5456ee9 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5121f5b-d643-469c-8d3f-5a6960415114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-02bd5f31-499b-4e01-a49a-5dc9c5456ee9 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eea50583-59f2-4ced-beff-d13f09ff2ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:08 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-02bd5f31-499b-4e01-a49a-5dc9c5456ee9 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Volume 22b92a75-c0cc-45df-8893-8069db427e5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22b92a75-c0cc-45df-8893-8069db427e5b', 'volume_size': 1} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-02bd5f31-499b-4e01-a49a-5dc9c5456ee9 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3694ab8f-6ef2-4475-b76e-80b2fdc3e065 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2ca967-5e40-44ba-ac6c-1c56fdab946d {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:08 devstack sudo[104287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2ca967-5e40-44ba-ac6c-1c56fdab946d Sep 03 11:29:08 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:08 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3694ab8f-6ef2-4475-b76e-80b2fdc3e065 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2ca967-5e40-44ba-ac6c-1c56fdab946d" returned: 0 in 0.250s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-3694ab8f-6ef2-4475-b76e-80b2fdc3e065 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3694ab8f-6ef2-4475-b76e-80b2fdc3e065 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4e4cb0c6-622a-4979-9973-8fad6617d7b4 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.112s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4e4cb0c6-622a-4979-9973-8fad6617d7b4 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:29:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1863288228',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7df5289d-3d60-4b19-8099-715d7d07327c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00f7c2174a7436cb39fb6a21f3a0bfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:29:08Z,use_quota=True,user_id='b113fb49da984673a3ca92f94731d602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-4e4cb0c6-622a-4979-9973-8fad6617d7b4 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Creating volume 7df5289d-3d60-4b19-8099-715d7d07327c {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4e4cb0c6-622a-4979-9973-8fad6617d7b4 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4e4cb0c6-622a-4979-9973-8fad6617d7b4 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4e4cb0c6-622a-4979-9973-8fad6617d7b4 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4e4cb0c6-622a-4979-9973-8fad6617d7b4 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4e4cb0c6-622a-4979-9973-8fad6617d7b4 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4e4cb0c6-622a-4979-9973-8fad6617d7b4 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:29:08 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-4e4cb0c6-622a-4979-9973-8fad6617d7b4 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4e4cb0c6-622a-4979-9973-8fad6617d7b4 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7df5289d-3d60-4b19-8099-715d7d07327c 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3694ab8f-6ef2-4475-b76e-80b2fdc3e065 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e58d8afd-bcbf-4332-b7f5-388e3df25770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab2ca967-5e40-44ba-ac6c-1c56fdab946d', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:08 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7df5289d-3d60-4b19-8099-715d7d07327c 1073741824 Sep 03 11:29:08 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3694ab8f-6ef2-4475-b76e-80b2fdc3e065 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b8843f-155b-4c5d-b716-39ef7400cd78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:08 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-3694ab8f-6ef2-4475-b76e-80b2fdc3e065 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Volume volume-ab2ca967-5e40-44ba-ac6c-1c56fdab946d (ab2ca967-5e40-44ba-ac6c-1c56fdab946d): created successfully Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3694ab8f-6ef2-4475-b76e-80b2fdc3e065 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4b8843f-155b-4c5d-b716-39ef7400cd78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3694ab8f-6ef2-4475-b76e-80b2fdc3e065 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Flow 'volume_create_manager' (8dafa2b5-5960-4005-9385-72d6abf80b6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:29:08 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-3694ab8f-6ef2-4475-b76e-80b2fdc3e065 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Created volume successfully. Sep 03 11:29:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-32e35ae4-c67a-4eec-8215-a606be2aa001 tempest-TestStampPattern-415769870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:29:09 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4e4cb0c6-622a-4979-9973-8fad6617d7b4 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7df5289d-3d60-4b19-8099-715d7d07327c 1073741824" returned: 0 in 0.443s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4e4cb0c6-622a-4979-9973-8fad6617d7b4 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7df5289d-3d60-4b19-8099-715d7d07327c {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:09 devstack sudo[104295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7df5289d-3d60-4b19-8099-715d7d07327c Sep 03 11:29:09 devstack sudo[104295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:09 devstack sudo[104295]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4e4cb0c6-622a-4979-9973-8fad6617d7b4 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7df5289d-3d60-4b19-8099-715d7d07327c" returned: 0 in 0.250s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4e4cb0c6-622a-4979-9973-8fad6617d7b4 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:29:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4e4cb0c6-622a-4979-9973-8fad6617d7b4 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:29:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-04c92a9e-0d61-4f2b-a7e9-201a1610ff7c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.404s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:29:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-04c92a9e-0d61-4f2b-a7e9-201a1610ff7c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1791944242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e245ddb1-3bf8-4142-85b8-6ffe17428f97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00f7c2174a7436cb39fb6a21f3a0bfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:29:08Z,use_quota=True,user_id='b113fb49da984673a3ca92f94731d602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:29:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-04c92a9e-0d61-4f2b-a7e9-201a1610ff7c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Creating volume e245ddb1-3bf8-4142-85b8-6ffe17428f97 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:29:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-04c92a9e-0d61-4f2b-a7e9-201a1610ff7c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:29:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-04c92a9e-0d61-4f2b-a7e9-201a1610ff7c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:29:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-04c92a9e-0d61-4f2b-a7e9-201a1610ff7c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:29:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-04c92a9e-0d61-4f2b-a7e9-201a1610ff7c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:29:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-04c92a9e-0d61-4f2b-a7e9-201a1610ff7c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:29:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-04c92a9e-0d61-4f2b-a7e9-201a1610ff7c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:29:09 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-04c92a9e-0d61-4f2b-a7e9-201a1610ff7c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:29:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-04c92a9e-0d61-4f2b-a7e9-201a1610ff7c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e245ddb1-3bf8-4142-85b8-6ffe17428f97 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:09 devstack sudo[104298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e245ddb1-3bf8-4142-85b8-6ffe17428f97 1073741824 Sep 03 11:29:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4e4cb0c6-622a-4979-9973-8fad6617d7b4 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0192222-c54d-4259-8640-a28543b47047) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7df5289d-3d60-4b19-8099-715d7d07327c', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:09 devstack sudo[104298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4e4cb0c6-622a-4979-9973-8fad6617d7b4 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (797bd345-3587-446d-94e1-dab349730665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:09 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-4e4cb0c6-622a-4979-9973-8fad6617d7b4 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Volume volume-7df5289d-3d60-4b19-8099-715d7d07327c (7df5289d-3d60-4b19-8099-715d7d07327c): created successfully Sep 03 11:29:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4e4cb0c6-622a-4979-9973-8fad6617d7b4 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (797bd345-3587-446d-94e1-dab349730665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4e4cb0c6-622a-4979-9973-8fad6617d7b4 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Flow 'volume_create_manager' (1e49b3ab-d6f5-459e-9da5-8eefdaeb4fd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:29:09 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-4e4cb0c6-622a-4979-9973-8fad6617d7b4 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Created volume successfully. Sep 03 11:29:09 devstack sudo[104298]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-04c92a9e-0d61-4f2b-a7e9-201a1610ff7c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e245ddb1-3bf8-4142-85b8-6ffe17428f97 1073741824" returned: 0 in 0.395s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-04c92a9e-0d61-4f2b-a7e9-201a1610ff7c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e245ddb1-3bf8-4142-85b8-6ffe17428f97 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:10 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e245ddb1-3bf8-4142-85b8-6ffe17428f97 Sep 03 11:29:10 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:10 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-04c92a9e-0d61-4f2b-a7e9-201a1610ff7c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e245ddb1-3bf8-4142-85b8-6ffe17428f97" returned: 0 in 0.251s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:10 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-04c92a9e-0d61-4f2b-a7e9-201a1610ff7c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:29:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-04c92a9e-0d61-4f2b-a7e9-201a1610ff7c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:29:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-02bd5f31-499b-4e01-a49a-5dc9c5456ee9 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.697s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:29:10 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-02bd5f31-499b-4e01-a49a-5dc9c5456ee9 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:29:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-808294795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22b92a75-c0cc-45df-8893-8069db427e5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c00f7c2174a7436cb39fb6a21f3a0bfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:29:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:29:08Z,use_quota=True,user_id='b113fb49da984673a3ca92f94731d602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:29:10 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-02bd5f31-499b-4e01-a49a-5dc9c5456ee9 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Creating volume 22b92a75-c0cc-45df-8893-8069db427e5b {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:29:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-02bd5f31-499b-4e01-a49a-5dc9c5456ee9 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:29:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-02bd5f31-499b-4e01-a49a-5dc9c5456ee9 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:29:10 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-02bd5f31-499b-4e01-a49a-5dc9c5456ee9 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:29:10 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-02bd5f31-499b-4e01-a49a-5dc9c5456ee9 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:29:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-02bd5f31-499b-4e01-a49a-5dc9c5456ee9 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:29:10 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-02bd5f31-499b-4e01-a49a-5dc9c5456ee9 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:29:10 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-02bd5f31-499b-4e01-a49a-5dc9c5456ee9 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:29:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-02bd5f31-499b-4e01-a49a-5dc9c5456ee9 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-22b92a75-c0cc-45df-8893-8069db427e5b 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:10 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-04c92a9e-0d61-4f2b-a7e9-201a1610ff7c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64693860-7bbd-49d6-b95a-9f8959a50d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e245ddb1-3bf8-4142-85b8-6ffe17428f97', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:10 devstack sudo[104307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-22b92a75-c0cc-45df-8893-8069db427e5b 1073741824 Sep 03 11:29:10 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:10 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-04c92a9e-0d61-4f2b-a7e9-201a1610ff7c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d358bf-a1c9-4a5d-ae96-9dc17abd4c63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:10 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-04c92a9e-0d61-4f2b-a7e9-201a1610ff7c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Volume volume-e245ddb1-3bf8-4142-85b8-6ffe17428f97 (e245ddb1-3bf8-4142-85b8-6ffe17428f97): created successfully Sep 03 11:29:10 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-04c92a9e-0d61-4f2b-a7e9-201a1610ff7c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25d358bf-a1c9-4a5d-ae96-9dc17abd4c63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:10 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-04c92a9e-0d61-4f2b-a7e9-201a1610ff7c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Flow 'volume_create_manager' (4a4cb6c9-824a-40db-afe0-f83c1a744ecd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:29:10 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-04c92a9e-0d61-4f2b-a7e9-201a1610ff7c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Created volume successfully. Sep 03 11:29:10 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-02bd5f31-499b-4e01-a49a-5dc9c5456ee9 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-22b92a75-c0cc-45df-8893-8069db427e5b 1073741824" returned: 0 in 0.413s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-02bd5f31-499b-4e01-a49a-5dc9c5456ee9 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-22b92a75-c0cc-45df-8893-8069db427e5b {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:10 devstack sudo[104313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-22b92a75-c0cc-45df-8893-8069db427e5b Sep 03 11:29:10 devstack sudo[104313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:10 devstack sudo[104313]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-02bd5f31-499b-4e01-a49a-5dc9c5456ee9 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-22b92a75-c0cc-45df-8893-8069db427e5b" returned: 0 in 0.244s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:10 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-02bd5f31-499b-4e01-a49a-5dc9c5456ee9 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:29:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-02bd5f31-499b-4e01-a49a-5dc9c5456ee9 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:29:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-32e35ae4-c67a-4eec-8215-a606be2aa001 tempest-TestStampPattern-415769870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.811s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:29:10 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-02bd5f31-499b-4e01-a49a-5dc9c5456ee9 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eea50583-59f2-4ced-beff-d13f09ff2ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22b92a75-c0cc-45df-8893-8069db427e5b', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:10 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-02bd5f31-499b-4e01-a49a-5dc9c5456ee9 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28d01568-ff91-4457-8322-6c1dccaeafcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:10 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-32e35ae4-c67a-4eec-8215-a606be2aa001 tempest-TestStampPattern-415769870 None] Creating offline snapshot a101eb9b-57bc-4cf2-920a-7b775993d803 of volume 4c63ecd4-5171-41ca-8f14-943222ffaba0 {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:29:11 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-02bd5f31-499b-4e01-a49a-5dc9c5456ee9 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Volume volume-22b92a75-c0cc-45df-8893-8069db427e5b (22b92a75-c0cc-45df-8893-8069db427e5b): created successfully Sep 03 11:29:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-02bd5f31-499b-4e01-a49a-5dc9c5456ee9 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28d01568-ff91-4457-8322-6c1dccaeafcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-02bd5f31-499b-4e01-a49a-5dc9c5456ee9 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Flow 'volume_create_manager' (b298562e-eddc-4d8a-9876-6ccb37c93c0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:29:11 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[489a484a-f6e2-4e38-b7b3-afe3c0b1ac30]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:29:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-32e35ae4-c67a-4eec-8215-a606be2aa001 tempest-TestStampPattern-415769870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:11 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-02bd5f31-499b-4e01-a49a-5dc9c5456ee9 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Created volume successfully. Sep 03 11:29:11 devstack sudo[104316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0 Sep 03 11:29:11 devstack sudo[104316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:11 devstack sudo[104316]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-32e35ae4-c67a-4eec-8215-a606be2aa001 tempest-TestStampPattern-415769870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0" returned: 0 in 0.359s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-32e35ae4-c67a-4eec-8215-a606be2aa001 tempest-TestStampPattern-415769870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0.a101eb9b-57bc-4cf2-920a-7b775993d803 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:11 devstack sudo[104322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0.a101eb9b-57bc-4cf2-920a-7b775993d803 1G Sep 03 11:29:11 devstack sudo[104322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:11 devstack sudo[104322]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-32e35ae4-c67a-4eec-8215-a606be2aa001 tempest-TestStampPattern-415769870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0.a101eb9b-57bc-4cf2-920a-7b775993d803 1G" returned: 0 in 0.382s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-32e35ae4-c67a-4eec-8215-a606be2aa001 tempest-TestStampPattern-415769870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c63ecd4-5171-41ca-8f14-943222ffaba0 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0.a101eb9b-57bc-4cf2-920a-7b775993d803 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:11 devstack sudo[104327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c63ecd4-5171-41ca-8f14-943222ffaba0 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0.a101eb9b-57bc-4cf2-920a-7b775993d803 Sep 03 11:29:11 devstack sudo[104327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:11 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fefd6117-069c-4b3d-822e-61e18ddb95dc tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Acquiring lock "cinder-22b92a75-c0cc-45df-8893-8069db427e5b-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:29:11 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fefd6117-069c-4b3d-822e-61e18ddb95dc tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "cinder-22b92a75-c0cc-45df-8893-8069db427e5b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:29:11 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fefd6117-069c-4b3d-822e-61e18ddb95dc tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Acquiring lock "cinder-quobyte-22b92a75-c0cc-45df-8893-8069db427e5b" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:29:11 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fefd6117-069c-4b3d-822e-61e18ddb95dc tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "cinder-quobyte-22b92a75-c0cc-45df-8893-8069db427e5b" acquired by "delete_volume" :: waited 0.019s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:29:11 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[b463ad4c-3a8f-4cba-924c-339bdb2ca360]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:29:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fefd6117-069c-4b3d-822e-61e18ddb95dc tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-22b92a75-c0cc-45df-8893-8069db427e5b {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:12 devstack sudo[104327]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-32e35ae4-c67a-4eec-8215-a606be2aa001 tempest-TestStampPattern-415769870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c63ecd4-5171-41ca-8f14-943222ffaba0 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0.a101eb9b-57bc-4cf2-920a-7b775993d803" returned: 0 in 0.301s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:12 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-32e35ae4-c67a-4eec-8215-a606be2aa001 tempest-TestStampPattern-415769870 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0.a101eb9b-57bc-4cf2-920a-7b775993d803 is being set with open permissions: ugo+rw Sep 03 11:29:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-32e35ae4-c67a-4eec-8215-a606be2aa001 tempest-TestStampPattern-415769870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0.a101eb9b-57bc-4cf2-920a-7b775993d803 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:12 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-22b92a75-c0cc-45df-8893-8069db427e5b Sep 03 11:29:12 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:12 devstack sudo[104333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0.a101eb9b-57bc-4cf2-920a-7b775993d803 Sep 03 11:29:12 devstack sudo[104333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:12 devstack sudo[104333]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-32e35ae4-c67a-4eec-8215-a606be2aa001 tempest-TestStampPattern-415769870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0.a101eb9b-57bc-4cf2-920a-7b775993d803" returned: 0 in 0.250s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:12 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fefd6117-069c-4b3d-822e-61e18ddb95dc tempest-CreateVolumesFromSourceVolumeTest-652477638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-22b92a75-c0cc-45df-8893-8069db427e5b" returned: 0 in 0.375s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fefd6117-069c-4b3d-822e-61e18ddb95dc tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-22b92a75-c0cc-45df-8893-8069db427e5b {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-32e35ae4-c67a-4eec-8215-a606be2aa001 tempest-TestStampPattern-415769870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:12 devstack sudo[104340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-22b92a75-c0cc-45df-8893-8069db427e5b Sep 03 11:29:12 devstack sudo[104340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:12 devstack sudo[104342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0.info Sep 03 11:29:12 devstack sudo[104342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:12 devstack sudo[104340]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fefd6117-069c-4b3d-822e-61e18ddb95dc tempest-CreateVolumesFromSourceVolumeTest-652477638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-22b92a75-c0cc-45df-8893-8069db427e5b" returned: 0 in 0.246s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:12 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fefd6117-069c-4b3d-822e-61e18ddb95dc tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "cinder-quobyte-22b92a75-c0cc-45df-8893-8069db427e5b" released by "delete_volume" :: held 0.667s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:29:12 devstack sudo[104342]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-32e35ae4-c67a-4eec-8215-a606be2aa001 tempest-TestStampPattern-415769870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0.info" returned: 0 in 0.267s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:12 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-32e35ae4-c67a-4eec-8215-a606be2aa001 tempest-TestStampPattern-415769870 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0.info is being set with open permissions: ugo+rw Sep 03 11:29:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-32e35ae4-c67a-4eec-8215-a606be2aa001 tempest-TestStampPattern-415769870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:12 devstack sudo[104346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0.info Sep 03 11:29:12 devstack sudo[104346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:12 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-fefd6117-069c-4b3d-822e-61e18ddb95dc tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Created reservations ['65d36864-fde5-479d-8114-15b0b6a797af', 'fb761853-3c7e-4f2d-bd0f-bfd51aecda9c', 'd53e1688-2cd1-4578-80e9-06269d1a8153', '492ba66d-a0b4-49bb-9b7d-44a40d4cc33f'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:29:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-fefd6117-069c-4b3d-822e-61e18ddb95dc tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:29:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-fefd6117-069c-4b3d-822e-61e18ddb95dc tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:29:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-fefd6117-069c-4b3d-822e-61e18ddb95dc tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:29:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-fefd6117-069c-4b3d-822e-61e18ddb95dc tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:29:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-fefd6117-069c-4b3d-822e-61e18ddb95dc tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:29:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fefd6117-069c-4b3d-822e-61e18ddb95dc tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:12 devstack sudo[104348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:29:12 devstack sudo[104348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:12 devstack sudo[104346]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-32e35ae4-c67a-4eec-8215-a606be2aa001 tempest-TestStampPattern-415769870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0.info" returned: 0 in 0.258s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-32e35ae4-c67a-4eec-8215-a606be2aa001 tempest-TestStampPattern-415769870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.954s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:29:12 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-32e35ae4-c67a-4eec-8215-a606be2aa001 tempest-TestStampPattern-415769870 None] Create snapshot completed successfully Sep 03 11:29:13 devstack sudo[104348]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fefd6117-069c-4b3d-822e-61e18ddb95dc tempest-CreateVolumesFromSourceVolumeTest-652477638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.278s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:13 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-fefd6117-069c-4b3d-822e-61e18ddb95dc tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:29:13 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-fefd6117-069c-4b3d-822e-61e18ddb95dc tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Deleted volume successfully. Sep 03 11:29:13 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-88380c26-c920-4644-bef8-6bed866944d3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Acquiring lock "cinder-e245ddb1-3bf8-4142-85b8-6ffe17428f97-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:29:13 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fefd6117-069c-4b3d-822e-61e18ddb95dc tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "cinder-22b92a75-c0cc-45df-8893-8069db427e5b-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:29:13 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-88380c26-c920-4644-bef8-6bed866944d3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "cinder-e245ddb1-3bf8-4142-85b8-6ffe17428f97-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:29:13 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-88380c26-c920-4644-bef8-6bed866944d3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Acquiring lock "cinder-quobyte-e245ddb1-3bf8-4142-85b8-6ffe17428f97" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:29:13 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-88380c26-c920-4644-bef8-6bed866944d3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "cinder-quobyte-e245ddb1-3bf8-4142-85b8-6ffe17428f97" acquired by "delete_volume" :: waited 0.015s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:29:13 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f518f8-792b-46f4-9c51-dcc86700f5af]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:29:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-88380c26-c920-4644-bef8-6bed866944d3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e245ddb1-3bf8-4142-85b8-6ffe17428f97 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:13 devstack sudo[104352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e245ddb1-3bf8-4142-85b8-6ffe17428f97 Sep 03 11:29:13 devstack sudo[104352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:13 devstack sudo[104352]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-88380c26-c920-4644-bef8-6bed866944d3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e245ddb1-3bf8-4142-85b8-6ffe17428f97" returned: 0 in 0.371s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-88380c26-c920-4644-bef8-6bed866944d3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e245ddb1-3bf8-4142-85b8-6ffe17428f97 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:13 devstack sudo[104358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e245ddb1-3bf8-4142-85b8-6ffe17428f97 Sep 03 11:29:13 devstack sudo[104358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:13 devstack sudo[104358]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-88380c26-c920-4644-bef8-6bed866944d3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e245ddb1-3bf8-4142-85b8-6ffe17428f97" returned: 0 in 0.255s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:13 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-88380c26-c920-4644-bef8-6bed866944d3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "cinder-quobyte-e245ddb1-3bf8-4142-85b8-6ffe17428f97" released by "delete_volume" :: held 0.666s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:29:13 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-88380c26-c920-4644-bef8-6bed866944d3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Created reservations ['8a35bc4e-5bd9-4dad-99a8-f814806cd1ba', '0401003e-ead3-42a7-8871-6414c784ba78', 'bf6d3316-7bb1-4f02-af5a-9af9104b13c6', '5b748398-3fd9-4500-8998-f36476ffda44'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:29:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-88380c26-c920-4644-bef8-6bed866944d3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:29:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-88380c26-c920-4644-bef8-6bed866944d3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:29:13 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-88380c26-c920-4644-bef8-6bed866944d3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:29:13 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-88380c26-c920-4644-bef8-6bed866944d3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:29:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-88380c26-c920-4644-bef8-6bed866944d3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:29:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-88380c26-c920-4644-bef8-6bed866944d3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:13 devstack sudo[104361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:29:13 devstack sudo[104361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:14 devstack sudo[104361]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-88380c26-c920-4644-bef8-6bed866944d3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.292s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:14 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-88380c26-c920-4644-bef8-6bed866944d3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:29:14 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-88380c26-c920-4644-bef8-6bed866944d3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Deleted volume successfully. Sep 03 11:29:14 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-88380c26-c920-4644-bef8-6bed866944d3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "cinder-e245ddb1-3bf8-4142-85b8-6ffe17428f97-delete_volume" released by "delete_volume" :: held 1.160s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:29:14 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b42cabd5-b4cd-4c9a-b8a5-847de14ebe3c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Acquiring lock "cinder-7df5289d-3d60-4b19-8099-715d7d07327c-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:29:14 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b42cabd5-b4cd-4c9a-b8a5-847de14ebe3c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "cinder-7df5289d-3d60-4b19-8099-715d7d07327c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:29:14 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b42cabd5-b4cd-4c9a-b8a5-847de14ebe3c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Acquiring lock "cinder-quobyte-7df5289d-3d60-4b19-8099-715d7d07327c" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:29:14 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b42cabd5-b4cd-4c9a-b8a5-847de14ebe3c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "cinder-quobyte-7df5289d-3d60-4b19-8099-715d7d07327c" acquired by "delete_volume" :: waited 0.017s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:29:14 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[b279545b-ef20-407a-8de6-052202be9c28]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:29:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b42cabd5-b4cd-4c9a-b8a5-847de14ebe3c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7df5289d-3d60-4b19-8099-715d7d07327c {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:14 devstack sudo[104364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7df5289d-3d60-4b19-8099-715d7d07327c Sep 03 11:29:14 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:14 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b42cabd5-b4cd-4c9a-b8a5-847de14ebe3c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7df5289d-3d60-4b19-8099-715d7d07327c" returned: 0 in 0.401s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b42cabd5-b4cd-4c9a-b8a5-847de14ebe3c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7df5289d-3d60-4b19-8099-715d7d07327c {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:14 devstack sudo[104370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7df5289d-3d60-4b19-8099-715d7d07327c Sep 03 11:29:14 devstack sudo[104370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:15 devstack sudo[104370]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b42cabd5-b4cd-4c9a-b8a5-847de14ebe3c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-7df5289d-3d60-4b19-8099-715d7d07327c" returned: 0 in 0.253s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:15 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b42cabd5-b4cd-4c9a-b8a5-847de14ebe3c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "cinder-quobyte-7df5289d-3d60-4b19-8099-715d7d07327c" released by "delete_volume" :: held 0.699s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:29:15 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-b42cabd5-b4cd-4c9a-b8a5-847de14ebe3c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Created reservations ['92c3c9d1-1b26-4c09-831e-21e53b137bc2', '25366095-849b-4a31-8f56-afd2b19b1802', '70301a69-3f09-4d25-8ff7-d55f53ca72dd', '33874de0-8dd4-4146-af87-02cc8594a0ad'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:29:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b42cabd5-b4cd-4c9a-b8a5-847de14ebe3c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:29:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b42cabd5-b4cd-4c9a-b8a5-847de14ebe3c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:29:15 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-b42cabd5-b4cd-4c9a-b8a5-847de14ebe3c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:29:15 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-b42cabd5-b4cd-4c9a-b8a5-847de14ebe3c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:29:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b42cabd5-b4cd-4c9a-b8a5-847de14ebe3c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:29:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b42cabd5-b4cd-4c9a-b8a5-847de14ebe3c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:15 devstack sudo[104388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:29:15 devstack sudo[104388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:15 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4c93221d-ff38-4ab7-b8db-db90f639321f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Acquiring lock "cinder-ab2ca967-5e40-44ba-ac6c-1c56fdab946d-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:29:15 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4c93221d-ff38-4ab7-b8db-db90f639321f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "cinder-ab2ca967-5e40-44ba-ac6c-1c56fdab946d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:29:15 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4c93221d-ff38-4ab7-b8db-db90f639321f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Acquiring lock "cinder-quobyte-ab2ca967-5e40-44ba-ac6c-1c56fdab946d" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:29:15 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4c93221d-ff38-4ab7-b8db-db90f639321f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "cinder-quobyte-ab2ca967-5e40-44ba-ac6c-1c56fdab946d" acquired by "delete_volume" :: waited 0.018s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:29:15 devstack sudo[104388]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b42cabd5-b4cd-4c9a-b8a5-847de14ebe3c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.281s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:15 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-b42cabd5-b4cd-4c9a-b8a5-847de14ebe3c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:29:15 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b683a69-1069-46aa-b462-9ec3cdea8f46]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:29:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4c93221d-ff38-4ab7-b8db-db90f639321f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2ca967-5e40-44ba-ac6c-1c56fdab946d {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:15 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-b42cabd5-b4cd-4c9a-b8a5-847de14ebe3c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Deleted volume successfully. Sep 03 11:29:15 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b42cabd5-b4cd-4c9a-b8a5-847de14ebe3c tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "cinder-7df5289d-3d60-4b19-8099-715d7d07327c-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:29:15 devstack sudo[104391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2ca967-5e40-44ba-ac6c-1c56fdab946d Sep 03 11:29:15 devstack sudo[104391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:15 devstack sudo[104391]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4c93221d-ff38-4ab7-b8db-db90f639321f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2ca967-5e40-44ba-ac6c-1c56fdab946d" returned: 0 in 0.375s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4c93221d-ff38-4ab7-b8db-db90f639321f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2ca967-5e40-44ba-ac6c-1c56fdab946d {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:15 devstack sudo[104405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2ca967-5e40-44ba-ac6c-1c56fdab946d Sep 03 11:29:15 devstack sudo[104405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:16 devstack sudo[104405]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4c93221d-ff38-4ab7-b8db-db90f639321f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2ca967-5e40-44ba-ac6c-1c56fdab946d" returned: 0 in 0.257s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:16 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4c93221d-ff38-4ab7-b8db-db90f639321f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "cinder-quobyte-ab2ca967-5e40-44ba-ac6c-1c56fdab946d" released by "delete_volume" :: held 0.675s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:29:16 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-4c93221d-ff38-4ab7-b8db-db90f639321f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Created reservations ['303db40f-e3ab-4fc7-8018-019d51fca0ea', 'b7201eab-8b1d-4b96-bf50-8bb556b9070c', 'ff076309-b29e-4ba8-bcc0-6892adbae8cf', '184af730-185a-48e2-b5f4-56c90d3e672c'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:29:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4c93221d-ff38-4ab7-b8db-db90f639321f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:29:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4c93221d-ff38-4ab7-b8db-db90f639321f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:29:16 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4c93221d-ff38-4ab7-b8db-db90f639321f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:29:16 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4c93221d-ff38-4ab7-b8db-db90f639321f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:29:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4c93221d-ff38-4ab7-b8db-db90f639321f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:29:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4c93221d-ff38-4ab7-b8db-db90f639321f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:16 devstack sudo[104408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:29:16 devstack sudo[104408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:16 devstack sudo[104408]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4c93221d-ff38-4ab7-b8db-db90f639321f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.292s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:16 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-4c93221d-ff38-4ab7-b8db-db90f639321f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:29:16 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-4c93221d-ff38-4ab7-b8db-db90f639321f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Deleted volume successfully. Sep 03 11:29:16 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5e550353-144b-4b2a-876c-37b01de48d75 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Acquiring lock "cinder-37af89e6-ebcf-4d37-8183-82557d22fd1d-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:29:16 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4c93221d-ff38-4ab7-b8db-db90f639321f tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "cinder-ab2ca967-5e40-44ba-ac6c-1c56fdab946d-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:29:16 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5e550353-144b-4b2a-876c-37b01de48d75 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "cinder-37af89e6-ebcf-4d37-8183-82557d22fd1d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:29:16 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5e550353-144b-4b2a-876c-37b01de48d75 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Acquiring lock "cinder-quobyte-37af89e6-ebcf-4d37-8183-82557d22fd1d" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:29:16 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5e550353-144b-4b2a-876c-37b01de48d75 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "cinder-quobyte-37af89e6-ebcf-4d37-8183-82557d22fd1d" acquired by "delete_volume" :: waited 0.014s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:29:16 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f1b9563-be94-4b42-8d4e-4bc689e3f2bb]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:29:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5e550353-144b-4b2a-876c-37b01de48d75 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-37af89e6-ebcf-4d37-8183-82557d22fd1d {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:16 devstack sudo[104411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-37af89e6-ebcf-4d37-8183-82557d22fd1d Sep 03 11:29:16 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:17 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5e550353-144b-4b2a-876c-37b01de48d75 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-37af89e6-ebcf-4d37-8183-82557d22fd1d" returned: 0 in 0.382s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5e550353-144b-4b2a-876c-37b01de48d75 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-37af89e6-ebcf-4d37-8183-82557d22fd1d {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:17 devstack sudo[104416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-37af89e6-ebcf-4d37-8183-82557d22fd1d Sep 03 11:29:17 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:17 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5e550353-144b-4b2a-876c-37b01de48d75 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-37af89e6-ebcf-4d37-8183-82557d22fd1d" returned: 0 in 0.256s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:17 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5e550353-144b-4b2a-876c-37b01de48d75 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "cinder-quobyte-37af89e6-ebcf-4d37-8183-82557d22fd1d" released by "delete_volume" :: held 0.684s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:29:17 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-5e550353-144b-4b2a-876c-37b01de48d75 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Created reservations ['70325683-5760-4db0-9dd3-6c98c04a20b3', 'fdce2b5e-c975-4e87-93a0-a41460c6f268', 'f638d773-c83a-486e-93db-f7e0f44610c4', '62c35d34-b1d6-496d-b677-48d8a84c0e57'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:29:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5e550353-144b-4b2a-876c-37b01de48d75 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:29:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5e550353-144b-4b2a-876c-37b01de48d75 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:29:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5e550353-144b-4b2a-876c-37b01de48d75 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:29:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5e550353-144b-4b2a-876c-37b01de48d75 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:29:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5e550353-144b-4b2a-876c-37b01de48d75 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:29:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5e550353-144b-4b2a-876c-37b01de48d75 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:17 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:29:17 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:17 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5e550353-144b-4b2a-876c-37b01de48d75 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.273s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:17 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-5e550353-144b-4b2a-876c-37b01de48d75 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:29:17 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-5e550353-144b-4b2a-876c-37b01de48d75 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Deleted volume successfully. Sep 03 11:29:17 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-899ad7bf-b2f2-4167-85ce-cf68046530e3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Acquiring lock "cinder-99e05f6b-792d-48e9-888e-08f9cadc0c23-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:29:17 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5e550353-144b-4b2a-876c-37b01de48d75 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "cinder-37af89e6-ebcf-4d37-8183-82557d22fd1d-delete_volume" released by "delete_volume" :: held 1.186s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:29:17 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-899ad7bf-b2f2-4167-85ce-cf68046530e3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "cinder-99e05f6b-792d-48e9-888e-08f9cadc0c23-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:29:17 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-899ad7bf-b2f2-4167-85ce-cf68046530e3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Acquiring lock "cinder-quobyte-99e05f6b-792d-48e9-888e-08f9cadc0c23" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:29:17 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-899ad7bf-b2f2-4167-85ce-cf68046530e3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "cinder-quobyte-99e05f6b-792d-48e9-888e-08f9cadc0c23" acquired by "delete_volume" :: waited 0.018s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:29:17 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:29:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:29:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:29:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:29:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:29:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:29:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:17 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[a713fed9-fb99-4ea1-8339-8cf2e7ce7d3e]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:29:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-899ad7bf-b2f2-4167-85ce-cf68046530e3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99e05f6b-792d-48e9-888e-08f9cadc0c23 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:17 devstack sudo[104422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:29:17 devstack sudo[104422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:18 devstack sudo[104423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99e05f6b-792d-48e9-888e-08f9cadc0c23 Sep 03 11:29:18 devstack sudo[104423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:18 devstack sudo[104422]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.308s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:18 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:29:18 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:29:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread count: 28 {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:29:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread info: [<_MainThread(MainThread, started 139554943000704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:29:18 devstack sudo[104423]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-899ad7bf-b2f2-4167-85ce-cf68046530e3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99e05f6b-792d-48e9-888e-08f9cadc0c23" returned: 0 in 0.395s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-899ad7bf-b2f2-4167-85ce-cf68046530e3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99e05f6b-792d-48e9-888e-08f9cadc0c23 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:18 devstack sudo[104432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99e05f6b-792d-48e9-888e-08f9cadc0c23 Sep 03 11:29:18 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:18 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-899ad7bf-b2f2-4167-85ce-cf68046530e3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-99e05f6b-792d-48e9-888e-08f9cadc0c23" returned: 0 in 0.252s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:18 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-899ad7bf-b2f2-4167-85ce-cf68046530e3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "cinder-quobyte-99e05f6b-792d-48e9-888e-08f9cadc0c23" released by "delete_volume" :: held 0.714s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:29:18 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-899ad7bf-b2f2-4167-85ce-cf68046530e3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Created reservations ['bf577931-6352-492c-b1c5-7dc5cf76d75a', '72480991-7785-456b-828f-0fb53270afbb', '57ccdc3f-e48c-4246-8b7d-e85534de74b3', 'a46830a6-3f09-4197-8987-71ca2de041f6'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:29:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-899ad7bf-b2f2-4167-85ce-cf68046530e3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:29:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-899ad7bf-b2f2-4167-85ce-cf68046530e3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:29:18 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-899ad7bf-b2f2-4167-85ce-cf68046530e3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:29:18 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-899ad7bf-b2f2-4167-85ce-cf68046530e3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:29:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-899ad7bf-b2f2-4167-85ce-cf68046530e3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:29:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-899ad7bf-b2f2-4167-85ce-cf68046530e3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:18 devstack sudo[104435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:29:18 devstack sudo[104435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:19 devstack sudo[104435]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-899ad7bf-b2f2-4167-85ce-cf68046530e3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.265s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:19 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-899ad7bf-b2f2-4167-85ce-cf68046530e3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:29:19 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-899ad7bf-b2f2-4167-85ce-cf68046530e3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Deleted volume successfully. Sep 03 11:29:19 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-899ad7bf-b2f2-4167-85ce-cf68046530e3 tempest-CreateVolumesFromSourceVolumeTest-652477638 None] Lock "cinder-99e05f6b-792d-48e9-888e-08f9cadc0c23-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:29:20 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:29:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Flow 'volume_create_manager' (d7d5021b-131e-4c6d-9ae2-8d4412897edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:29:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcafc2bc-4a79-49ca-9baa-fe966c190d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcafc2bc-4a79-49ca-9baa-fe966c190d9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1272494677',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84a1f888-f868-4b01-a052-69813e3d2908,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2747b9c7f77244f88e8001cd60e1fe58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:29:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a101eb9b-57bc-4cf2-920a-7b775993d803,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:29:20Z,use_quota=True,user_id='1d242d9365264321b2d70d5e0bd55c68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fc369d3-7fdf-4bef-9120-4139d2eb5c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fc369d3-7fdf-4bef-9120-4139d2eb5c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee426dfa-1324-4a2c-9463-c99d42e26463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee426dfa-1324-4a2c-9463-c99d42e26463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '84a1f888-f868-4b01-a052-69813e3d2908', 'volume_name': 'volume-84a1f888-f868-4b01-a052-69813e3d2908', 'volume_size': 1, 'snapshot_id': 'a101eb9b-57bc-4cf2-920a-7b775993d803'}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62ff6a6c-06e3-4ae6-9a4d-61c2e15621b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62ff6a6c-06e3-4ae6-9a4d-61c2e15621b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (704dee98-3505-49aa-b4da-06bad395e571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:20 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Volume 84a1f888-f868-4b01-a052-69813e3d2908: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-84a1f888-f868-4b01-a052-69813e3d2908', 'volume_size': 1, 'snapshot_id': 'a101eb9b-57bc-4cf2-920a-7b775993d803'} Sep 03 11:29:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:29:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:29:20 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Acquiring lock "cinder-quobyte-a101eb9b-57bc-4cf2-920a-7b775993d803-84a1f888-f868-4b01-a052-69813e3d2908" by "_create_volume_from_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:29:20 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Lock "cinder-quobyte-a101eb9b-57bc-4cf2-920a-7b775993d803-84a1f888-f868-4b01-a052-69813e3d2908" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:29:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Creating volume 84a1f888-f868-4b01-a052-69813e3d2908 from snapshot a101eb9b-57bc-4cf2-920a-7b775993d803 {{(pid=87038) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 11:29:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:29:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:29:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:29:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:29:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:29:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:29:20 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Acquiring lock "cinder-quobyte-84a1f888-f868-4b01-a052-69813e3d2908" by "_copy_volume_from_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:29:20 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Lock "cinder-quobyte-84a1f888-f868-4b01-a052-69813e3d2908" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:29:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] snapshot: a101eb9b-57bc-4cf2-920a-7b775993d803, volume: 84a1f888-f868-4b01-a052-69813e3d2908, {{(pid=87038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 11:29:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:29:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:29:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:29:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:29:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:29:20 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b1d77d-f771-4d51-b0e6-d253d0b6149f]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:29:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0.a101eb9b-57bc-4cf2-920a-7b775993d803 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:20 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0.a101eb9b-57bc-4cf2-920a-7b775993d803 Sep 03 11:29:20 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:20 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0.a101eb9b-57bc-4cf2-920a-7b775993d803" returned: 0 in 0.391s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c63ecd4-5171-41ca-8f14-943222ffaba0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:29:20 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b01377-92ef-47ed-ac6d-d8c7f99f0d52]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:29:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:20 devstack sudo[104482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0 Sep 03 11:29:20 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:21 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0" returned: 0 in 0.427s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:21 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0 {{(pid=87038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 11:29:21 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Creating direct copy from snapshot {{(pid=87038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 11:29:21 devstack cinder-volume[87038]: DEBUG cinder.utils [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Path /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-84a1f888-f868-4b01-a052-69813e3d2908 not found in is_blk_device check {{(pid=87038) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 11:29:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-84a1f888-f868-4b01-a052-69813e3d2908 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:21 devstack sudo[104490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-84a1f888-f868-4b01-a052-69813e3d2908 Sep 03 11:29:21 devstack sudo[104490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:26 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a50132e-ec87-4f6c-8135-b80e5646a55a tempest-ProjectReaderTests-1906821848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:29:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4a50132e-ec87-4f6c-8135-b80e5646a55a tempest-ProjectReaderTests-1906821848 None] Flow 'volume_create_manager' (a6e2c920-bc14-44d5-bffc-13e7b77e0cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:29:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4a50132e-ec87-4f6c-8135-b80e5646a55a tempest-ProjectReaderTests-1906821848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3091ac14-3f5f-4160-b77f-253e572f2d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4a50132e-ec87-4f6c-8135-b80e5646a55a tempest-ProjectReaderTests-1906821848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3091ac14-3f5f-4160-b77f-253e572f2d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1777748172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=410a197f-d181-48bc-8494-48fdf895aded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352acc94007b4dac802ba4797918695e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:29:26Z,use_quota=True,user_id='13ad9001da8e4f468018add355359de9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4a50132e-ec87-4f6c-8135-b80e5646a55a tempest-ProjectReaderTests-1906821848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7476f969-f17a-4501-9b7b-3c353f131c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4a50132e-ec87-4f6c-8135-b80e5646a55a tempest-ProjectReaderTests-1906821848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7476f969-f17a-4501-9b7b-3c353f131c38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4a50132e-ec87-4f6c-8135-b80e5646a55a tempest-ProjectReaderTests-1906821848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c1b433-9653-4ce1-b447-98e44251c9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4a50132e-ec87-4f6c-8135-b80e5646a55a tempest-ProjectReaderTests-1906821848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03c1b433-9653-4ce1-b447-98e44251c9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '410a197f-d181-48bc-8494-48fdf895aded', 'volume_name': 'volume-410a197f-d181-48bc-8494-48fdf895aded', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4a50132e-ec87-4f6c-8135-b80e5646a55a tempest-ProjectReaderTests-1906821848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acb7b12d-4c37-47b3-bfb7-722fbe3ba505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4a50132e-ec87-4f6c-8135-b80e5646a55a tempest-ProjectReaderTests-1906821848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acb7b12d-4c37-47b3-bfb7-722fbe3ba505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4a50132e-ec87-4f6c-8135-b80e5646a55a tempest-ProjectReaderTests-1906821848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4085dc0-3be7-4d4c-95ca-e37a43b4192b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:26 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-4a50132e-ec87-4f6c-8135-b80e5646a55a tempest-ProjectReaderTests-1906821848 None] Volume 410a197f-d181-48bc-8494-48fdf895aded: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-410a197f-d181-48bc-8494-48fdf895aded', 'volume_size': 1} Sep 03 11:29:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4a50132e-ec87-4f6c-8135-b80e5646a55a tempest-ProjectReaderTests-1906821848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:29:27 devstack sudo[104490]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-84a1f888-f868-4b01-a052-69813e3d2908" returned: 0 in 6.147s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:27 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Image conversion details: src /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0, size 1024.00 MB, duration 6.15 sec, destination /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-84a1f888-f868-4b01-a052-69813e3d2908 {{(pid=87038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:29:27 devstack cinder-volume[87038]: INFO cinder.image.image_utils [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Converted 1024.00 MB image at 166.53 MB/s Sep 03 11:29:27 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-84a1f888-f868-4b01-a052-69813e3d2908 is being set with open permissions: ugo+rw Sep 03 11:29:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-84a1f888-f868-4b01-a052-69813e3d2908 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:27 devstack sudo[104503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-84a1f888-f868-4b01-a052-69813e3d2908 Sep 03 11:29:27 devstack sudo[104503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:27 devstack sudo[104503]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-84a1f888-f868-4b01-a052-69813e3d2908" returned: 0 in 0.256s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:27 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Lock "cinder-quobyte-84a1f888-f868-4b01-a052-69813e3d2908" released by "_copy_volume_from_snapshot" :: held 7.318s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:29:27 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Lock "cinder-quobyte-a101eb9b-57bc-4cf2-920a-7b775993d803-84a1f888-f868-4b01-a052-69813e3d2908" released by "_create_volume_from_snapshot" :: held 7.419s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:29:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.435s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:29:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4a50132e-ec87-4f6c-8135-b80e5646a55a tempest-ProjectReaderTests-1906821848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.367s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:29:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4a50132e-ec87-4f6c-8135-b80e5646a55a tempest-ProjectReaderTests-1906821848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1777748172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=410a197f-d181-48bc-8494-48fdf895aded,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352acc94007b4dac802ba4797918695e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:29:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:29:26Z,use_quota=True,user_id='13ad9001da8e4f468018add355359de9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:29:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-4a50132e-ec87-4f6c-8135-b80e5646a55a tempest-ProjectReaderTests-1906821848 None] Creating volume 410a197f-d181-48bc-8494-48fdf895aded {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:29:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4a50132e-ec87-4f6c-8135-b80e5646a55a tempest-ProjectReaderTests-1906821848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:29:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4a50132e-ec87-4f6c-8135-b80e5646a55a tempest-ProjectReaderTests-1906821848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:29:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4a50132e-ec87-4f6c-8135-b80e5646a55a tempest-ProjectReaderTests-1906821848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:29:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4a50132e-ec87-4f6c-8135-b80e5646a55a tempest-ProjectReaderTests-1906821848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:29:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4a50132e-ec87-4f6c-8135-b80e5646a55a tempest-ProjectReaderTests-1906821848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:29:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4a50132e-ec87-4f6c-8135-b80e5646a55a tempest-ProjectReaderTests-1906821848 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:29:27 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-4a50132e-ec87-4f6c-8135-b80e5646a55a tempest-ProjectReaderTests-1906821848 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:29:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4a50132e-ec87-4f6c-8135-b80e5646a55a tempest-ProjectReaderTests-1906821848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-410a197f-d181-48bc-8494-48fdf895aded 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:27 devstack sudo[104516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-410a197f-d181-48bc-8494-48fdf895aded 1073741824 Sep 03 11:29:27 devstack sudo[104516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:27 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (704dee98-3505-49aa-b4da-06bad395e571) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84a1f888-f868-4b01-a052-69813e3d2908', 'volume_size': 1, 'snapshot_id': 'a101eb9b-57bc-4cf2-920a-7b775993d803'}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:27 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8422c800-65ac-4e91-a05b-35b5eb0af16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:27 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Volume volume-84a1f888-f868-4b01-a052-69813e3d2908 (84a1f888-f868-4b01-a052-69813e3d2908): created successfully Sep 03 11:29:27 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8422c800-65ac-4e91-a05b-35b5eb0af16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:27 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Flow 'volume_create_manager' (d7d5021b-131e-4c6d-9ae2-8d4412897edd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:29:27 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-3af163de-8c8b-49fa-8c00-e6ec76568795 tempest-TestStampPattern-415769870 None] Created volume successfully. Sep 03 11:29:28 devstack sudo[104516]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4a50132e-ec87-4f6c-8135-b80e5646a55a tempest-ProjectReaderTests-1906821848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-410a197f-d181-48bc-8494-48fdf895aded 1073741824" returned: 0 in 0.514s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4a50132e-ec87-4f6c-8135-b80e5646a55a tempest-ProjectReaderTests-1906821848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-410a197f-d181-48bc-8494-48fdf895aded {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:28 devstack sudo[104531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-410a197f-d181-48bc-8494-48fdf895aded Sep 03 11:29:28 devstack sudo[104531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:28 devstack sudo[104531]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4a50132e-ec87-4f6c-8135-b80e5646a55a tempest-ProjectReaderTests-1906821848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-410a197f-d181-48bc-8494-48fdf895aded" returned: 0 in 0.275s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:28 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4a50132e-ec87-4f6c-8135-b80e5646a55a tempest-ProjectReaderTests-1906821848 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:29:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4a50132e-ec87-4f6c-8135-b80e5646a55a tempest-ProjectReaderTests-1906821848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:29:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4a50132e-ec87-4f6c-8135-b80e5646a55a tempest-ProjectReaderTests-1906821848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4085dc0-3be7-4d4c-95ca-e37a43b4192b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-410a197f-d181-48bc-8494-48fdf895aded', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4a50132e-ec87-4f6c-8135-b80e5646a55a tempest-ProjectReaderTests-1906821848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38dab96d-c749-4bbc-9ed1-a6a6edb0f614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:28 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-4a50132e-ec87-4f6c-8135-b80e5646a55a tempest-ProjectReaderTests-1906821848 None] Volume volume-410a197f-d181-48bc-8494-48fdf895aded (410a197f-d181-48bc-8494-48fdf895aded): created successfully Sep 03 11:29:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4a50132e-ec87-4f6c-8135-b80e5646a55a tempest-ProjectReaderTests-1906821848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38dab96d-c749-4bbc-9ed1-a6a6edb0f614) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-4a50132e-ec87-4f6c-8135-b80e5646a55a tempest-ProjectReaderTests-1906821848 None] Flow 'volume_create_manager' (a6e2c920-bc14-44d5-bffc-13e7b77e0cd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:29:28 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-4a50132e-ec87-4f6c-8135-b80e5646a55a tempest-ProjectReaderTests-1906821848 None] Created volume successfully. Sep 03 11:29:29 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1f8a56f8-c878-4081-a683-9699d002fbb8 tempest-ProjectReaderTests-1906821848 None] Acquiring lock "cinder-410a197f-d181-48bc-8494-48fdf895aded-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:29:29 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1f8a56f8-c878-4081-a683-9699d002fbb8 tempest-ProjectReaderTests-1906821848 None] Lock "cinder-410a197f-d181-48bc-8494-48fdf895aded-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:29:29 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1f8a56f8-c878-4081-a683-9699d002fbb8 tempest-ProjectReaderTests-1906821848 None] Acquiring lock "cinder-quobyte-410a197f-d181-48bc-8494-48fdf895aded" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:29:29 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1f8a56f8-c878-4081-a683-9699d002fbb8 tempest-ProjectReaderTests-1906821848 None] Lock "cinder-quobyte-410a197f-d181-48bc-8494-48fdf895aded" acquired by "delete_volume" :: waited 0.022s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:29:29 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6f45f3-88dc-438a-a62b-fc9e5ed57026]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:29:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1f8a56f8-c878-4081-a683-9699d002fbb8 tempest-ProjectReaderTests-1906821848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-410a197f-d181-48bc-8494-48fdf895aded {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:29 devstack sudo[104584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-410a197f-d181-48bc-8494-48fdf895aded Sep 03 11:29:29 devstack sudo[104584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:30 devstack sudo[104584]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1f8a56f8-c878-4081-a683-9699d002fbb8 tempest-ProjectReaderTests-1906821848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-410a197f-d181-48bc-8494-48fdf895aded" returned: 0 in 0.401s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1f8a56f8-c878-4081-a683-9699d002fbb8 tempest-ProjectReaderTests-1906821848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-410a197f-d181-48bc-8494-48fdf895aded {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:30 devstack sudo[104590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-410a197f-d181-48bc-8494-48fdf895aded Sep 03 11:29:30 devstack sudo[104590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:30 devstack sudo[104590]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1f8a56f8-c878-4081-a683-9699d002fbb8 tempest-ProjectReaderTests-1906821848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-410a197f-d181-48bc-8494-48fdf895aded" returned: 0 in 0.255s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1f8a56f8-c878-4081-a683-9699d002fbb8 tempest-ProjectReaderTests-1906821848 None] Lock "cinder-quobyte-410a197f-d181-48bc-8494-48fdf895aded" released by "delete_volume" :: held 0.699s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:29:30 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=109,cinder:UPDATE=163,cinder:INSERT=46,cinder:DELETE=13 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:29:30 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-1f8a56f8-c878-4081-a683-9699d002fbb8 tempest-ProjectReaderTests-1906821848 None] Created reservations ['9c4a2f99-3e85-4f42-94b6-ad9ce69ce780', '06c71c4e-9a65-4584-8362-058148cc6ef3', '1a644a9e-adbf-4994-99b0-a7cb0fafa5df', '7e593737-9502-46c3-b23c-310c2f41da4c'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:29:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1f8a56f8-c878-4081-a683-9699d002fbb8 tempest-ProjectReaderTests-1906821848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:29:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1f8a56f8-c878-4081-a683-9699d002fbb8 tempest-ProjectReaderTests-1906821848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:29:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1f8a56f8-c878-4081-a683-9699d002fbb8 tempest-ProjectReaderTests-1906821848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:29:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1f8a56f8-c878-4081-a683-9699d002fbb8 tempest-ProjectReaderTests-1906821848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:29:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1f8a56f8-c878-4081-a683-9699d002fbb8 tempest-ProjectReaderTests-1906821848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:29:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1f8a56f8-c878-4081-a683-9699d002fbb8 tempest-ProjectReaderTests-1906821848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:30 devstack sudo[104595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:29:30 devstack sudo[104595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:30 devstack sudo[104595]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1f8a56f8-c878-4081-a683-9699d002fbb8 tempest-ProjectReaderTests-1906821848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.327s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:30 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-1f8a56f8-c878-4081-a683-9699d002fbb8 tempest-ProjectReaderTests-1906821848 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:29:30 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-1f8a56f8-c878-4081-a683-9699d002fbb8 tempest-ProjectReaderTests-1906821848 None] Deleted volume successfully. Sep 03 11:29:30 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=148,cinder:UPDATE=173,cinder:INSERT=41,cinder:DELETE=19 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:29:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1f8a56f8-c878-4081-a683-9699d002fbb8 tempest-ProjectReaderTests-1906821848 None] Lock "cinder-410a197f-d181-48bc-8494-48fdf895aded-delete_volume" released by "delete_volume" :: held 1.337s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:29:31 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-bac917f4-73e6-44d1-b504-50e07b261498 tempest-ProjectReaderTests-1906821848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:29:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bac917f4-73e6-44d1-b504-50e07b261498 tempest-ProjectReaderTests-1906821848 None] Flow 'volume_create_manager' (0e1685fe-2926-4fd4-b75b-cef1eeda8208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:29:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bac917f4-73e6-44d1-b504-50e07b261498 tempest-ProjectReaderTests-1906821848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35cf3feb-6ed7-45b8-ae83-184a12fff359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bac917f4-73e6-44d1-b504-50e07b261498 tempest-ProjectReaderTests-1906821848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35cf3feb-6ed7-45b8-ae83-184a12fff359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1471692770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0099b7f-bef8-4a98-a9f3-639c2a239782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352acc94007b4dac802ba4797918695e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:29:31Z,use_quota=True,user_id='13ad9001da8e4f468018add355359de9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bac917f4-73e6-44d1-b504-50e07b261498 tempest-ProjectReaderTests-1906821848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (874cc65e-8e09-496d-9636-2bcdddf90eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bac917f4-73e6-44d1-b504-50e07b261498 tempest-ProjectReaderTests-1906821848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (874cc65e-8e09-496d-9636-2bcdddf90eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bac917f4-73e6-44d1-b504-50e07b261498 tempest-ProjectReaderTests-1906821848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07027e67-3bf3-4bd4-b9a0-c74ced870711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bac917f4-73e6-44d1-b504-50e07b261498 tempest-ProjectReaderTests-1906821848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07027e67-3bf3-4bd4-b9a0-c74ced870711) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0099b7f-bef8-4a98-a9f3-639c2a239782', 'volume_name': 'volume-c0099b7f-bef8-4a98-a9f3-639c2a239782', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bac917f4-73e6-44d1-b504-50e07b261498 tempest-ProjectReaderTests-1906821848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f89d94b-101d-4459-951e-9a8619264c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bac917f4-73e6-44d1-b504-50e07b261498 tempest-ProjectReaderTests-1906821848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f89d94b-101d-4459-951e-9a8619264c27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bac917f4-73e6-44d1-b504-50e07b261498 tempest-ProjectReaderTests-1906821848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (990cad3a-b626-441e-afdd-d3dab6ec5c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:31 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-bac917f4-73e6-44d1-b504-50e07b261498 tempest-ProjectReaderTests-1906821848 None] Volume c0099b7f-bef8-4a98-a9f3-639c2a239782: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0099b7f-bef8-4a98-a9f3-639c2a239782', 'volume_size': 1} Sep 03 11:29:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bac917f4-73e6-44d1-b504-50e07b261498 tempest-ProjectReaderTests-1906821848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:29:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bac917f4-73e6-44d1-b504-50e07b261498 tempest-ProjectReaderTests-1906821848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:29:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-bac917f4-73e6-44d1-b504-50e07b261498 tempest-ProjectReaderTests-1906821848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:29:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1471692770',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0099b7f-bef8-4a98-a9f3-639c2a239782,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352acc94007b4dac802ba4797918695e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:29:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:29:31Z,use_quota=True,user_id='13ad9001da8e4f468018add355359de9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:29:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-bac917f4-73e6-44d1-b504-50e07b261498 tempest-ProjectReaderTests-1906821848 None] Creating volume c0099b7f-bef8-4a98-a9f3-639c2a239782 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:29:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bac917f4-73e6-44d1-b504-50e07b261498 tempest-ProjectReaderTests-1906821848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:29:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bac917f4-73e6-44d1-b504-50e07b261498 tempest-ProjectReaderTests-1906821848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:29:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-bac917f4-73e6-44d1-b504-50e07b261498 tempest-ProjectReaderTests-1906821848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:29:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-bac917f4-73e6-44d1-b504-50e07b261498 tempest-ProjectReaderTests-1906821848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:29:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bac917f4-73e6-44d1-b504-50e07b261498 tempest-ProjectReaderTests-1906821848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:29:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-bac917f4-73e6-44d1-b504-50e07b261498 tempest-ProjectReaderTests-1906821848 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:29:31 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-bac917f4-73e6-44d1-b504-50e07b261498 tempest-ProjectReaderTests-1906821848 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:29:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bac917f4-73e6-44d1-b504-50e07b261498 tempest-ProjectReaderTests-1906821848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0099b7f-bef8-4a98-a9f3-639c2a239782 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:31 devstack sudo[104599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0099b7f-bef8-4a98-a9f3-639c2a239782 1073741824 Sep 03 11:29:31 devstack sudo[104599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:31 devstack sudo[104599]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bac917f4-73e6-44d1-b504-50e07b261498 tempest-ProjectReaderTests-1906821848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0099b7f-bef8-4a98-a9f3-639c2a239782 1073741824" returned: 0 in 0.435s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bac917f4-73e6-44d1-b504-50e07b261498 tempest-ProjectReaderTests-1906821848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0099b7f-bef8-4a98-a9f3-639c2a239782 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:31 devstack sudo[104604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0099b7f-bef8-4a98-a9f3-639c2a239782 Sep 03 11:29:31 devstack sudo[104604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:32 devstack sudo[104604]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-bac917f4-73e6-44d1-b504-50e07b261498 tempest-ProjectReaderTests-1906821848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0099b7f-bef8-4a98-a9f3-639c2a239782" returned: 0 in 0.261s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-bac917f4-73e6-44d1-b504-50e07b261498 tempest-ProjectReaderTests-1906821848 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:29:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-bac917f4-73e6-44d1-b504-50e07b261498 tempest-ProjectReaderTests-1906821848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:29:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bac917f4-73e6-44d1-b504-50e07b261498 tempest-ProjectReaderTests-1906821848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (990cad3a-b626-441e-afdd-d3dab6ec5c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0099b7f-bef8-4a98-a9f3-639c2a239782', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bac917f4-73e6-44d1-b504-50e07b261498 tempest-ProjectReaderTests-1906821848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (050d1671-5504-4e3c-8e5f-cd8652bc88ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:29:32 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-bac917f4-73e6-44d1-b504-50e07b261498 tempest-ProjectReaderTests-1906821848 None] Volume volume-c0099b7f-bef8-4a98-a9f3-639c2a239782 (c0099b7f-bef8-4a98-a9f3-639c2a239782): created successfully Sep 03 11:29:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bac917f4-73e6-44d1-b504-50e07b261498 tempest-ProjectReaderTests-1906821848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (050d1671-5504-4e3c-8e5f-cd8652bc88ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:29:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-bac917f4-73e6-44d1-b504-50e07b261498 tempest-ProjectReaderTests-1906821848 None] Flow 'volume_create_manager' (0e1685fe-2926-4fd4-b75b-cef1eeda8208) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:29:32 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-bac917f4-73e6-44d1-b504-50e07b261498 tempest-ProjectReaderTests-1906821848 None] Created volume successfully. Sep 03 11:29:32 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-39150961-24ef-4e50-a938-c9d7a7750034 tempest-ProjectReaderTests-1906821848 None] Acquiring lock "cinder-c0099b7f-bef8-4a98-a9f3-639c2a239782-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:29:32 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-39150961-24ef-4e50-a938-c9d7a7750034 tempest-ProjectReaderTests-1906821848 None] Lock "cinder-c0099b7f-bef8-4a98-a9f3-639c2a239782-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:29:32 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-39150961-24ef-4e50-a938-c9d7a7750034 tempest-ProjectReaderTests-1906821848 None] Acquiring lock "cinder-quobyte-c0099b7f-bef8-4a98-a9f3-639c2a239782" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:29:32 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-39150961-24ef-4e50-a938-c9d7a7750034 tempest-ProjectReaderTests-1906821848 None] Lock "cinder-quobyte-c0099b7f-bef8-4a98-a9f3-639c2a239782" acquired by "delete_volume" :: waited 0.016s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:29:32 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[81670e96-d48c-4112-912b-6568fcebe5d2]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:29:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-39150961-24ef-4e50-a938-c9d7a7750034 tempest-ProjectReaderTests-1906821848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0099b7f-bef8-4a98-a9f3-639c2a239782 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:32 devstack sudo[104607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0099b7f-bef8-4a98-a9f3-639c2a239782 Sep 03 11:29:32 devstack sudo[104607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:32 devstack sudo[104607]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-39150961-24ef-4e50-a938-c9d7a7750034 tempest-ProjectReaderTests-1906821848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0099b7f-bef8-4a98-a9f3-639c2a239782" returned: 0 in 0.404s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-39150961-24ef-4e50-a938-c9d7a7750034 tempest-ProjectReaderTests-1906821848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0099b7f-bef8-4a98-a9f3-639c2a239782 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:33 devstack sudo[104612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0099b7f-bef8-4a98-a9f3-639c2a239782 Sep 03 11:29:33 devstack sudo[104612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:33 devstack sudo[104612]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-39150961-24ef-4e50-a938-c9d7a7750034 tempest-ProjectReaderTests-1906821848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0099b7f-bef8-4a98-a9f3-639c2a239782" returned: 0 in 0.261s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:33 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-39150961-24ef-4e50-a938-c9d7a7750034 tempest-ProjectReaderTests-1906821848 None] Lock "cinder-quobyte-c0099b7f-bef8-4a98-a9f3-639c2a239782" released by "delete_volume" :: held 0.718s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:29:33 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-39150961-24ef-4e50-a938-c9d7a7750034 tempest-ProjectReaderTests-1906821848 None] Created reservations ['6f8cf0b4-d770-4982-99e4-0c64cc77226c', '6eb5be1f-c7e5-4804-a0bd-6d0d4897a9d5', '57dfb4cd-5897-4347-99dc-53d9399ae90c', 'a36aa62b-4c25-4411-99be-6db2857fc7bb'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:29:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-39150961-24ef-4e50-a938-c9d7a7750034 tempest-ProjectReaderTests-1906821848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:29:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-39150961-24ef-4e50-a938-c9d7a7750034 tempest-ProjectReaderTests-1906821848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:29:33 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-39150961-24ef-4e50-a938-c9d7a7750034 tempest-ProjectReaderTests-1906821848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:29:33 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-39150961-24ef-4e50-a938-c9d7a7750034 tempest-ProjectReaderTests-1906821848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:29:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-39150961-24ef-4e50-a938-c9d7a7750034 tempest-ProjectReaderTests-1906821848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:29:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-39150961-24ef-4e50-a938-c9d7a7750034 tempest-ProjectReaderTests-1906821848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:29:33 devstack sudo[104615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:29:33 devstack sudo[104615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:29:33 devstack sudo[104615]: pam_unix(sudo:session): session closed for user root Sep 03 11:29:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-39150961-24ef-4e50-a938-c9d7a7750034 tempest-ProjectReaderTests-1906821848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.284s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:29:33 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-39150961-24ef-4e50-a938-c9d7a7750034 tempest-ProjectReaderTests-1906821848 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:29:33 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-39150961-24ef-4e50-a938-c9d7a7750034 tempest-ProjectReaderTests-1906821848 None] Deleted volume successfully. Sep 03 11:29:33 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-39150961-24ef-4e50-a938-c9d7a7750034 tempest-ProjectReaderTests-1906821848 None] Lock "cinder-c0099b7f-bef8-4a98-a9f3-639c2a239782-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:29:51 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:UPDATE=12,cinder:SELECT=8,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:29:51 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:INSERT=5,cinder:UPDATE=18,cinder:SELECT=9,cinder:DELETE=1 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:29:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-7f449053-5cff-4d85-b49a-2f2a2f08d4d7 req-75693863-9c93-41b4-9099-76f14b1693e1 tempest-TestStampPattern-415769870 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:29:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-7f449053-5cff-4d85-b49a-2f2a2f08d4d7 req-75693863-9c93-41b4-9099-76f14b1693e1 tempest-TestStampPattern-415769870 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:29:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [req-7f449053-5cff-4d85-b49a-2f2a2f08d4d7 req-75693863-9c93-41b4-9099-76f14b1693e1 tempest-TestStampPattern-415769870 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:29:57 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-7f449053-5cff-4d85-b49a-2f2a2f08d4d7 req-75693863-9c93-41b4-9099-76f14b1693e1 tempest-TestStampPattern-415769870 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912', 'name': 'volume-84a1f888-f868-4b01-a052-69813e3d2908', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9f89b397-940f-46bd-a173-c9f962cc2497', 'enforce_multipath': True} {{(pid=87038) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:29:57 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-7f449053-5cff-4d85-b49a-2f2a2f08d4d7 req-75693863-9c93-41b4-9099-76f14b1693e1 tempest-TestStampPattern-415769870 None] attachment_update completed successfully. Sep 03 11:30:00 devstack cinder-volume[87038]: INFO cinder.volume.manager [req-52c32c1d-bf90-4d5e-b480-c619b27d73d0 req-84735368-b5f4-4c26-b35e-c457c2539bd3 tempest-TestStampPattern-415769870 None] Terminate volume connection completed successfully. Sep 03 11:30:00 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [req-52c32c1d-bf90-4d5e-b480-c619b27d73d0 req-84735368-b5f4-4c26-b35e-c457c2539bd3 tempest-TestStampPattern-415769870 None] Deleting attachment 9f89b397-940f-46bd-a173-c9f962cc2497. {{(pid=87038) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:30:04 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e19552dd-6430-4acc-9c7e-33c6fc78c4a1 tempest-TestStampPattern-415769870 None] Acquiring lock "cinder-84a1f888-f868-4b01-a052-69813e3d2908-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:30:04 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e19552dd-6430-4acc-9c7e-33c6fc78c4a1 tempest-TestStampPattern-415769870 None] Lock "cinder-84a1f888-f868-4b01-a052-69813e3d2908-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:30:04 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e19552dd-6430-4acc-9c7e-33c6fc78c4a1 tempest-TestStampPattern-415769870 None] Acquiring lock "cinder-quobyte-84a1f888-f868-4b01-a052-69813e3d2908" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:30:04 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e19552dd-6430-4acc-9c7e-33c6fc78c4a1 tempest-TestStampPattern-415769870 None] Lock "cinder-quobyte-84a1f888-f868-4b01-a052-69813e3d2908" acquired by "delete_volume" :: waited 0.015s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:30:04 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[04be33fd-1f02-4d97-b4f5-c01a0941df6f]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:30:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e19552dd-6430-4acc-9c7e-33c6fc78c4a1 tempest-TestStampPattern-415769870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-84a1f888-f868-4b01-a052-69813e3d2908 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:30:04 devstack sudo[105126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-84a1f888-f868-4b01-a052-69813e3d2908 Sep 03 11:30:04 devstack sudo[105126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:30:04 devstack sudo[105126]: pam_unix(sudo:session): session closed for user root Sep 03 11:30:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e19552dd-6430-4acc-9c7e-33c6fc78c4a1 tempest-TestStampPattern-415769870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-84a1f888-f868-4b01-a052-69813e3d2908" returned: 0 in 0.353s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:30:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e19552dd-6430-4acc-9c7e-33c6fc78c4a1 tempest-TestStampPattern-415769870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-84a1f888-f868-4b01-a052-69813e3d2908 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:30:04 devstack sudo[105131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-84a1f888-f868-4b01-a052-69813e3d2908 Sep 03 11:30:04 devstack sudo[105131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:30:04 devstack sudo[105131]: pam_unix(sudo:session): session closed for user root Sep 03 11:30:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e19552dd-6430-4acc-9c7e-33c6fc78c4a1 tempest-TestStampPattern-415769870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-84a1f888-f868-4b01-a052-69813e3d2908" returned: 0 in 0.235s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:30:04 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e19552dd-6430-4acc-9c7e-33c6fc78c4a1 tempest-TestStampPattern-415769870 None] Lock "cinder-quobyte-84a1f888-f868-4b01-a052-69813e3d2908" released by "delete_volume" :: held 0.626s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:30:04 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-e19552dd-6430-4acc-9c7e-33c6fc78c4a1 tempest-TestStampPattern-415769870 None] Created reservations ['7bf9da83-4aaa-4e18-9f26-d7e4efe306cd', '8a6a58e9-a171-4a43-842f-7a9d3dbbfe9f', '464b400a-890f-42fb-b61c-1e4ad36b0d27', 'b4ffcea2-f373-4a64-a1db-01df77ea3cc7'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:30:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e19552dd-6430-4acc-9c7e-33c6fc78c4a1 tempest-TestStampPattern-415769870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:30:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e19552dd-6430-4acc-9c7e-33c6fc78c4a1 tempest-TestStampPattern-415769870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:30:05 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e19552dd-6430-4acc-9c7e-33c6fc78c4a1 tempest-TestStampPattern-415769870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:30:05 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e19552dd-6430-4acc-9c7e-33c6fc78c4a1 tempest-TestStampPattern-415769870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:30:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e19552dd-6430-4acc-9c7e-33c6fc78c4a1 tempest-TestStampPattern-415769870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:30:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e19552dd-6430-4acc-9c7e-33c6fc78c4a1 tempest-TestStampPattern-415769870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:30:05 devstack sudo[105134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:30:05 devstack sudo[105134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:30:05 devstack sudo[105134]: pam_unix(sudo:session): session closed for user root Sep 03 11:30:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e19552dd-6430-4acc-9c7e-33c6fc78c4a1 tempest-TestStampPattern-415769870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.245s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:30:05 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-e19552dd-6430-4acc-9c7e-33c6fc78c4a1 tempest-TestStampPattern-415769870 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:30:05 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-e19552dd-6430-4acc-9c7e-33c6fc78c4a1 tempest-TestStampPattern-415769870 None] Deleted volume successfully. Sep 03 11:30:05 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e19552dd-6430-4acc-9c7e-33c6fc78c4a1 tempest-TestStampPattern-415769870 None] Lock "cinder-84a1f888-f868-4b01-a052-69813e3d2908-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:30:05 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-eb6f9ac1-6f9e-475f-8d58-637383d7deab tempest-TestStampPattern-415769870 None] Acquiring lock "cinder-a101eb9b-57bc-4cf2-920a-7b775993d803-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:30:05 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-eb6f9ac1-6f9e-475f-8d58-637383d7deab tempest-TestStampPattern-415769870 None] Lock "cinder-a101eb9b-57bc-4cf2-920a-7b775993d803-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:30:05 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-eb6f9ac1-6f9e-475f-8d58-637383d7deab tempest-TestStampPattern-415769870 None] Acquiring lock "cinder-quobyte-4c63ecd4-5171-41ca-8f14-943222ffaba0" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:30:05 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-eb6f9ac1-6f9e-475f-8d58-637383d7deab tempest-TestStampPattern-415769870 None] Lock "cinder-quobyte-4c63ecd4-5171-41ca-8f14-943222ffaba0" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:30:05 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-eb6f9ac1-6f9e-475f-8d58-637383d7deab tempest-TestStampPattern-415769870 None] Acquiring lock "cinder-quobyte-a101eb9b-57bc-4cf2-920a-7b775993d803" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:30:05 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-eb6f9ac1-6f9e-475f-8d58-637383d7deab tempest-TestStampPattern-415769870 None] Lock "cinder-quobyte-a101eb9b-57bc-4cf2-920a-7b775993d803" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:30:05 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-eb6f9ac1-6f9e-475f-8d58-637383d7deab tempest-TestStampPattern-415769870 None] Deleting offline snapshot a101eb9b-57bc-4cf2-920a-7b775993d803 of volume 4c63ecd4-5171-41ca-8f14-943222ffaba0 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:30:05 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-eb6f9ac1-6f9e-475f-8d58-637383d7deab tempest-TestStampPattern-415769870 None] snapshot_file for this snap is: volume-4c63ecd4-5171-41ca-8f14-943222ffaba0.a101eb9b-57bc-4cf2-920a-7b775993d803 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:30:05 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[2023ddda-4df0-4657-99fe-08d6eee6c28e]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:30:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-eb6f9ac1-6f9e-475f-8d58-637383d7deab tempest-TestStampPattern-415769870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0.a101eb9b-57bc-4cf2-920a-7b775993d803 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:30:05 devstack sudo[105137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0.a101eb9b-57bc-4cf2-920a-7b775993d803 Sep 03 11:30:05 devstack sudo[105137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:30:06 devstack sudo[105137]: pam_unix(sudo:session): session closed for user root Sep 03 11:30:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-eb6f9ac1-6f9e-475f-8d58-637383d7deab tempest-TestStampPattern-415769870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0.a101eb9b-57bc-4cf2-920a-7b775993d803" returned: 0 in 0.344s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:30:06 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-eb6f9ac1-6f9e-475f-8d58-637383d7deab tempest-TestStampPattern-415769870 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c63ecd4-5171-41ca-8f14-943222ffaba0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:30:06 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[035d092a-92e3-4b64-89b5-501fd21e6021]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:30:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-eb6f9ac1-6f9e-475f-8d58-637383d7deab tempest-TestStampPattern-415769870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:30:06 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0 Sep 03 11:30:06 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:30:06 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Sep 03 11:30:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-eb6f9ac1-6f9e-475f-8d58-637383d7deab tempest-TestStampPattern-415769870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0" returned: 0 in 0.497s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:30:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-eb6f9ac1-6f9e-475f-8d58-637383d7deab tempest-TestStampPattern-415769870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0.a101eb9b-57bc-4cf2-920a-7b775993d803 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:30:06 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0.a101eb9b-57bc-4cf2-920a-7b775993d803 Sep 03 11:30:06 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:30:06 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Sep 03 11:30:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-eb6f9ac1-6f9e-475f-8d58-637383d7deab tempest-TestStampPattern-415769870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0.a101eb9b-57bc-4cf2-920a-7b775993d803" returned: 0 in 0.320s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:30:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-eb6f9ac1-6f9e-475f-8d58-637383d7deab tempest-TestStampPattern-415769870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0.a101eb9b-57bc-4cf2-920a-7b775993d803 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:30:06 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0.a101eb9b-57bc-4cf2-920a-7b775993d803 Sep 03 11:30:06 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:30:07 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Sep 03 11:30:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-eb6f9ac1-6f9e-475f-8d58-637383d7deab tempest-TestStampPattern-415769870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0.a101eb9b-57bc-4cf2-920a-7b775993d803" returned: 0 in 0.236s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:30:07 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-eb6f9ac1-6f9e-475f-8d58-637383d7deab tempest-TestStampPattern-415769870 None] Lock "cinder-quobyte-a101eb9b-57bc-4cf2-920a-7b775993d803" released by "_delete_snapshot" :: held 1.487s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:30:07 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-eb6f9ac1-6f9e-475f-8d58-637383d7deab tempest-TestStampPattern-415769870 None] Lock "cinder-quobyte-4c63ecd4-5171-41ca-8f14-943222ffaba0" released by "delete_snapshot" :: held 1.511s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:30:07 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-eb6f9ac1-6f9e-475f-8d58-637383d7deab tempest-TestStampPattern-415769870 None] Created reservations ['59901763-3d96-4496-a0d4-c56b927f42a0', '04995bed-9fc5-4f60-8949-98301d4660c5', '7c6bd1b2-3446-4921-9e43-6912c8c48d76', 'de644a80-8b54-4395-b739-e1e4d27c47ce'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:30:07 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-eb6f9ac1-6f9e-475f-8d58-637383d7deab tempest-TestStampPattern-415769870 None] Delete snapshot completed successfully. Sep 03 11:30:07 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-eb6f9ac1-6f9e-475f-8d58-637383d7deab tempest-TestStampPattern-415769870 None] Lock "cinder-a101eb9b-57bc-4cf2-920a-7b775993d803-delete_snapshot" released by "delete_snapshot" :: held 1.642s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:30:11 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-6a45a21f-6f48-4876-9b02-56c99051d4eb tempest-TestStampPattern-415769870 None] Acquiring lock "cinder-4c63ecd4-5171-41ca-8f14-943222ffaba0-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:30:11 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-6a45a21f-6f48-4876-9b02-56c99051d4eb tempest-TestStampPattern-415769870 None] Lock "cinder-4c63ecd4-5171-41ca-8f14-943222ffaba0-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:30:11 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-6a45a21f-6f48-4876-9b02-56c99051d4eb tempest-TestStampPattern-415769870 None] Acquiring lock "cinder-quobyte-4c63ecd4-5171-41ca-8f14-943222ffaba0" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:30:11 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-6a45a21f-6f48-4876-9b02-56c99051d4eb tempest-TestStampPattern-415769870 None] Lock "cinder-quobyte-4c63ecd4-5171-41ca-8f14-943222ffaba0" acquired by "delete_volume" :: waited 0.013s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:30:11 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcb776f-eb38-4d85-a4c1-452026e6fa53]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:30:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6a45a21f-6f48-4876-9b02-56c99051d4eb tempest-TestStampPattern-415769870 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:30:11 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0 Sep 03 11:30:11 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:30:11 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Sep 03 11:30:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6a45a21f-6f48-4876-9b02-56c99051d4eb tempest-TestStampPattern-415769870 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0" returned: 0 in 0.350s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:30:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6a45a21f-6f48-4876-9b02-56c99051d4eb tempest-TestStampPattern-415769870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:30:11 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0 Sep 03 11:30:11 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:30:12 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Sep 03 11:30:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6a45a21f-6f48-4876-9b02-56c99051d4eb tempest-TestStampPattern-415769870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4c63ecd4-5171-41ca-8f14-943222ffaba0" returned: 0 in 0.240s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:30:12 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-6a45a21f-6f48-4876-9b02-56c99051d4eb tempest-TestStampPattern-415769870 None] Lock "cinder-quobyte-4c63ecd4-5171-41ca-8f14-943222ffaba0" released by "delete_volume" :: held 0.641s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:30:12 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-6a45a21f-6f48-4876-9b02-56c99051d4eb tempest-TestStampPattern-415769870 None] Created reservations ['51aad469-3365-481e-ba4c-8f26f9925496', '56cd888e-ced2-4a93-8f1a-d263d9b17b14', '377a7ab1-242b-4b33-a409-1fa9dc417ded', 'f7eb563d-5288-40df-bf6a-91fb93a2082f'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:30:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6a45a21f-6f48-4876-9b02-56c99051d4eb tempest-TestStampPattern-415769870 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:30:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6a45a21f-6f48-4876-9b02-56c99051d4eb tempest-TestStampPattern-415769870 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:30:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6a45a21f-6f48-4876-9b02-56c99051d4eb tempest-TestStampPattern-415769870 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:30:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6a45a21f-6f48-4876-9b02-56c99051d4eb tempest-TestStampPattern-415769870 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:30:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6a45a21f-6f48-4876-9b02-56c99051d4eb tempest-TestStampPattern-415769870 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:30:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6a45a21f-6f48-4876-9b02-56c99051d4eb tempest-TestStampPattern-415769870 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:30:12 devstack sudo[105191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:30:12 devstack sudo[105191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:30:12 devstack sudo[105191]: pam_unix(sudo:session): session closed for user root Sep 03 11:30:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6a45a21f-6f48-4876-9b02-56c99051d4eb tempest-TestStampPattern-415769870 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.236s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:30:12 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-6a45a21f-6f48-4876-9b02-56c99051d4eb tempest-TestStampPattern-415769870 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:30:12 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-6a45a21f-6f48-4876-9b02-56c99051d4eb tempest-TestStampPattern-415769870 None] Deleted volume successfully. Sep 03 11:30:12 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-6a45a21f-6f48-4876-9b02-56c99051d4eb tempest-TestStampPattern-415769870 None] Lock "cinder-4c63ecd4-5171-41ca-8f14-943222ffaba0-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:30:17 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:30:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:30:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:30:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:30:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:30:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:30:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:30:17 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:30:17 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:30:18 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Sep 03 11:30:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.243s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:30:18 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:30:18 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:30:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread count: 28 {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:30:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread info: [<_MainThread(MainThread, started 139554943000704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:30:22 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=21,cinder:UPDATE=23,cinder:INSERT=5 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:30:22 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=25,cinder:INSERT=7,cinder:UPDATE=23,cinder:DELETE=2 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:30:44 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b4d6e3f-3ba3-496b-9770-fb097ee3e2a2 tempest-SnapshotDependencyTests-1975108325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:30:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5b4d6e3f-3ba3-496b-9770-fb097ee3e2a2 tempest-SnapshotDependencyTests-1975108325 None] Flow 'volume_create_manager' (03d96e45-6503-4ea4-9fd9-74382dea85b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:30:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5b4d6e3f-3ba3-496b-9770-fb097ee3e2a2 tempest-SnapshotDependencyTests-1975108325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c222fb-58d5-4db0-b7db-dbd90df24182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:30:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5b4d6e3f-3ba3-496b-9770-fb097ee3e2a2 tempest-SnapshotDependencyTests-1975108325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3c222fb-58d5-4db0-b7db-dbd90df24182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-402623086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e93df87f-5e0c-4543-bc57-67674c76b60d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1de472262d4266b1f3cb2e46b76d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:30:44Z,use_quota=True,user_id='469caeb25c6244fc9c2bfa8594b626bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:30:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5b4d6e3f-3ba3-496b-9770-fb097ee3e2a2 tempest-SnapshotDependencyTests-1975108325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4765a385-e7d2-4daa-8888-df9aab7e8a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:30:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5b4d6e3f-3ba3-496b-9770-fb097ee3e2a2 tempest-SnapshotDependencyTests-1975108325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4765a385-e7d2-4daa-8888-df9aab7e8a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:30:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5b4d6e3f-3ba3-496b-9770-fb097ee3e2a2 tempest-SnapshotDependencyTests-1975108325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eab721a-f815-498d-a362-e94656747794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:30:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5b4d6e3f-3ba3-496b-9770-fb097ee3e2a2 tempest-SnapshotDependencyTests-1975108325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6eab721a-f815-498d-a362-e94656747794) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e93df87f-5e0c-4543-bc57-67674c76b60d', 'volume_name': 'volume-e93df87f-5e0c-4543-bc57-67674c76b60d', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:30:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5b4d6e3f-3ba3-496b-9770-fb097ee3e2a2 tempest-SnapshotDependencyTests-1975108325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cceb564-ec6c-433d-9c4b-609d8990ab8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:30:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5b4d6e3f-3ba3-496b-9770-fb097ee3e2a2 tempest-SnapshotDependencyTests-1975108325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cceb564-ec6c-433d-9c4b-609d8990ab8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:30:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5b4d6e3f-3ba3-496b-9770-fb097ee3e2a2 tempest-SnapshotDependencyTests-1975108325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0886346d-fd1c-4079-9617-9553b60e2f07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:30:44 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-5b4d6e3f-3ba3-496b-9770-fb097ee3e2a2 tempest-SnapshotDependencyTests-1975108325 None] Volume e93df87f-5e0c-4543-bc57-67674c76b60d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e93df87f-5e0c-4543-bc57-67674c76b60d', 'volume_size': 1} Sep 03 11:30:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5b4d6e3f-3ba3-496b-9770-fb097ee3e2a2 tempest-SnapshotDependencyTests-1975108325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:30:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5b4d6e3f-3ba3-496b-9770-fb097ee3e2a2 tempest-SnapshotDependencyTests-1975108325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:30:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5b4d6e3f-3ba3-496b-9770-fb097ee3e2a2 tempest-SnapshotDependencyTests-1975108325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-402623086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e93df87f-5e0c-4543-bc57-67674c76b60d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1de472262d4266b1f3cb2e46b76d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:30:44Z,use_quota=True,user_id='469caeb25c6244fc9c2bfa8594b626bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:30:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-5b4d6e3f-3ba3-496b-9770-fb097ee3e2a2 tempest-SnapshotDependencyTests-1975108325 None] Creating volume e93df87f-5e0c-4543-bc57-67674c76b60d {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:30:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5b4d6e3f-3ba3-496b-9770-fb097ee3e2a2 tempest-SnapshotDependencyTests-1975108325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:30:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5b4d6e3f-3ba3-496b-9770-fb097ee3e2a2 tempest-SnapshotDependencyTests-1975108325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:30:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5b4d6e3f-3ba3-496b-9770-fb097ee3e2a2 tempest-SnapshotDependencyTests-1975108325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:30:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5b4d6e3f-3ba3-496b-9770-fb097ee3e2a2 tempest-SnapshotDependencyTests-1975108325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:30:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5b4d6e3f-3ba3-496b-9770-fb097ee3e2a2 tempest-SnapshotDependencyTests-1975108325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:30:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5b4d6e3f-3ba3-496b-9770-fb097ee3e2a2 tempest-SnapshotDependencyTests-1975108325 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:30:44 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-5b4d6e3f-3ba3-496b-9770-fb097ee3e2a2 tempest-SnapshotDependencyTests-1975108325 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:30:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5b4d6e3f-3ba3-496b-9770-fb097ee3e2a2 tempest-SnapshotDependencyTests-1975108325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:30:44 devstack sudo[105249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d 1073741824 Sep 03 11:30:44 devstack sudo[105249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:30:44 devstack sudo[105249]: pam_unix(sudo:session): session closed for user root Sep 03 11:30:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5b4d6e3f-3ba3-496b-9770-fb097ee3e2a2 tempest-SnapshotDependencyTests-1975108325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d 1073741824" returned: 0 in 0.453s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:30:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5b4d6e3f-3ba3-496b-9770-fb097ee3e2a2 tempest-SnapshotDependencyTests-1975108325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:30:44 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d Sep 03 11:30:44 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:30:44 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Sep 03 11:30:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5b4d6e3f-3ba3-496b-9770-fb097ee3e2a2 tempest-SnapshotDependencyTests-1975108325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d" returned: 0 in 0.249s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:30:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5b4d6e3f-3ba3-496b-9770-fb097ee3e2a2 tempest-SnapshotDependencyTests-1975108325 None] <== create_volume: return (743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:30:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5b4d6e3f-3ba3-496b-9770-fb097ee3e2a2 tempest-SnapshotDependencyTests-1975108325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:30:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5b4d6e3f-3ba3-496b-9770-fb097ee3e2a2 tempest-SnapshotDependencyTests-1975108325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0886346d-fd1c-4079-9617-9553b60e2f07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e93df87f-5e0c-4543-bc57-67674c76b60d', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:30:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5b4d6e3f-3ba3-496b-9770-fb097ee3e2a2 tempest-SnapshotDependencyTests-1975108325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (323c016c-fe90-46f1-b623-9d1f2c85d241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:30:44 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-5b4d6e3f-3ba3-496b-9770-fb097ee3e2a2 tempest-SnapshotDependencyTests-1975108325 None] Volume volume-e93df87f-5e0c-4543-bc57-67674c76b60d (e93df87f-5e0c-4543-bc57-67674c76b60d): created successfully Sep 03 11:30:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5b4d6e3f-3ba3-496b-9770-fb097ee3e2a2 tempest-SnapshotDependencyTests-1975108325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (323c016c-fe90-46f1-b623-9d1f2c85d241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:30:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5b4d6e3f-3ba3-496b-9770-fb097ee3e2a2 tempest-SnapshotDependencyTests-1975108325 None] Flow 'volume_create_manager' (03d96e45-6503-4ea4-9fd9-74382dea85b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:30:44 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-5b4d6e3f-3ba3-496b-9770-fb097ee3e2a2 tempest-SnapshotDependencyTests-1975108325 None] Created volume successfully. Sep 03 11:30:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1b79db8c-3e99-4d8f-9e0c-b74b7f99f4f7 tempest-SnapshotDependencyTests-1975108325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:30:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1b79db8c-3e99-4d8f-9e0c-b74b7f99f4f7 tempest-SnapshotDependencyTests-1975108325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:30:45 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-1b79db8c-3e99-4d8f-9e0c-b74b7f99f4f7 tempest-SnapshotDependencyTests-1975108325 None] Creating offline snapshot 46eac5df-ed4f-40c5-a722-d4e5bf1c2478 of volume e93df87f-5e0c-4543-bc57-67674c76b60d {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:30:45 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[266b6b0d-c404-47bc-a99e-640ab900ccc0]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:30:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1b79db8c-3e99-4d8f-9e0c-b74b7f99f4f7 tempest-SnapshotDependencyTests-1975108325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:30:45 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d Sep 03 11:30:45 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:30:45 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Sep 03 11:30:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1b79db8c-3e99-4d8f-9e0c-b74b7f99f4f7 tempest-SnapshotDependencyTests-1975108325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d" returned: 0 in 0.343s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:30:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1b79db8c-3e99-4d8f-9e0c-b74b7f99f4f7 tempest-SnapshotDependencyTests-1975108325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d.46eac5df-ed4f-40c5-a722-d4e5bf1c2478 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:30:45 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d.46eac5df-ed4f-40c5-a722-d4e5bf1c2478 1G Sep 03 11:30:45 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:30:46 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Sep 03 11:30:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1b79db8c-3e99-4d8f-9e0c-b74b7f99f4f7 tempest-SnapshotDependencyTests-1975108325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d.46eac5df-ed4f-40c5-a722-d4e5bf1c2478 1G" returned: 0 in 0.366s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:30:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1b79db8c-3e99-4d8f-9e0c-b74b7f99f4f7 tempest-SnapshotDependencyTests-1975108325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e93df87f-5e0c-4543-bc57-67674c76b60d -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d.46eac5df-ed4f-40c5-a722-d4e5bf1c2478 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:30:46 devstack sudo[105268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e93df87f-5e0c-4543-bc57-67674c76b60d -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d.46eac5df-ed4f-40c5-a722-d4e5bf1c2478 Sep 03 11:30:46 devstack sudo[105268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:30:46 devstack sudo[105268]: pam_unix(sudo:session): session closed for user root Sep 03 11:30:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1b79db8c-3e99-4d8f-9e0c-b74b7f99f4f7 tempest-SnapshotDependencyTests-1975108325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e93df87f-5e0c-4543-bc57-67674c76b60d -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d.46eac5df-ed4f-40c5-a722-d4e5bf1c2478" returned: 0 in 0.269s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:30:46 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-1b79db8c-3e99-4d8f-9e0c-b74b7f99f4f7 tempest-SnapshotDependencyTests-1975108325 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d.46eac5df-ed4f-40c5-a722-d4e5bf1c2478 is being set with open permissions: ugo+rw Sep 03 11:30:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1b79db8c-3e99-4d8f-9e0c-b74b7f99f4f7 tempest-SnapshotDependencyTests-1975108325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d.46eac5df-ed4f-40c5-a722-d4e5bf1c2478 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:30:46 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d.46eac5df-ed4f-40c5-a722-d4e5bf1c2478 Sep 03 11:30:46 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:30:46 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Sep 03 11:30:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1b79db8c-3e99-4d8f-9e0c-b74b7f99f4f7 tempest-SnapshotDependencyTests-1975108325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d.46eac5df-ed4f-40c5-a722-d4e5bf1c2478" returned: 0 in 0.234s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:30:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1b79db8c-3e99-4d8f-9e0c-b74b7f99f4f7 tempest-SnapshotDependencyTests-1975108325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:30:46 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d.info Sep 03 11:30:46 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:30:46 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Sep 03 11:30:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1b79db8c-3e99-4d8f-9e0c-b74b7f99f4f7 tempest-SnapshotDependencyTests-1975108325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d.info" returned: 0 in 0.239s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:30:46 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-1b79db8c-3e99-4d8f-9e0c-b74b7f99f4f7 tempest-SnapshotDependencyTests-1975108325 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d.info is being set with open permissions: ugo+rw Sep 03 11:30:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1b79db8c-3e99-4d8f-9e0c-b74b7f99f4f7 tempest-SnapshotDependencyTests-1975108325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:30:46 devstack sudo[105279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d.info Sep 03 11:30:46 devstack sudo[105279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:30:47 devstack sudo[105279]: pam_unix(sudo:session): session closed for user root Sep 03 11:30:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1b79db8c-3e99-4d8f-9e0c-b74b7f99f4f7 tempest-SnapshotDependencyTests-1975108325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d.info" returned: 0 in 0.228s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:30:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1b79db8c-3e99-4d8f-9e0c-b74b7f99f4f7 tempest-SnapshotDependencyTests-1975108325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.754s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:30:47 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-1b79db8c-3e99-4d8f-9e0c-b74b7f99f4f7 tempest-SnapshotDependencyTests-1975108325 None] Create snapshot completed successfully Sep 03 11:30:47 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:30:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Flow 'volume_create_manager' (e6a61d37-2804-40f4-8d02-58ab19598a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:30:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542b07ca-fc40-4551-b238-77ab283595fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:30:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (542b07ca-fc40-4551-b238-77ab283595fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:30:48Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b859fca-0921-4285-9102-78b8309c03dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e1de472262d4266b1f3cb2e46b76d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:30:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=46eac5df-ed4f-40c5-a722-d4e5bf1c2478,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:30:48Z,use_quota=True,user_id='469caeb25c6244fc9c2bfa8594b626bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:30:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d0aadf8-2c8d-4b47-9b06-e25b39e868a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:30:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d0aadf8-2c8d-4b47-9b06-e25b39e868a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:30:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9c7ffda-e207-496f-a098-ee25bf60ddcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:30:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9c7ffda-e207-496f-a098-ee25bf60ddcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6b859fca-0921-4285-9102-78b8309c03dd', 'volume_name': 'volume-6b859fca-0921-4285-9102-78b8309c03dd', 'volume_size': 1, 'snapshot_id': '46eac5df-ed4f-40c5-a722-d4e5bf1c2478'}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:30:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d94e4c0-5101-4f78-aa8f-ecaf926d8cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:30:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d94e4c0-5101-4f78-aa8f-ecaf926d8cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:30:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c5bd930-2f8f-44b8-9b0e-5509aecdc453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:30:48 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Volume 6b859fca-0921-4285-9102-78b8309c03dd: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6b859fca-0921-4285-9102-78b8309c03dd', 'volume_size': 1, 'snapshot_id': '46eac5df-ed4f-40c5-a722-d4e5bf1c2478'} Sep 03 11:30:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:30:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:30:48 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Acquiring lock "cinder-quobyte-46eac5df-ed4f-40c5-a722-d4e5bf1c2478-6b859fca-0921-4285-9102-78b8309c03dd" by "_create_volume_from_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:30:48 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Lock "cinder-quobyte-46eac5df-ed4f-40c5-a722-d4e5bf1c2478-6b859fca-0921-4285-9102-78b8309c03dd" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:30:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Creating volume 6b859fca-0921-4285-9102-78b8309c03dd from snapshot 46eac5df-ed4f-40c5-a722-d4e5bf1c2478 {{(pid=87038) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 11:30:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:30:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:30:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:30:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:30:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:30:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:30:48 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Acquiring lock "cinder-quobyte-6b859fca-0921-4285-9102-78b8309c03dd" by "_copy_volume_from_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:30:48 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Lock "cinder-quobyte-6b859fca-0921-4285-9102-78b8309c03dd" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:30:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] snapshot: 46eac5df-ed4f-40c5-a722-d4e5bf1c2478, volume: 6b859fca-0921-4285-9102-78b8309c03dd, {{(pid=87038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 11:30:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:30:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:30:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:30:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:30:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:30:48 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2dcb59-0fc4-429e-b9f3-2011fdde112b]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:30:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d.46eac5df-ed4f-40c5-a722-d4e5bf1c2478 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:30:48 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d.46eac5df-ed4f-40c5-a722-d4e5bf1c2478 Sep 03 11:30:48 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:30:48 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Sep 03 11:30:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d.46eac5df-ed4f-40c5-a722-d4e5bf1c2478" returned: 0 in 0.336s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:30:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e93df87f-5e0c-4543-bc57-67674c76b60d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:30:48 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[83cede45-7176-4c62-bcb9-0a58e1ab7244]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:30:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:30:48 devstack sudo[105288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d Sep 03 11:30:48 devstack sudo[105288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:30:48 devstack sudo[105288]: pam_unix(sudo:session): session closed for user root Sep 03 11:30:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d" returned: 0 in 0.332s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:30:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d {{(pid=87038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 11:30:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Creating direct copy from snapshot {{(pid=87038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 11:30:48 devstack cinder-volume[87038]: DEBUG cinder.utils [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Path /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6b859fca-0921-4285-9102-78b8309c03dd not found in is_blk_device check {{(pid=87038) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 11:30:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6b859fca-0921-4285-9102-78b8309c03dd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:30:48 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6b859fca-0921-4285-9102-78b8309c03dd Sep 03 11:30:48 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:30:52 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Sep 03 11:30:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6b859fca-0921-4285-9102-78b8309c03dd" returned: 0 in 3.923s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:30:52 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Image conversion details: src /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d, size 1024.00 MB, duration 3.92 sec, destination /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6b859fca-0921-4285-9102-78b8309c03dd {{(pid=87038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:30:52 devstack cinder-volume[87038]: INFO cinder.image.image_utils [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Converted 1024.00 MB image at 260.92 MB/s Sep 03 11:30:52 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6b859fca-0921-4285-9102-78b8309c03dd is being set with open permissions: ugo+rw Sep 03 11:30:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6b859fca-0921-4285-9102-78b8309c03dd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:30:52 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6b859fca-0921-4285-9102-78b8309c03dd Sep 03 11:30:52 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:30:52 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Sep 03 11:30:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6b859fca-0921-4285-9102-78b8309c03dd" returned: 0 in 0.244s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:30:52 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Lock "cinder-quobyte-6b859fca-0921-4285-9102-78b8309c03dd" released by "_copy_volume_from_snapshot" :: held 4.905s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:30:53 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Lock "cinder-quobyte-46eac5df-ed4f-40c5-a722-d4e5bf1c2478-6b859fca-0921-4285-9102-78b8309c03dd" released by "_create_volume_from_snapshot" :: held 4.968s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:30:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 4.981s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:30:53 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c5bd930-2f8f-44b8-9b0e-5509aecdc453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b859fca-0921-4285-9102-78b8309c03dd', 'volume_size': 1, 'snapshot_id': '46eac5df-ed4f-40c5-a722-d4e5bf1c2478'}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:30:53 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f61685-1c84-4889-bb23-51165ff0d195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:30:53 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Volume volume-6b859fca-0921-4285-9102-78b8309c03dd (6b859fca-0921-4285-9102-78b8309c03dd): created successfully Sep 03 11:30:53 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f61685-1c84-4889-bb23-51165ff0d195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:30:53 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Flow 'volume_create_manager' (e6a61d37-2804-40f4-8d02-58ab19598a1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:30:53 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-db9643c5-a2fa-443f-99bb-70c28390fb4b tempest-SnapshotDependencyTests-1975108325 None] Created volume successfully. Sep 03 11:30:53 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-c4cea2c4-ecfd-45e4-aff3-99ae2c3acac0 tempest-SnapshotDependencyTests-1975108325 None] Acquiring lock "cinder-46eac5df-ed4f-40c5-a722-d4e5bf1c2478-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:30:53 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-c4cea2c4-ecfd-45e4-aff3-99ae2c3acac0 tempest-SnapshotDependencyTests-1975108325 None] Lock "cinder-46eac5df-ed4f-40c5-a722-d4e5bf1c2478-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:30:53 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-c4cea2c4-ecfd-45e4-aff3-99ae2c3acac0 tempest-SnapshotDependencyTests-1975108325 None] Acquiring lock "cinder-quobyte-e93df87f-5e0c-4543-bc57-67674c76b60d" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:30:53 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-c4cea2c4-ecfd-45e4-aff3-99ae2c3acac0 tempest-SnapshotDependencyTests-1975108325 None] Lock "cinder-quobyte-e93df87f-5e0c-4543-bc57-67674c76b60d" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:30:53 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-c4cea2c4-ecfd-45e4-aff3-99ae2c3acac0 tempest-SnapshotDependencyTests-1975108325 None] Acquiring lock "cinder-quobyte-46eac5df-ed4f-40c5-a722-d4e5bf1c2478" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:30:53 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-c4cea2c4-ecfd-45e4-aff3-99ae2c3acac0 tempest-SnapshotDependencyTests-1975108325 None] Lock "cinder-quobyte-46eac5df-ed4f-40c5-a722-d4e5bf1c2478" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:30:53 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-c4cea2c4-ecfd-45e4-aff3-99ae2c3acac0 tempest-SnapshotDependencyTests-1975108325 None] Deleting offline snapshot 46eac5df-ed4f-40c5-a722-d4e5bf1c2478 of volume e93df87f-5e0c-4543-bc57-67674c76b60d {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:30:53 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-c4cea2c4-ecfd-45e4-aff3-99ae2c3acac0 tempest-SnapshotDependencyTests-1975108325 None] snapshot_file for this snap is: volume-e93df87f-5e0c-4543-bc57-67674c76b60d.46eac5df-ed4f-40c5-a722-d4e5bf1c2478 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:30:53 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda8d435-3913-45f2-bfed-57e06fdf7490]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:30:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c4cea2c4-ecfd-45e4-aff3-99ae2c3acac0 tempest-SnapshotDependencyTests-1975108325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d.46eac5df-ed4f-40c5-a722-d4e5bf1c2478 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:30:53 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d.46eac5df-ed4f-40c5-a722-d4e5bf1c2478 Sep 03 11:30:53 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:30:53 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Sep 03 11:30:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c4cea2c4-ecfd-45e4-aff3-99ae2c3acac0 tempest-SnapshotDependencyTests-1975108325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d.46eac5df-ed4f-40c5-a722-d4e5bf1c2478" returned: 0 in 0.349s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:30:53 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-c4cea2c4-ecfd-45e4-aff3-99ae2c3acac0 tempest-SnapshotDependencyTests-1975108325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e93df87f-5e0c-4543-bc57-67674c76b60d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:30:53 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d11366-3a87-46aa-8f73-6f12c66a0c0b]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:30:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c4cea2c4-ecfd-45e4-aff3-99ae2c3acac0 tempest-SnapshotDependencyTests-1975108325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:30:54 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d Sep 03 11:30:54 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:30:54 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Sep 03 11:30:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c4cea2c4-ecfd-45e4-aff3-99ae2c3acac0 tempest-SnapshotDependencyTests-1975108325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d" returned: 0 in 0.516s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:30:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c4cea2c4-ecfd-45e4-aff3-99ae2c3acac0 tempest-SnapshotDependencyTests-1975108325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d.46eac5df-ed4f-40c5-a722-d4e5bf1c2478 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:30:54 devstack sudo[105321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d.46eac5df-ed4f-40c5-a722-d4e5bf1c2478 Sep 03 11:30:54 devstack sudo[105321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:30:54 devstack sudo[105321]: pam_unix(sudo:session): session closed for user root Sep 03 11:30:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c4cea2c4-ecfd-45e4-aff3-99ae2c3acac0 tempest-SnapshotDependencyTests-1975108325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d.46eac5df-ed4f-40c5-a722-d4e5bf1c2478" returned: 0 in 0.322s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:30:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c4cea2c4-ecfd-45e4-aff3-99ae2c3acac0 tempest-SnapshotDependencyTests-1975108325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d.46eac5df-ed4f-40c5-a722-d4e5bf1c2478 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:30:54 devstack sudo[105326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d.46eac5df-ed4f-40c5-a722-d4e5bf1c2478 Sep 03 11:30:54 devstack sudo[105326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:30:55 devstack sudo[105326]: pam_unix(sudo:session): session closed for user root Sep 03 11:30:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c4cea2c4-ecfd-45e4-aff3-99ae2c3acac0 tempest-SnapshotDependencyTests-1975108325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d.46eac5df-ed4f-40c5-a722-d4e5bf1c2478" returned: 0 in 0.235s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:30:55 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-c4cea2c4-ecfd-45e4-aff3-99ae2c3acac0 tempest-SnapshotDependencyTests-1975108325 None] Lock "cinder-quobyte-46eac5df-ed4f-40c5-a722-d4e5bf1c2478" released by "_delete_snapshot" :: held 1.522s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:30:55 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-c4cea2c4-ecfd-45e4-aff3-99ae2c3acac0 tempest-SnapshotDependencyTests-1975108325 None] Lock "cinder-quobyte-e93df87f-5e0c-4543-bc57-67674c76b60d" released by "delete_snapshot" :: held 1.544s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:30:55 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-c4cea2c4-ecfd-45e4-aff3-99ae2c3acac0 tempest-SnapshotDependencyTests-1975108325 None] Created reservations ['30d2ed08-7a8e-4f1b-819a-adf8dd1d50c3', '17de1ea0-923a-48ce-b29b-b5cb217d44ce', '2281b8ab-f66d-484a-b0b8-efe0074f11f0', 'd7c3f360-5eea-4bb0-8de4-cc745450f08b'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:30:55 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-c4cea2c4-ecfd-45e4-aff3-99ae2c3acac0 tempest-SnapshotDependencyTests-1975108325 None] Delete snapshot completed successfully. Sep 03 11:30:55 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-c4cea2c4-ecfd-45e4-aff3-99ae2c3acac0 tempest-SnapshotDependencyTests-1975108325 None] Lock "cinder-46eac5df-ed4f-40c5-a722-d4e5bf1c2478-delete_snapshot" released by "delete_snapshot" :: held 1.684s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:30:55 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fa082b56-7fd9-4678-96f7-a84df29ac000 tempest-SnapshotDependencyTests-1975108325 None] Acquiring lock "cinder-e93df87f-5e0c-4543-bc57-67674c76b60d-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:30:55 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fa082b56-7fd9-4678-96f7-a84df29ac000 tempest-SnapshotDependencyTests-1975108325 None] Lock "cinder-e93df87f-5e0c-4543-bc57-67674c76b60d-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:30:55 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fa082b56-7fd9-4678-96f7-a84df29ac000 tempest-SnapshotDependencyTests-1975108325 None] Acquiring lock "cinder-quobyte-e93df87f-5e0c-4543-bc57-67674c76b60d" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:30:55 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fa082b56-7fd9-4678-96f7-a84df29ac000 tempest-SnapshotDependencyTests-1975108325 None] Lock "cinder-quobyte-e93df87f-5e0c-4543-bc57-67674c76b60d" acquired by "delete_volume" :: waited 0.014s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:30:55 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9dd0d1-2ab3-4b4c-a374-996b05438705]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:30:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fa082b56-7fd9-4678-96f7-a84df29ac000 tempest-SnapshotDependencyTests-1975108325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:30:55 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d Sep 03 11:30:55 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:30:56 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Sep 03 11:30:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fa082b56-7fd9-4678-96f7-a84df29ac000 tempest-SnapshotDependencyTests-1975108325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d" returned: 0 in 0.350s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:30:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fa082b56-7fd9-4678-96f7-a84df29ac000 tempest-SnapshotDependencyTests-1975108325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:30:56 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d Sep 03 11:30:56 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:30:56 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Sep 03 11:30:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fa082b56-7fd9-4678-96f7-a84df29ac000 tempest-SnapshotDependencyTests-1975108325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e93df87f-5e0c-4543-bc57-67674c76b60d" returned: 0 in 0.241s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:30:56 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fa082b56-7fd9-4678-96f7-a84df29ac000 tempest-SnapshotDependencyTests-1975108325 None] Lock "cinder-quobyte-e93df87f-5e0c-4543-bc57-67674c76b60d" released by "delete_volume" :: held 0.648s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:30:56 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-fa082b56-7fd9-4678-96f7-a84df29ac000 tempest-SnapshotDependencyTests-1975108325 None] Created reservations ['27f9c8df-e835-4b96-86ff-91220f084369', '4fc472da-150a-4c14-8312-f34ffe58574f', '3b14135d-6761-4097-bc41-246c1ace4b5b', 'e5625a42-5166-40c4-abec-f6f20cff23ee'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:30:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-fa082b56-7fd9-4678-96f7-a84df29ac000 tempest-SnapshotDependencyTests-1975108325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:30:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-fa082b56-7fd9-4678-96f7-a84df29ac000 tempest-SnapshotDependencyTests-1975108325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:30:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-fa082b56-7fd9-4678-96f7-a84df29ac000 tempest-SnapshotDependencyTests-1975108325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:30:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-fa082b56-7fd9-4678-96f7-a84df29ac000 tempest-SnapshotDependencyTests-1975108325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:30:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-fa082b56-7fd9-4678-96f7-a84df29ac000 tempest-SnapshotDependencyTests-1975108325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:30:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fa082b56-7fd9-4678-96f7-a84df29ac000 tempest-SnapshotDependencyTests-1975108325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:30:56 devstack sudo[105337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:30:56 devstack sudo[105337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:30:56 devstack sudo[105337]: pam_unix(sudo:session): session closed for user root Sep 03 11:30:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fa082b56-7fd9-4678-96f7-a84df29ac000 tempest-SnapshotDependencyTests-1975108325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.238s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:30:56 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-fa082b56-7fd9-4678-96f7-a84df29ac000 tempest-SnapshotDependencyTests-1975108325 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:30:56 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-fa082b56-7fd9-4678-96f7-a84df29ac000 tempest-SnapshotDependencyTests-1975108325 None] Deleted volume successfully. Sep 03 11:30:56 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fa082b56-7fd9-4678-96f7-a84df29ac000 tempest-SnapshotDependencyTests-1975108325 None] Lock "cinder-e93df87f-5e0c-4543-bc57-67674c76b60d-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:30:56 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2a087c65-1e6b-4166-967f-37bcf67c2c26 tempest-SnapshotDependencyTests-1975108325 None] Acquiring lock "cinder-6b859fca-0921-4285-9102-78b8309c03dd-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:30:56 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2a087c65-1e6b-4166-967f-37bcf67c2c26 tempest-SnapshotDependencyTests-1975108325 None] Lock "cinder-6b859fca-0921-4285-9102-78b8309c03dd-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:30:56 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2a087c65-1e6b-4166-967f-37bcf67c2c26 tempest-SnapshotDependencyTests-1975108325 None] Acquiring lock "cinder-quobyte-6b859fca-0921-4285-9102-78b8309c03dd" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:30:56 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2a087c65-1e6b-4166-967f-37bcf67c2c26 tempest-SnapshotDependencyTests-1975108325 None] Lock "cinder-quobyte-6b859fca-0921-4285-9102-78b8309c03dd" acquired by "delete_volume" :: waited 0.018s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:30:56 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[07646372-d7c5-4944-9976-867f1248515a]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:30:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2a087c65-1e6b-4166-967f-37bcf67c2c26 tempest-SnapshotDependencyTests-1975108325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6b859fca-0921-4285-9102-78b8309c03dd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:30:56 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6b859fca-0921-4285-9102-78b8309c03dd Sep 03 11:30:56 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:30:57 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Sep 03 11:30:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2a087c65-1e6b-4166-967f-37bcf67c2c26 tempest-SnapshotDependencyTests-1975108325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6b859fca-0921-4285-9102-78b8309c03dd" returned: 0 in 0.347s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:30:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2a087c65-1e6b-4166-967f-37bcf67c2c26 tempest-SnapshotDependencyTests-1975108325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6b859fca-0921-4285-9102-78b8309c03dd {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:30:57 devstack sudo[105345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6b859fca-0921-4285-9102-78b8309c03dd Sep 03 11:30:57 devstack sudo[105345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:30:57 devstack sudo[105345]: pam_unix(sudo:session): session closed for user root Sep 03 11:30:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2a087c65-1e6b-4166-967f-37bcf67c2c26 tempest-SnapshotDependencyTests-1975108325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6b859fca-0921-4285-9102-78b8309c03dd" returned: 0 in 0.245s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:30:57 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2a087c65-1e6b-4166-967f-37bcf67c2c26 tempest-SnapshotDependencyTests-1975108325 None] Lock "cinder-quobyte-6b859fca-0921-4285-9102-78b8309c03dd" released by "delete_volume" :: held 0.630s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:30:57 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-2a087c65-1e6b-4166-967f-37bcf67c2c26 tempest-SnapshotDependencyTests-1975108325 None] Created reservations ['a8e07212-f3a7-403d-af2e-0b58432eede3', 'c3614acc-d134-45cc-9c73-a146fc500fb9', '6f84f816-793e-40bf-b4a9-c3d69eb1bf26', '712d0832-954a-4e1d-9ac1-22d63409995f'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:30:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2a087c65-1e6b-4166-967f-37bcf67c2c26 tempest-SnapshotDependencyTests-1975108325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:30:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2a087c65-1e6b-4166-967f-37bcf67c2c26 tempest-SnapshotDependencyTests-1975108325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:30:57 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2a087c65-1e6b-4166-967f-37bcf67c2c26 tempest-SnapshotDependencyTests-1975108325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:30:57 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2a087c65-1e6b-4166-967f-37bcf67c2c26 tempest-SnapshotDependencyTests-1975108325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:30:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2a087c65-1e6b-4166-967f-37bcf67c2c26 tempest-SnapshotDependencyTests-1975108325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:30:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2a087c65-1e6b-4166-967f-37bcf67c2c26 tempest-SnapshotDependencyTests-1975108325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:30:57 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:30:57 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:30:57 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Sep 03 11:30:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2a087c65-1e6b-4166-967f-37bcf67c2c26 tempest-SnapshotDependencyTests-1975108325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.237s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:30:57 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-2a087c65-1e6b-4166-967f-37bcf67c2c26 tempest-SnapshotDependencyTests-1975108325 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:30:57 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-2a087c65-1e6b-4166-967f-37bcf67c2c26 tempest-SnapshotDependencyTests-1975108325 None] Deleted volume successfully. Sep 03 11:30:57 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2a087c65-1e6b-4166-967f-37bcf67c2c26 tempest-SnapshotDependencyTests-1975108325 None] Lock "cinder-6b859fca-0921-4285-9102-78b8309c03dd-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:07 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:UPDATE=30,cinder:SELECT=26,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:31:07 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=23,cinder:UPDATE=28,cinder:DELETE=2,cinder:INSERT=7 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:31:17 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf9136d8-dc23-402e-a543-fc07b538b606 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:31:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-cf9136d8-dc23-402e-a543-fc07b538b606 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Flow 'volume_create_manager' (927522ef-d603-47fd-942d-f3de0de6d2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-cf9136d8-dc23-402e-a543-fc07b538b606 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (758ec5ee-92f4-4d0c-875a-bd151f7bbd4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-cf9136d8-dc23-402e-a543-fc07b538b606 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (758ec5ee-92f4-4d0c-875a-bd151f7bbd4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-683290476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e59ae1f-b054-40fa-a465-902cd6d6d00f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='237cc853aaef49119e628e361a8e03ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:18Z,use_quota=True,user_id='71ea0f0cb0e04c4bb248198183d87b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-cf9136d8-dc23-402e-a543-fc07b538b606 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adb86f02-9aa9-49e8-b330-19cc404b19ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-cf9136d8-dc23-402e-a543-fc07b538b606 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adb86f02-9aa9-49e8-b330-19cc404b19ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-cf9136d8-dc23-402e-a543-fc07b538b606 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c838d452-a0cf-4927-88aa-676f797f9314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-cf9136d8-dc23-402e-a543-fc07b538b606 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c838d452-a0cf-4927-88aa-676f797f9314) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e59ae1f-b054-40fa-a465-902cd6d6d00f', 'volume_name': 'volume-1e59ae1f-b054-40fa-a465-902cd6d6d00f', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-cf9136d8-dc23-402e-a543-fc07b538b606 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d02466-c8ba-44f9-83b9-1a023eaba9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-cf9136d8-dc23-402e-a543-fc07b538b606 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d02466-c8ba-44f9-83b9-1a023eaba9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:17 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-cf9136d8-dc23-402e-a543-fc07b538b606 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc82e7d1-1079-411c-ac05-bc58ae9bedda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:17 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-cf9136d8-dc23-402e-a543-fc07b538b606 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Volume 1e59ae1f-b054-40fa-a465-902cd6d6d00f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e59ae1f-b054-40fa-a465-902cd6d6d00f', 'volume_size': 1} Sep 03 11:31:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-cf9136d8-dc23-402e-a543-fc07b538b606 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-cf9136d8-dc23-402e-a543-fc07b538b606 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-cf9136d8-dc23-402e-a543-fc07b538b606 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-683290476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e59ae1f-b054-40fa-a465-902cd6d6d00f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='237cc853aaef49119e628e361a8e03ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:18Z,use_quota=True,user_id='71ea0f0cb0e04c4bb248198183d87b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:31:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-cf9136d8-dc23-402e-a543-fc07b538b606 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Creating volume 1e59ae1f-b054-40fa-a465-902cd6d6d00f {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:31:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-cf9136d8-dc23-402e-a543-fc07b538b606 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-cf9136d8-dc23-402e-a543-fc07b538b606 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-cf9136d8-dc23-402e-a543-fc07b538b606 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-cf9136d8-dc23-402e-a543-fc07b538b606 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-cf9136d8-dc23-402e-a543-fc07b538b606 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-cf9136d8-dc23-402e-a543-fc07b538b606 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:31:17 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-cf9136d8-dc23-402e-a543-fc07b538b606 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:31:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cf9136d8-dc23-402e-a543-fc07b538b606 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1e59ae1f-b054-40fa-a465-902cd6d6d00f 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:17 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:31:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:17 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1e59ae1f-b054-40fa-a465-902cd6d6d00f 1073741824 Sep 03 11:31:17 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:18 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:31:18 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-43fa0636-5c1e-401c-a1f5-7eb7b0d974fc tempest-CinderUnicodeTest-1349351074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-43fa0636-5c1e-401c-a1f5-7eb7b0d974fc tempest-CinderUnicodeTest-1349351074 None] Flow 'volume_create_manager' (508145d0-dff5-4256-84f0-d4a7faaab2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-43fa0636-5c1e-401c-a1f5-7eb7b0d974fc tempest-CinderUnicodeTest-1349351074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8cc65c7-f54b-4a40-b13f-bfca635d860b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-43fa0636-5c1e-401c-a1f5-7eb7b0d974fc tempest-CinderUnicodeTest-1349351074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8cc65c7-f54b-4a40-b13f-bfca635d860b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53cdebdc-9cfd-4afd-be0b-d0ac488e13a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebef44558daf41d9a0cc9dea240d73df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:18Z,use_quota=True,user_id='7f4aed8cb90c4f7a935c730cfc0c9698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-43fa0636-5c1e-401c-a1f5-7eb7b0d974fc tempest-CinderUnicodeTest-1349351074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1675a149-4c7f-4d21-ba20-35652aaa00a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-43fa0636-5c1e-401c-a1f5-7eb7b0d974fc tempest-CinderUnicodeTest-1349351074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1675a149-4c7f-4d21-ba20-35652aaa00a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-43fa0636-5c1e-401c-a1f5-7eb7b0d974fc tempest-CinderUnicodeTest-1349351074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7180e780-f380-4a48-bf67-6cc039358059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-43fa0636-5c1e-401c-a1f5-7eb7b0d974fc tempest-CinderUnicodeTest-1349351074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7180e780-f380-4a48-bf67-6cc039358059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53cdebdc-9cfd-4afd-be0b-d0ac488e13a1', 'volume_name': 'volume-53cdebdc-9cfd-4afd-be0b-d0ac488e13a1', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-43fa0636-5c1e-401c-a1f5-7eb7b0d974fc tempest-CinderUnicodeTest-1349351074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efb3e024-6798-4805-92c1-50d34bd57fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-43fa0636-5c1e-401c-a1f5-7eb7b0d974fc tempest-CinderUnicodeTest-1349351074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efb3e024-6798-4805-92c1-50d34bd57fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-43fa0636-5c1e-401c-a1f5-7eb7b0d974fc tempest-CinderUnicodeTest-1349351074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (753638f9-4f23-4bbe-b287-383f63f6c4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:18 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-43fa0636-5c1e-401c-a1f5-7eb7b0d974fc tempest-CinderUnicodeTest-1349351074 None] Volume 53cdebdc-9cfd-4afd-be0b-d0ac488e13a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53cdebdc-9cfd-4afd-be0b-d0ac488e13a1', 'volume_size': 1} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-43fa0636-5c1e-401c-a1f5-7eb7b0d974fc tempest-CinderUnicodeTest-1349351074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:18 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.401s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread count: 28 {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread info: [<_MainThread(MainThread, started 139554943000704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:31:18 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cf9136d8-dc23-402e-a543-fc07b538b606 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1e59ae1f-b054-40fa-a465-902cd6d6d00f 1073741824" returned: 0 in 0.551s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cf9136d8-dc23-402e-a543-fc07b538b606 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1e59ae1f-b054-40fa-a465-902cd6d6d00f {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-22702d49-069c-47fe-b9a5-700a50b842ed tempest-CreateVolumesFromSnapshotTest-2066319807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:31:18 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1e59ae1f-b054-40fa-a465-902cd6d6d00f Sep 03 11:31:18 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-22702d49-069c-47fe-b9a5-700a50b842ed tempest-CreateVolumesFromSnapshotTest-2066319807 None] Flow 'volume_create_manager' (bcc4ee20-274c-45a4-b616-0585e7e7f04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-22702d49-069c-47fe-b9a5-700a50b842ed tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03a235c5-4d0a-43e0-866c-dda68044a5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-22702d49-069c-47fe-b9a5-700a50b842ed tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03a235c5-4d0a-43e0-866c-dda68044a5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1587464259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27fad037-87dd-42ea-b527-77f67f40b633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='277eb90f50004faa903c51161079a23c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:18Z,use_quota=True,user_id='0a4310dc1f0d4895b79d13aa5fe5c14f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-22702d49-069c-47fe-b9a5-700a50b842ed tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (992d82f6-db66-47cd-b38d-a07f153c953e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-22702d49-069c-47fe-b9a5-700a50b842ed tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (992d82f6-db66-47cd-b38d-a07f153c953e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-22702d49-069c-47fe-b9a5-700a50b842ed tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34f9f331-5c22-416a-a725-dc154afecd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-22702d49-069c-47fe-b9a5-700a50b842ed tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34f9f331-5c22-416a-a725-dc154afecd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27fad037-87dd-42ea-b527-77f67f40b633', 'volume_name': 'volume-27fad037-87dd-42ea-b527-77f67f40b633', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-22702d49-069c-47fe-b9a5-700a50b842ed tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54f17bcc-e653-4863-8ac7-50152e11c72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-22702d49-069c-47fe-b9a5-700a50b842ed tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54f17bcc-e653-4863-8ac7-50152e11c72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-22702d49-069c-47fe-b9a5-700a50b842ed tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c1193c8-6b64-4068-8ebe-aa1658021b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:18 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-22702d49-069c-47fe-b9a5-700a50b842ed tempest-CreateVolumesFromSnapshotTest-2066319807 None] Volume 27fad037-87dd-42ea-b527-77f67f40b633: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27fad037-87dd-42ea-b527-77f67f40b633', 'volume_size': 1} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-22702d49-069c-47fe-b9a5-700a50b842ed tempest-CreateVolumesFromSnapshotTest-2066319807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:18 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cf9136d8-dc23-402e-a543-fc07b538b606 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1e59ae1f-b054-40fa-a465-902cd6d6d00f" returned: 0 in 0.264s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-cf9136d8-dc23-402e-a543-fc07b538b606 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-cf9136d8-dc23-402e-a543-fc07b538b606 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-43fa0636-5c1e-401c-a1f5-7eb7b0d974fc tempest-CinderUnicodeTest-1349351074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.695s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-43fa0636-5c1e-401c-a1f5-7eb7b0d974fc tempest-CinderUnicodeTest-1349351074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:17Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53cdebdc-9cfd-4afd-be0b-d0ac488e13a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebef44558daf41d9a0cc9dea240d73df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:18Z,use_quota=True,user_id='7f4aed8cb90c4f7a935c730cfc0c9698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-43fa0636-5c1e-401c-a1f5-7eb7b0d974fc tempest-CinderUnicodeTest-1349351074 None] Creating volume 53cdebdc-9cfd-4afd-be0b-d0ac488e13a1 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-43fa0636-5c1e-401c-a1f5-7eb7b0d974fc tempest-CinderUnicodeTest-1349351074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-43fa0636-5c1e-401c-a1f5-7eb7b0d974fc tempest-CinderUnicodeTest-1349351074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-43fa0636-5c1e-401c-a1f5-7eb7b0d974fc tempest-CinderUnicodeTest-1349351074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-43fa0636-5c1e-401c-a1f5-7eb7b0d974fc tempest-CinderUnicodeTest-1349351074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-43fa0636-5c1e-401c-a1f5-7eb7b0d974fc tempest-CinderUnicodeTest-1349351074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-43fa0636-5c1e-401c-a1f5-7eb7b0d974fc tempest-CinderUnicodeTest-1349351074 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:31:18 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-43fa0636-5c1e-401c-a1f5-7eb7b0d974fc tempest-CinderUnicodeTest-1349351074 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-43fa0636-5c1e-401c-a1f5-7eb7b0d974fc tempest-CinderUnicodeTest-1349351074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-53cdebdc-9cfd-4afd-be0b-d0ac488e13a1 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-cf9136d8-dc23-402e-a543-fc07b538b606 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc82e7d1-1079-411c-ac05-bc58ae9bedda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e59ae1f-b054-40fa-a465-902cd6d6d00f', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-cf9136d8-dc23-402e-a543-fc07b538b606 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c555e068-b45f-4541-99f6-eba7bf1dbb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:18 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-53cdebdc-9cfd-4afd-be0b-d0ac488e13a1 1073741824 Sep 03 11:31:18 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:18 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-cf9136d8-dc23-402e-a543-fc07b538b606 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Volume volume-1e59ae1f-b054-40fa-a465-902cd6d6d00f (1e59ae1f-b054-40fa-a465-902cd6d6d00f): created successfully Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-cf9136d8-dc23-402e-a543-fc07b538b606 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c555e068-b45f-4541-99f6-eba7bf1dbb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-cf9136d8-dc23-402e-a543-fc07b538b606 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Flow 'volume_create_manager' (927522ef-d603-47fd-942d-f3de0de6d2cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:18 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-cf9136d8-dc23-402e-a543-fc07b538b606 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Created volume successfully. Sep 03 11:31:19 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-43fa0636-5c1e-401c-a1f5-7eb7b0d974fc tempest-CinderUnicodeTest-1349351074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-53cdebdc-9cfd-4afd-be0b-d0ac488e13a1 1073741824" returned: 0 in 0.446s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-43fa0636-5c1e-401c-a1f5-7eb7b0d974fc tempest-CinderUnicodeTest-1349351074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-53cdebdc-9cfd-4afd-be0b-d0ac488e13a1 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:19 devstack sudo[105413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-53cdebdc-9cfd-4afd-be0b-d0ac488e13a1 Sep 03 11:31:19 devstack sudo[105413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:19 devstack sudo[105413]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-43fa0636-5c1e-401c-a1f5-7eb7b0d974fc tempest-CinderUnicodeTest-1349351074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-53cdebdc-9cfd-4afd-be0b-d0ac488e13a1" returned: 0 in 0.250s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:19 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-43fa0636-5c1e-401c-a1f5-7eb7b0d974fc tempest-CinderUnicodeTest-1349351074 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:31:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-43fa0636-5c1e-401c-a1f5-7eb7b0d974fc tempest-CinderUnicodeTest-1349351074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-22702d49-069c-47fe-b9a5-700a50b842ed tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.908s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:19 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-22702d49-069c-47fe-b9a5-700a50b842ed tempest-CreateVolumesFromSnapshotTest-2066319807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1587464259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27fad037-87dd-42ea-b527-77f67f40b633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='277eb90f50004faa903c51161079a23c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:18Z,use_quota=True,user_id='0a4310dc1f0d4895b79d13aa5fe5c14f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:31:19 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-22702d49-069c-47fe-b9a5-700a50b842ed tempest-CreateVolumesFromSnapshotTest-2066319807 None] Creating volume 27fad037-87dd-42ea-b527-77f67f40b633 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:31:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-22702d49-069c-47fe-b9a5-700a50b842ed tempest-CreateVolumesFromSnapshotTest-2066319807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-22702d49-069c-47fe-b9a5-700a50b842ed tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:19 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-22702d49-069c-47fe-b9a5-700a50b842ed tempest-CreateVolumesFromSnapshotTest-2066319807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:19 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-22702d49-069c-47fe-b9a5-700a50b842ed tempest-CreateVolumesFromSnapshotTest-2066319807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-22702d49-069c-47fe-b9a5-700a50b842ed tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:19 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-22702d49-069c-47fe-b9a5-700a50b842ed tempest-CreateVolumesFromSnapshotTest-2066319807 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:31:19 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-22702d49-069c-47fe-b9a5-700a50b842ed tempest-CreateVolumesFromSnapshotTest-2066319807 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:31:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-22702d49-069c-47fe-b9a5-700a50b842ed tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:19 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633 1073741824 Sep 03 11:31:19 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:19 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-43fa0636-5c1e-401c-a1f5-7eb7b0d974fc tempest-CinderUnicodeTest-1349351074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (753638f9-4f23-4bbe-b287-383f63f6c4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53cdebdc-9cfd-4afd-be0b-d0ac488e13a1', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:19 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-43fa0636-5c1e-401c-a1f5-7eb7b0d974fc tempest-CinderUnicodeTest-1349351074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3559896-bf0d-4666-b3f8-e1b4d53db7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:19 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-43fa0636-5c1e-401c-a1f5-7eb7b0d974fc tempest-CinderUnicodeTest-1349351074 None] Volume volume-53cdebdc-9cfd-4afd-be0b-d0ac488e13a1 (53cdebdc-9cfd-4afd-be0b-d0ac488e13a1): created successfully Sep 03 11:31:19 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-43fa0636-5c1e-401c-a1f5-7eb7b0d974fc tempest-CinderUnicodeTest-1349351074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3559896-bf0d-4666-b3f8-e1b4d53db7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:19 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-43fa0636-5c1e-401c-a1f5-7eb7b0d974fc tempest-CinderUnicodeTest-1349351074 None] Flow 'volume_create_manager' (508145d0-dff5-4256-84f0-d4a7faaab2ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:19 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-43fa0636-5c1e-401c-a1f5-7eb7b0d974fc tempest-CinderUnicodeTest-1349351074 None] Created volume successfully. Sep 03 11:31:20 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-22702d49-069c-47fe-b9a5-700a50b842ed tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633 1073741824" returned: 0 in 0.581s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-22702d49-069c-47fe-b9a5-700a50b842ed tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:20 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633 Sep 03 11:31:20 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:20 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-8733e813-e206-4d48-bb02-52178943d191 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:31:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8733e813-e206-4d48-bb02-52178943d191 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Flow 'volume_create_manager' (de72b91a-cd5c-44ef-a670-46ef8766e6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8733e813-e206-4d48-bb02-52178943d191 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fd0d2ce-dfbd-4de6-8f0f-4c783836eb3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8733e813-e206-4d48-bb02-52178943d191 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fd0d2ce-dfbd-4de6-8f0f-4c783836eb3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-389173207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dc7a26f-15db-42dc-95fc-16bc0e6ea6f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='237cc853aaef49119e628e361a8e03ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:20Z,use_quota=True,user_id='71ea0f0cb0e04c4bb248198183d87b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8733e813-e206-4d48-bb02-52178943d191 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53db1339-c658-4ba4-90db-e78e65f2a26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8733e813-e206-4d48-bb02-52178943d191 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53db1339-c658-4ba4-90db-e78e65f2a26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8733e813-e206-4d48-bb02-52178943d191 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa4a1b2-309f-4f27-a920-6ae9a9e5502a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8733e813-e206-4d48-bb02-52178943d191 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2aa4a1b2-309f-4f27-a920-6ae9a9e5502a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dc7a26f-15db-42dc-95fc-16bc0e6ea6f2', 'volume_name': 'volume-2dc7a26f-15db-42dc-95fc-16bc0e6ea6f2', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8733e813-e206-4d48-bb02-52178943d191 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3498ae7f-cbc6-4d5c-9f5d-a6e6e4fb1557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8733e813-e206-4d48-bb02-52178943d191 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3498ae7f-cbc6-4d5c-9f5d-a6e6e4fb1557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8733e813-e206-4d48-bb02-52178943d191 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9479dee5-c73e-4cec-bf73-18c40ed13826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:20 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-8733e813-e206-4d48-bb02-52178943d191 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Volume 2dc7a26f-15db-42dc-95fc-16bc0e6ea6f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dc7a26f-15db-42dc-95fc-16bc0e6ea6f2', 'volume_size': 1} Sep 03 11:31:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-8733e813-e206-4d48-bb02-52178943d191 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:20 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-22702d49-069c-47fe-b9a5-700a50b842ed tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633" returned: 0 in 0.484s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-22702d49-069c-47fe-b9a5-700a50b842ed tempest-CreateVolumesFromSnapshotTest-2066319807 None] <== create_volume: return (1121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:31:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-22702d49-069c-47fe-b9a5-700a50b842ed tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-8733e813-e206-4d48-bb02-52178943d191 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.043s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-8733e813-e206-4d48-bb02-52178943d191 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-389173207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dc7a26f-15db-42dc-95fc-16bc0e6ea6f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='237cc853aaef49119e628e361a8e03ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:20Z,use_quota=True,user_id='71ea0f0cb0e04c4bb248198183d87b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:31:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-8733e813-e206-4d48-bb02-52178943d191 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Creating volume 2dc7a26f-15db-42dc-95fc-16bc0e6ea6f2 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:31:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-8733e813-e206-4d48-bb02-52178943d191 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-8733e813-e206-4d48-bb02-52178943d191 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-8733e813-e206-4d48-bb02-52178943d191 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-8733e813-e206-4d48-bb02-52178943d191 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-8733e813-e206-4d48-bb02-52178943d191 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-8733e813-e206-4d48-bb02-52178943d191 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:31:20 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-8733e813-e206-4d48-bb02-52178943d191 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:31:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8733e813-e206-4d48-bb02-52178943d191 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2dc7a26f-15db-42dc-95fc-16bc0e6ea6f2 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:20 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2dc7a26f-15db-42dc-95fc-16bc0e6ea6f2 1073741824 Sep 03 11:31:20 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-22702d49-069c-47fe-b9a5-700a50b842ed tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c1193c8-6b64-4068-8ebe-aa1658021b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27fad037-87dd-42ea-b527-77f67f40b633', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-22702d49-069c-47fe-b9a5-700a50b842ed tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (815620b3-3445-4b09-9bd9-9076b8a99d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:20 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-22702d49-069c-47fe-b9a5-700a50b842ed tempest-CreateVolumesFromSnapshotTest-2066319807 None] Volume volume-27fad037-87dd-42ea-b527-77f67f40b633 (27fad037-87dd-42ea-b527-77f67f40b633): created successfully Sep 03 11:31:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-22702d49-069c-47fe-b9a5-700a50b842ed tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (815620b3-3445-4b09-9bd9-9076b8a99d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-22702d49-069c-47fe-b9a5-700a50b842ed tempest-CreateVolumesFromSnapshotTest-2066319807 None] Flow 'volume_create_manager' (bcc4ee20-274c-45a4-b616-0585e7e7f04e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:20 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-22702d49-069c-47fe-b9a5-700a50b842ed tempest-CreateVolumesFromSnapshotTest-2066319807 None] Created volume successfully. Sep 03 11:31:21 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8733e813-e206-4d48-bb02-52178943d191 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2dc7a26f-15db-42dc-95fc-16bc0e6ea6f2 1073741824" returned: 0 in 0.561s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8733e813-e206-4d48-bb02-52178943d191 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2dc7a26f-15db-42dc-95fc-16bc0e6ea6f2 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bad7004-fa7e-4e7b-bbfa-36c345bbf760 tempest-CinderUnicodeTest-1349351074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1bad7004-fa7e-4e7b-bbfa-36c345bbf760 tempest-CinderUnicodeTest-1349351074 None] Flow 'volume_create_manager' (cab7ad58-6105-4197-9b8a-fd921ef3936d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:21 devstack sudo[105469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2dc7a26f-15db-42dc-95fc-16bc0e6ea6f2 Sep 03 11:31:21 devstack sudo[105469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1bad7004-fa7e-4e7b-bbfa-36c345bbf760 tempest-CinderUnicodeTest-1349351074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fe59d93-38e2-4c1f-a4b1-82afe57ffb49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1bad7004-fa7e-4e7b-bbfa-36c345bbf760 tempest-CinderUnicodeTest-1349351074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fe59d93-38e2-4c1f-a4b1-82afe57ffb49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-239400907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d5f61b9-8b1f-4210-9d58-6989315d255e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebef44558daf41d9a0cc9dea240d73df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:21Z,use_quota=True,user_id='7f4aed8cb90c4f7a935c730cfc0c9698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1bad7004-fa7e-4e7b-bbfa-36c345bbf760 tempest-CinderUnicodeTest-1349351074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (043adca9-f08b-4911-9d36-73aab8e3d256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1bad7004-fa7e-4e7b-bbfa-36c345bbf760 tempest-CinderUnicodeTest-1349351074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (043adca9-f08b-4911-9d36-73aab8e3d256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1bad7004-fa7e-4e7b-bbfa-36c345bbf760 tempest-CinderUnicodeTest-1349351074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fca83c1-ec40-4f5f-b1e4-82955acb690c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1bad7004-fa7e-4e7b-bbfa-36c345bbf760 tempest-CinderUnicodeTest-1349351074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1fca83c1-ec40-4f5f-b1e4-82955acb690c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d5f61b9-8b1f-4210-9d58-6989315d255e', 'volume_name': 'volume-0d5f61b9-8b1f-4210-9d58-6989315d255e', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1bad7004-fa7e-4e7b-bbfa-36c345bbf760 tempest-CinderUnicodeTest-1349351074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b22022e-ba87-438a-b97e-8bea03eca879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1bad7004-fa7e-4e7b-bbfa-36c345bbf760 tempest-CinderUnicodeTest-1349351074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b22022e-ba87-438a-b97e-8bea03eca879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1bad7004-fa7e-4e7b-bbfa-36c345bbf760 tempest-CinderUnicodeTest-1349351074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97551fd2-1a01-4a26-b2a3-c991e7dabce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:21 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-1bad7004-fa7e-4e7b-bbfa-36c345bbf760 tempest-CinderUnicodeTest-1349351074 None] Volume 0d5f61b9-8b1f-4210-9d58-6989315d255e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d5f61b9-8b1f-4210-9d58-6989315d255e', 'volume_size': 1} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1bad7004-fa7e-4e7b-bbfa-36c345bbf760 tempest-CinderUnicodeTest-1349351074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1d350f4-5089-44fb-aaa6-47fa8af2b906 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f1d350f4-5089-44fb-aaa6-47fa8af2b906 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Flow 'volume_create_manager' (19edc4cf-385a-4140-ad9a-444299c9d2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f1d350f4-5089-44fb-aaa6-47fa8af2b906 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78036fa0-3196-4ad6-b202-a86d3639e54a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:21 devstack sudo[105469]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-12cbb0b3-d81a-465a-ba1c-feba78c6dd70 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12cbb0b3-d81a-465a-ba1c-feba78c6dd70 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Flow 'volume_create_manager' (e0b2cd7c-18b5-4bdd-9d6e-13f3b4a0f988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12cbb0b3-d81a-465a-ba1c-feba78c6dd70 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39c9e319-e057-4cae-862a-ca1ae742c636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8733e813-e206-4d48-bb02-52178943d191 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2dc7a26f-15db-42dc-95fc-16bc0e6ea6f2" returned: 0 in 0.375s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f1d350f4-5089-44fb-aaa6-47fa8af2b906 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78036fa0-3196-4ad6-b202-a86d3639e54a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1450000375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ed0050f-301e-4d21-94ce-5ca858e47ba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='237cc853aaef49119e628e361a8e03ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:21Z,use_quota=True,user_id='71ea0f0cb0e04c4bb248198183d87b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f1d350f4-5089-44fb-aaa6-47fa8af2b906 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71b0586a-c8ca-4baa-a1e5-7a3c5eba6747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f1d350f4-5089-44fb-aaa6-47fa8af2b906 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71b0586a-c8ca-4baa-a1e5-7a3c5eba6747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f1d350f4-5089-44fb-aaa6-47fa8af2b906 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (219e8bfc-02a0-45ef-9ec5-46fc8cfe8109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f1d350f4-5089-44fb-aaa6-47fa8af2b906 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (219e8bfc-02a0-45ef-9ec5-46fc8cfe8109) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ed0050f-301e-4d21-94ce-5ca858e47ba0', 'volume_name': 'volume-6ed0050f-301e-4d21-94ce-5ca858e47ba0', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f1d350f4-5089-44fb-aaa6-47fa8af2b906 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdec0b03-ece6-4c4d-986c-3b916cffae26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f1d350f4-5089-44fb-aaa6-47fa8af2b906 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdec0b03-ece6-4c4d-986c-3b916cffae26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f1d350f4-5089-44fb-aaa6-47fa8af2b906 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f219a7-38ee-41e8-a021-3271a56f387e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:21 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-f1d350f4-5089-44fb-aaa6-47fa8af2b906 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Volume 6ed0050f-301e-4d21-94ce-5ca858e47ba0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ed0050f-301e-4d21-94ce-5ca858e47ba0', 'volume_size': 1} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f1d350f4-5089-44fb-aaa6-47fa8af2b906 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-8733e813-e206-4d48-bb02-52178943d191 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-8733e813-e206-4d48-bb02-52178943d191 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1bad7004-fa7e-4e7b-bbfa-36c345bbf760 tempest-CinderUnicodeTest-1349351074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.249s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1bad7004-fa7e-4e7b-bbfa-36c345bbf760 tempest-CinderUnicodeTest-1349351074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-239400907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d5f61b9-8b1f-4210-9d58-6989315d255e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebef44558daf41d9a0cc9dea240d73df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:21Z,use_quota=True,user_id='7f4aed8cb90c4f7a935c730cfc0c9698',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-1bad7004-fa7e-4e7b-bbfa-36c345bbf760 tempest-CinderUnicodeTest-1349351074 None] Creating volume 0d5f61b9-8b1f-4210-9d58-6989315d255e {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1bad7004-fa7e-4e7b-bbfa-36c345bbf760 tempest-CinderUnicodeTest-1349351074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1bad7004-fa7e-4e7b-bbfa-36c345bbf760 tempest-CinderUnicodeTest-1349351074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1bad7004-fa7e-4e7b-bbfa-36c345bbf760 tempest-CinderUnicodeTest-1349351074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1bad7004-fa7e-4e7b-bbfa-36c345bbf760 tempest-CinderUnicodeTest-1349351074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1bad7004-fa7e-4e7b-bbfa-36c345bbf760 tempest-CinderUnicodeTest-1349351074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1bad7004-fa7e-4e7b-bbfa-36c345bbf760 tempest-CinderUnicodeTest-1349351074 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:31:21 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-1bad7004-fa7e-4e7b-bbfa-36c345bbf760 tempest-CinderUnicodeTest-1349351074 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1bad7004-fa7e-4e7b-bbfa-36c345bbf760 tempest-CinderUnicodeTest-1349351074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:21 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e 1073741824 Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12cbb0b3-d81a-465a-ba1c-feba78c6dd70 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39c9e319-e057-4cae-862a-ca1ae742c636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-137383728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b6a0d30-3bfb-42ff-995f-73cb505889c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='237cc853aaef49119e628e361a8e03ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:21Z,use_quota=True,user_id='71ea0f0cb0e04c4bb248198183d87b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:21 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12cbb0b3-d81a-465a-ba1c-feba78c6dd70 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8bc57b7-d813-41ca-b08f-c89cbfb80ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12cbb0b3-d81a-465a-ba1c-feba78c6dd70 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8bc57b7-d813-41ca-b08f-c89cbfb80ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12cbb0b3-d81a-465a-ba1c-feba78c6dd70 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d36276e1-91fe-4aff-b7e8-4893f127f3cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12cbb0b3-d81a-465a-ba1c-feba78c6dd70 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d36276e1-91fe-4aff-b7e8-4893f127f3cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b6a0d30-3bfb-42ff-995f-73cb505889c1', 'volume_name': 'volume-5b6a0d30-3bfb-42ff-995f-73cb505889c1', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12cbb0b3-d81a-465a-ba1c-feba78c6dd70 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6124acc0-817d-4d9d-abd1-1731d35fc20c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12cbb0b3-d81a-465a-ba1c-feba78c6dd70 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6124acc0-817d-4d9d-abd1-1731d35fc20c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12cbb0b3-d81a-465a-ba1c-feba78c6dd70 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db1dc8e3-5d05-430c-b00a-7356ee7080e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:21 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-12cbb0b3-d81a-465a-ba1c-feba78c6dd70 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Volume 5b6a0d30-3bfb-42ff-995f-73cb505889c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b6a0d30-3bfb-42ff-995f-73cb505889c1', 'volume_size': 1} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-12cbb0b3-d81a-465a-ba1c-feba78c6dd70 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8733e813-e206-4d48-bb02-52178943d191 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9479dee5-c73e-4cec-bf73-18c40ed13826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dc7a26f-15db-42dc-95fc-16bc0e6ea6f2', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8733e813-e206-4d48-bb02-52178943d191 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd5c547-198d-4d62-bcac-2bcfd332c46f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:21 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-8733e813-e206-4d48-bb02-52178943d191 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Volume volume-2dc7a26f-15db-42dc-95fc-16bc0e6ea6f2 (2dc7a26f-15db-42dc-95fc-16bc0e6ea6f2): created successfully Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8733e813-e206-4d48-bb02-52178943d191 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bd5c547-198d-4d62-bcac-2bcfd332c46f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-8733e813-e206-4d48-bb02-52178943d191 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Flow 'volume_create_manager' (de72b91a-cd5c-44ef-a670-46ef8766e6d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4ce2409-ca60-4909-b2eb-852f6b9057a0 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d4ce2409-ca60-4909-b2eb-852f6b9057a0 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Flow 'volume_create_manager' (ab6d9fdb-23cb-4653-9b1b-2513a7e32027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d4ce2409-ca60-4909-b2eb-852f6b9057a0 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c47566f-5d37-4ebb-a207-974ae076518c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:21 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-8733e813-e206-4d48-bb02-52178943d191 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Created volume successfully. Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d4ce2409-ca60-4909-b2eb-852f6b9057a0 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c47566f-5d37-4ebb-a207-974ae076518c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1106381417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f22e4ea5-2815-4466-b2c7-447cc54e9821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='237cc853aaef49119e628e361a8e03ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:22Z,use_quota=True,user_id='71ea0f0cb0e04c4bb248198183d87b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d4ce2409-ca60-4909-b2eb-852f6b9057a0 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e40a826-76aa-4bca-8402-4ff168938d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d4ce2409-ca60-4909-b2eb-852f6b9057a0 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e40a826-76aa-4bca-8402-4ff168938d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d4ce2409-ca60-4909-b2eb-852f6b9057a0 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bade69d3-d441-4db1-bf1f-a2acb5205246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d4ce2409-ca60-4909-b2eb-852f6b9057a0 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bade69d3-d441-4db1-bf1f-a2acb5205246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f22e4ea5-2815-4466-b2c7-447cc54e9821', 'volume_name': 'volume-f22e4ea5-2815-4466-b2c7-447cc54e9821', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d4ce2409-ca60-4909-b2eb-852f6b9057a0 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c8846a3-1bd0-450a-8c50-e1171ba5e87e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d4ce2409-ca60-4909-b2eb-852f6b9057a0 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c8846a3-1bd0-450a-8c50-e1171ba5e87e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d4ce2409-ca60-4909-b2eb-852f6b9057a0 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23fd11e8-832c-4a43-b96e-2d5ee5dc3184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:22 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-d4ce2409-ca60-4909-b2eb-852f6b9057a0 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Volume f22e4ea5-2815-4466-b2c7-447cc54e9821: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f22e4ea5-2815-4466-b2c7-447cc54e9821', 'volume_size': 1} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d4ce2409-ca60-4909-b2eb-852f6b9057a0 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:22 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1bad7004-fa7e-4e7b-bbfa-36c345bbf760 tempest-CinderUnicodeTest-1349351074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e 1073741824" returned: 0 in 0.566s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1bad7004-fa7e-4e7b-bbfa-36c345bbf760 tempest-CinderUnicodeTest-1349351074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:22 devstack sudo[105478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e Sep 03 11:31:22 devstack sudo[105478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-16fe1a73-5f16-437f-9f9b-ea2c99273549 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-16fe1a73-5f16-437f-9f9b-ea2c99273549 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Flow 'volume_create_manager' (d5389760-7395-48ef-b968-8af6102ce943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-16fe1a73-5f16-437f-9f9b-ea2c99273549 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c678dade-799f-42d1-85e7-f4587b5ed79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:22 devstack sudo[105478]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1bad7004-fa7e-4e7b-bbfa-36c345bbf760 tempest-CinderUnicodeTest-1349351074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e" returned: 0 in 0.283s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1bad7004-fa7e-4e7b-bbfa-36c345bbf760 tempest-CinderUnicodeTest-1349351074 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1bad7004-fa7e-4e7b-bbfa-36c345bbf760 tempest-CinderUnicodeTest-1349351074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-16fe1a73-5f16-437f-9f9b-ea2c99273549 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c678dade-799f-42d1-85e7-f4587b5ed79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2127812489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65c5429-cd4c-4dda-bab3-e46cf5cdfaba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='237cc853aaef49119e628e361a8e03ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:22Z,use_quota=True,user_id='71ea0f0cb0e04c4bb248198183d87b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-16fe1a73-5f16-437f-9f9b-ea2c99273549 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d2ca3b6-e8ee-48ea-8074-85dde3c074b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-16fe1a73-5f16-437f-9f9b-ea2c99273549 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d2ca3b6-e8ee-48ea-8074-85dde3c074b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-16fe1a73-5f16-437f-9f9b-ea2c99273549 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db98ab22-35e6-46b3-8935-73f12da0c2da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-16fe1a73-5f16-437f-9f9b-ea2c99273549 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db98ab22-35e6-46b3-8935-73f12da0c2da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b65c5429-cd4c-4dda-bab3-e46cf5cdfaba', 'volume_name': 'volume-b65c5429-cd4c-4dda-bab3-e46cf5cdfaba', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-16fe1a73-5f16-437f-9f9b-ea2c99273549 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3416871f-4eb5-42b3-ae3e-e565158f9e33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-16fe1a73-5f16-437f-9f9b-ea2c99273549 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3416871f-4eb5-42b3-ae3e-e565158f9e33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-16fe1a73-5f16-437f-9f9b-ea2c99273549 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b6fe267-1207-4eee-a7ef-6bb95a29403e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:22 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-16fe1a73-5f16-437f-9f9b-ea2c99273549 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Volume b65c5429-cd4c-4dda-bab3-e46cf5cdfaba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b65c5429-cd4c-4dda-bab3-e46cf5cdfaba', 'volume_size': 1} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-16fe1a73-5f16-437f-9f9b-ea2c99273549 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-16fe1a73-5f16-437f-9f9b-ea2c99273549 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-16fe1a73-5f16-437f-9f9b-ea2c99273549 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2127812489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b65c5429-cd4c-4dda-bab3-e46cf5cdfaba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='237cc853aaef49119e628e361a8e03ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:22Z,use_quota=True,user_id='71ea0f0cb0e04c4bb248198183d87b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-16fe1a73-5f16-437f-9f9b-ea2c99273549 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Creating volume b65c5429-cd4c-4dda-bab3-e46cf5cdfaba {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-16fe1a73-5f16-437f-9f9b-ea2c99273549 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-16fe1a73-5f16-437f-9f9b-ea2c99273549 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-16fe1a73-5f16-437f-9f9b-ea2c99273549 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-16fe1a73-5f16-437f-9f9b-ea2c99273549 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-16fe1a73-5f16-437f-9f9b-ea2c99273549 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-16fe1a73-5f16-437f-9f9b-ea2c99273549 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:31:22 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-16fe1a73-5f16-437f-9f9b-ea2c99273549 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-16fe1a73-5f16-437f-9f9b-ea2c99273549 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b65c5429-cd4c-4dda-bab3-e46cf5cdfaba 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:22 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b65c5429-cd4c-4dda-bab3-e46cf5cdfaba 1073741824 Sep 03 11:31:22 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7d31c382-2cec-474c-9ac5-e0d2539f5ee4 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Flow 'volume_create_manager' (4a24ed9c-a8de-45da-b95c-70ad3838a4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3dff52-e992-4d92-a8c3-c8991ba66593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1bad7004-fa7e-4e7b-bbfa-36c345bbf760 tempest-CinderUnicodeTest-1349351074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97551fd2-1a01-4a26-b2a3-c991e7dabce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d5f61b9-8b1f-4210-9d58-6989315d255e', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1bad7004-fa7e-4e7b-bbfa-36c345bbf760 tempest-CinderUnicodeTest-1349351074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d0a40b-df23-4539-a2bc-a14ff75d23a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3dff52-e992-4d92-a8c3-c8991ba66593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcb5f500-7cd5-4fbd-af23-7ffa469e3176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd46f0cbce1345459333210a1d785473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:23Z,use_quota=True,user_id='b387ed421509412c97cb0ab458de5d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5762589-bf45-4acf-a698-9d326d65db23),volume_type_id=e5762589-bf45-4acf-a698-9d326d65db23)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be9cd14b-f990-43b3-b6de-e711a33d49d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be9cd14b-f990-43b3-b6de-e711a33d49d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a3bfc7-9737-415f-b818-1ebbdfa0a727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG cinder.image.glance [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Creating Keystone auth plugin from conf {{(pid=87038) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 11:31:22 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-1bad7004-fa7e-4e7b-bbfa-36c345bbf760 tempest-CinderUnicodeTest-1349351074 None] Volume volume-0d5f61b9-8b1f-4210-9d58-6989315d255e (0d5f61b9-8b1f-4210-9d58-6989315d255e): created successfully Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1bad7004-fa7e-4e7b-bbfa-36c345bbf760 tempest-CinderUnicodeTest-1349351074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0d0a40b-df23-4539-a2bc-a14ff75d23a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1bad7004-fa7e-4e7b-bbfa-36c345bbf760 tempest-CinderUnicodeTest-1349351074 None] Flow 'volume_create_manager' (cab7ad58-6105-4197-9b8a-fd921ef3936d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:22 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-1bad7004-fa7e-4e7b-bbfa-36c345bbf760 tempest-CinderUnicodeTest-1349351074 None] Created volume successfully. Sep 03 11:31:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a3bfc7-9737-415f-b818-1ebbdfa0a727) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dcb5f500-7cd5-4fbd-af23-7ffa469e3176', 'volume_name': 'volume-dcb5f500-7cd5-4fbd-af23-7ffa469e3176', 'volume_size': 1, 'image_id': '4b1b7596-9bae-476b-a48d-c3f9aa0969c7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b1b7596-9bae-476b-a48d-c3f9aa0969c7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3633e444fa91dd2c9bb1cfde120a1030', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cd46f0cbce1345459333210a1d785473', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5a0c0301bcae32f4fd0fcdd63c14c03a1fa628b561537bc7043a1dee73e84f9e984a61588c716053694c31bc7fd9683b58750b30b25effdd256b3ab23915cc07', 'id': '4b1b7596-9bae-476b-a48d-c3f9aa0969c7', 'created_at': datetime.datetime(2026, 9, 3, 9, 31, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 31, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b1b7596-9bae-476b-a48d-c3f9aa0969c7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5908d62-17c2-44a0-a6f1-639e5fd6f8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5908d62-17c2-44a0-a6f1-639e5fd6f8da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7555a84-e183-45c1-8157-917da7687b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:23 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Volume dcb5f500-7cd5-4fbd-af23-7ffa469e3176: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dcb5f500-7cd5-4fbd-af23-7ffa469e3176', 'volume_size': 1, 'image_id': '4b1b7596-9bae-476b-a48d-c3f9aa0969c7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b1b7596-9bae-476b-a48d-c3f9aa0969c7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3633e444fa91dd2c9bb1cfde120a1030', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cd46f0cbce1345459333210a1d785473', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5a0c0301bcae32f4fd0fcdd63c14c03a1fa628b561537bc7043a1dee73e84f9e984a61588c716053694c31bc7fd9683b58750b30b25effdd256b3ab23915cc07', 'id': '4b1b7596-9bae-476b-a48d-c3f9aa0969c7', 'created_at': datetime.datetime(2026, 9, 3, 9, 31, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 31, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b1b7596-9bae-476b-a48d-c3f9aa0969c7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 03 11:31:23 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Trying to clone dcb5f500-7cd5-4fbd-af23-7ffa469e3176 from image 4b1b7596-9bae-476b-a48d-c3f9aa0969c7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4b1b7596-9bae-476b-a48d-c3f9aa0969c7', 'metadata': {}}]). {{(pid=87038) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 11:31:23 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-16fe1a73-5f16-437f-9f9b-ea2c99273549 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b65c5429-cd4c-4dda-bab3-e46cf5cdfaba 1073741824" returned: 0 in 0.442s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:23 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4b1b7596-9bae-476b-a48d-c3f9aa0969c7_ueo8rhbedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87038) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 11:31:23 devstack cinder-volume[87038]: INFO cinder.image.image_utils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Image download 0.00 MB at 0.00 MB/s Sep 03 11:31:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-16fe1a73-5f16-437f-9f9b-ea2c99273549 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b65c5429-cd4c-4dda-bab3-e46cf5cdfaba {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:23 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b65c5429-cd4c-4dda-bab3-e46cf5cdfaba Sep 03 11:31:23 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:23 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fdde549-e90e-4cb5-9114-b33adb294ace]: (4, 'raw') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b1b7596-9bae-476b-a48d-c3f9aa0969c7_ueo8rhbedevstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:23 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b1b7596-9bae-476b-a48d-c3f9aa0969c7_ueo8rhbedevstack@QuobyteHD Sep 03 11:31:23 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:23 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-16fe1a73-5f16-437f-9f9b-ea2c99273549 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b65c5429-cd4c-4dda-bab3-e46cf5cdfaba" returned: 0 in 0.259s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:23 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-16fe1a73-5f16-437f-9f9b-ea2c99273549 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:31:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-16fe1a73-5f16-437f-9f9b-ea2c99273549 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-12cbb0b3-d81a-465a-ba1c-feba78c6dd70 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.660s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:23 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-12cbb0b3-d81a-465a-ba1c-feba78c6dd70 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-137383728',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b6a0d30-3bfb-42ff-995f-73cb505889c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='237cc853aaef49119e628e361a8e03ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:21Z,use_quota=True,user_id='71ea0f0cb0e04c4bb248198183d87b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:31:23 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-12cbb0b3-d81a-465a-ba1c-feba78c6dd70 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Creating volume 5b6a0d30-3bfb-42ff-995f-73cb505889c1 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:31:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-12cbb0b3-d81a-465a-ba1c-feba78c6dd70 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-12cbb0b3-d81a-465a-ba1c-feba78c6dd70 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:23 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-12cbb0b3-d81a-465a-ba1c-feba78c6dd70 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:23 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-12cbb0b3-d81a-465a-ba1c-feba78c6dd70 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-12cbb0b3-d81a-465a-ba1c-feba78c6dd70 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:23 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-12cbb0b3-d81a-465a-ba1c-feba78c6dd70 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:31:23 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-12cbb0b3-d81a-465a-ba1c-feba78c6dd70 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:31:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-12cbb0b3-d81a-465a-ba1c-feba78c6dd70 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5b6a0d30-3bfb-42ff-995f-73cb505889c1 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:23 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5b6a0d30-3bfb-42ff-995f-73cb505889c1 1073741824 Sep 03 11:31:23 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-16fe1a73-5f16-437f-9f9b-ea2c99273549 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b6fe267-1207-4eee-a7ef-6bb95a29403e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b65c5429-cd4c-4dda-bab3-e46cf5cdfaba', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-16fe1a73-5f16-437f-9f9b-ea2c99273549 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13da9e24-f959-4e08-b76a-67de3eb034c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:23 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-16fe1a73-5f16-437f-9f9b-ea2c99273549 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Volume volume-b65c5429-cd4c-4dda-bab3-e46cf5cdfaba (b65c5429-cd4c-4dda-bab3-e46cf5cdfaba): created successfully Sep 03 11:31:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-16fe1a73-5f16-437f-9f9b-ea2c99273549 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13da9e24-f959-4e08-b76a-67de3eb034c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-16fe1a73-5f16-437f-9f9b-ea2c99273549 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Flow 'volume_create_manager' (d5389760-7395-48ef-b968-8af6102ce943) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:23 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-16fe1a73-5f16-437f-9f9b-ea2c99273549 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Created volume successfully. Sep 03 11:31:23 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b1b7596-9bae-476b-a48d-c3f9aa0969c7_ueo8rhbedevstack@QuobyteHD" returned: 0 in 0.374s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b1b7596-9bae-476b-a48d-c3f9aa0969c7_ueo8rhbedevstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:23 devstack sudo[105497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b1b7596-9bae-476b-a48d-c3f9aa0969c7_ueo8rhbedevstack@QuobyteHD Sep 03 11:31:23 devstack sudo[105497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:23 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-12cbb0b3-d81a-465a-ba1c-feba78c6dd70 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5b6a0d30-3bfb-42ff-995f-73cb505889c1 1073741824" returned: 0 in 0.436s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-12cbb0b3-d81a-465a-ba1c-feba78c6dd70 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5b6a0d30-3bfb-42ff-995f-73cb505889c1 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:24 devstack sudo[105497]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b1b7596-9bae-476b-a48d-c3f9aa0969c7_ueo8rhbedevstack@QuobyteHD" returned: 1 in 0.350s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b1b7596-9bae-476b-a48d-c3f9aa0969c7_ueo8rhbedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:31:24 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Temporary image 4b1b7596-9bae-476b-a48d-c3f9aa0969c7 is fetched for user b387ed421509412c97cb0ab458de5d95. {{(pid=87038) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 11:31:24 devstack sudo[105506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5b6a0d30-3bfb-42ff-995f-73cb505889c1 Sep 03 11:31:24 devstack sudo[105506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:24 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb454d0d-f65b-4478-9f19-7f6b0734aab9]: (4, 'raw') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b1b7596-9bae-476b-a48d-c3f9aa0969c7_ueo8rhbedevstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:24 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b1b7596-9bae-476b-a48d-c3f9aa0969c7_ueo8rhbedevstack@QuobyteHD Sep 03 11:31:24 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-baa64235-8d8f-4ee3-96c0-1c6bf510dcac tempest-CinderUnicodeTest-1349351074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:24 devstack sudo[105506]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-12cbb0b3-d81a-465a-ba1c-feba78c6dd70 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5b6a0d30-3bfb-42ff-995f-73cb505889c1" returned: 0 in 0.302s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-12cbb0b3-d81a-465a-ba1c-feba78c6dd70 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:31:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-12cbb0b3-d81a-465a-ba1c-feba78c6dd70 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d4ce2409-ca60-4909-b2eb-852f6b9057a0 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.297s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d4ce2409-ca60-4909-b2eb-852f6b9057a0 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1106381417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f22e4ea5-2815-4466-b2c7-447cc54e9821,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='237cc853aaef49119e628e361a8e03ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:22Z,use_quota=True,user_id='71ea0f0cb0e04c4bb248198183d87b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:31:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-d4ce2409-ca60-4909-b2eb-852f6b9057a0 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Creating volume f22e4ea5-2815-4466-b2c7-447cc54e9821 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:31:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d4ce2409-ca60-4909-b2eb-852f6b9057a0 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d4ce2409-ca60-4909-b2eb-852f6b9057a0 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d4ce2409-ca60-4909-b2eb-852f6b9057a0 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d4ce2409-ca60-4909-b2eb-852f6b9057a0 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d4ce2409-ca60-4909-b2eb-852f6b9057a0 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d4ce2409-ca60-4909-b2eb-852f6b9057a0 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:31:24 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-d4ce2409-ca60-4909-b2eb-852f6b9057a0 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:31:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d4ce2409-ca60-4909-b2eb-852f6b9057a0 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f22e4ea5-2815-4466-b2c7-447cc54e9821 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12cbb0b3-d81a-465a-ba1c-feba78c6dd70 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db1dc8e3-5d05-430c-b00a-7356ee7080e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b6a0d30-3bfb-42ff-995f-73cb505889c1', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:24 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f22e4ea5-2815-4466-b2c7-447cc54e9821 1073741824 Sep 03 11:31:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12cbb0b3-d81a-465a-ba1c-feba78c6dd70 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfc9ca9b-7729-4cdd-83e8-f4ec781c76c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:24 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:24 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-12cbb0b3-d81a-465a-ba1c-feba78c6dd70 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Volume volume-5b6a0d30-3bfb-42ff-995f-73cb505889c1 (5b6a0d30-3bfb-42ff-995f-73cb505889c1): created successfully Sep 03 11:31:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12cbb0b3-d81a-465a-ba1c-feba78c6dd70 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfc9ca9b-7729-4cdd-83e8-f4ec781c76c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-12cbb0b3-d81a-465a-ba1c-feba78c6dd70 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Flow 'volume_create_manager' (e0b2cd7c-18b5-4bdd-9d6e-13f3b4a0f988) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:24 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-12cbb0b3-d81a-465a-ba1c-feba78c6dd70 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Created volume successfully. Sep 03 11:31:24 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b1b7596-9bae-476b-a48d-c3f9aa0969c7_ueo8rhbedevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b1b7596-9bae-476b-a48d-c3f9aa0969c7_ueo8rhbedevstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:24 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b1b7596-9bae-476b-a48d-c3f9aa0969c7_ueo8rhbedevstack@QuobyteHD Sep 03 11:31:24 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:24 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d4ce2409-ca60-4909-b2eb-852f6b9057a0 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f22e4ea5-2815-4466-b2c7-447cc54e9821 1073741824" returned: 0 in 0.435s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:24 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b1b7596-9bae-476b-a48d-c3f9aa0969c7_ueo8rhbedevstack@QuobyteHD" returned: 1 in 0.339s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b1b7596-9bae-476b-a48d-c3f9aa0969c7_ueo8rhbedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:31:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d4ce2409-ca60-4909-b2eb-852f6b9057a0 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f22e4ea5-2815-4466-b2c7-447cc54e9821 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:24 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f22e4ea5-2815-4466-b2c7-447cc54e9821 Sep 03 11:31:24 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:25 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d4ce2409-ca60-4909-b2eb-852f6b9057a0 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f22e4ea5-2815-4466-b2c7-447cc54e9821" returned: 0 in 0.236s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:25 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d4ce2409-ca60-4909-b2eb-852f6b9057a0 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:31:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d4ce2409-ca60-4909-b2eb-852f6b9057a0 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f1d350f4-5089-44fb-aaa6-47fa8af2b906 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.280s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:25 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f1d350f4-5089-44fb-aaa6-47fa8af2b906 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1450000375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ed0050f-301e-4d21-94ce-5ca858e47ba0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='237cc853aaef49119e628e361a8e03ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:21Z,use_quota=True,user_id='71ea0f0cb0e04c4bb248198183d87b75',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:31:25 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-f1d350f4-5089-44fb-aaa6-47fa8af2b906 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Creating volume 6ed0050f-301e-4d21-94ce-5ca858e47ba0 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:31:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f1d350f4-5089-44fb-aaa6-47fa8af2b906 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f1d350f4-5089-44fb-aaa6-47fa8af2b906 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:25 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f1d350f4-5089-44fb-aaa6-47fa8af2b906 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:25 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f1d350f4-5089-44fb-aaa6-47fa8af2b906 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f1d350f4-5089-44fb-aaa6-47fa8af2b906 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:25 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f1d350f4-5089-44fb-aaa6-47fa8af2b906 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:31:25 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-f1d350f4-5089-44fb-aaa6-47fa8af2b906 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:31:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f1d350f4-5089-44fb-aaa6-47fa8af2b906 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6ed0050f-301e-4d21-94ce-5ca858e47ba0 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d4ce2409-ca60-4909-b2eb-852f6b9057a0 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23fd11e8-832c-4a43-b96e-2d5ee5dc3184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f22e4ea5-2815-4466-b2c7-447cc54e9821', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:25 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6ed0050f-301e-4d21-94ce-5ca858e47ba0 1073741824 Sep 03 11:31:25 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d4ce2409-ca60-4909-b2eb-852f6b9057a0 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0feb55-4553-42ad-97a6-cadc670c091f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:25 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-d4ce2409-ca60-4909-b2eb-852f6b9057a0 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Volume volume-f22e4ea5-2815-4466-b2c7-447cc54e9821 (f22e4ea5-2815-4466-b2c7-447cc54e9821): created successfully Sep 03 11:31:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d4ce2409-ca60-4909-b2eb-852f6b9057a0 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e0feb55-4553-42ad-97a6-cadc670c091f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d4ce2409-ca60-4909-b2eb-852f6b9057a0 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Flow 'volume_create_manager' (ab6d9fdb-23cb-4653-9b1b-2513a7e32027) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:25 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-d4ce2409-ca60-4909-b2eb-852f6b9057a0 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Created volume successfully. Sep 03 11:31:25 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f1d350f4-5089-44fb-aaa6-47fa8af2b906 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6ed0050f-301e-4d21-94ce-5ca858e47ba0 1073741824" returned: 0 in 0.393s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f1d350f4-5089-44fb-aaa6-47fa8af2b906 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6ed0050f-301e-4d21-94ce-5ca858e47ba0 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:25 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6ed0050f-301e-4d21-94ce-5ca858e47ba0 Sep 03 11:31:25 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:25 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f1d350f4-5089-44fb-aaa6-47fa8af2b906 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6ed0050f-301e-4d21-94ce-5ca858e47ba0" returned: 0 in 0.255s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:25 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f1d350f4-5089-44fb-aaa6-47fa8af2b906 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:31:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f1d350f4-5089-44fb-aaa6-47fa8af2b906 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7d31c382-2cec-474c-9ac5-e0d2539f5ee4 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.904s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f1d350f4-5089-44fb-aaa6-47fa8af2b906 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f219a7-38ee-41e8-a021-3271a56f387e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ed0050f-301e-4d21-94ce-5ca858e47ba0', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f1d350f4-5089-44fb-aaa6-47fa8af2b906 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0111721b-6575-4524-8f7e-66363fd2d13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:25 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-7d31c382-2cec-474c-9ac5-e0d2539f5ee4 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Creating offline snapshot 1595d3d8-59a8-4ede-a1b3-23795d19aa84 of volume 27fad037-87dd-42ea-b527-77f67f40b633 {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:31:25 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-f1d350f4-5089-44fb-aaa6-47fa8af2b906 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Volume volume-6ed0050f-301e-4d21-94ce-5ca858e47ba0 (6ed0050f-301e-4d21-94ce-5ca858e47ba0): created successfully Sep 03 11:31:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f1d350f4-5089-44fb-aaa6-47fa8af2b906 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0111721b-6575-4524-8f7e-66363fd2d13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-f1d350f4-5089-44fb-aaa6-47fa8af2b906 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Flow 'volume_create_manager' (19edc4cf-385a-4140-ad9a-444299c9d2d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:25 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8a9d86-b00f-4cc7-83ba-7723f1e49088]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7d31c382-2cec-474c-9ac5-e0d2539f5ee4 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:25 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-f1d350f4-5089-44fb-aaa6-47fa8af2b906 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Created volume successfully. Sep 03 11:31:25 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633 Sep 03 11:31:25 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:26 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7d31c382-2cec-474c-9ac5-e0d2539f5ee4 tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633" returned: 0 in 0.362s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7d31c382-2cec-474c-9ac5-e0d2539f5ee4 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633.1595d3d8-59a8-4ede-a1b3-23795d19aa84 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:26 devstack sudo[105539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633.1595d3d8-59a8-4ede-a1b3-23795d19aa84 1G Sep 03 11:31:26 devstack sudo[105539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:26 devstack sudo[105539]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7d31c382-2cec-474c-9ac5-e0d2539f5ee4 tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633.1595d3d8-59a8-4ede-a1b3-23795d19aa84 1G" returned: 0 in 0.378s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7d31c382-2cec-474c-9ac5-e0d2539f5ee4 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27fad037-87dd-42ea-b527-77f67f40b633 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633.1595d3d8-59a8-4ede-a1b3-23795d19aa84 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:26 devstack sudo[105544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27fad037-87dd-42ea-b527-77f67f40b633 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633.1595d3d8-59a8-4ede-a1b3-23795d19aa84 Sep 03 11:31:26 devstack sudo[105544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:26 devstack sudo[105544]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7d31c382-2cec-474c-9ac5-e0d2539f5ee4 tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-27fad037-87dd-42ea-b527-77f67f40b633 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633.1595d3d8-59a8-4ede-a1b3-23795d19aa84" returned: 0 in 0.312s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:26 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-7d31c382-2cec-474c-9ac5-e0d2539f5ee4 tempest-CreateVolumesFromSnapshotTest-2066319807 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633.1595d3d8-59a8-4ede-a1b3-23795d19aa84 is being set with open permissions: ugo+rw Sep 03 11:31:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7d31c382-2cec-474c-9ac5-e0d2539f5ee4 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633.1595d3d8-59a8-4ede-a1b3-23795d19aa84 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:26 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633.1595d3d8-59a8-4ede-a1b3-23795d19aa84 Sep 03 11:31:26 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:27 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-38a5e408-9fa6-45c2-acaf-ab465fb888b6 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Acquiring lock "cinder-b65c5429-cd4c-4dda-bab3-e46cf5cdfaba-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:27 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-38a5e408-9fa6-45c2-acaf-ab465fb888b6 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "cinder-b65c5429-cd4c-4dda-bab3-e46cf5cdfaba-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:27 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-38a5e408-9fa6-45c2-acaf-ab465fb888b6 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Acquiring lock "cinder-quobyte-b65c5429-cd4c-4dda-bab3-e46cf5cdfaba" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:27 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-38a5e408-9fa6-45c2-acaf-ab465fb888b6 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "cinder-quobyte-b65c5429-cd4c-4dda-bab3-e46cf5cdfaba" acquired by "delete_volume" :: waited 0.018s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:27 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7d31c382-2cec-474c-9ac5-e0d2539f5ee4 tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633.1595d3d8-59a8-4ede-a1b3-23795d19aa84" returned: 0 in 0.269s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:27 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[278dc949-bab7-4ea9-a542-c96f5bd2f063]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-38a5e408-9fa6-45c2-acaf-ab465fb888b6 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b65c5429-cd4c-4dda-bab3-e46cf5cdfaba {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7d31c382-2cec-474c-9ac5-e0d2539f5ee4 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:27 devstack sudo[105554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633.info Sep 03 11:31:27 devstack sudo[105554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:27 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b65c5429-cd4c-4dda-bab3-e46cf5cdfaba Sep 03 11:31:27 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:27 devstack sudo[105554]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7d31c382-2cec-474c-9ac5-e0d2539f5ee4 tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633.info" returned: 0 in 0.260s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:27 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-7d31c382-2cec-474c-9ac5-e0d2539f5ee4 tempest-CreateVolumesFromSnapshotTest-2066319807 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633.info is being set with open permissions: ugo+rw Sep 03 11:31:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7d31c382-2cec-474c-9ac5-e0d2539f5ee4 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:27 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633.info Sep 03 11:31:27 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:27 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-38a5e408-9fa6-45c2-acaf-ab465fb888b6 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b65c5429-cd4c-4dda-bab3-e46cf5cdfaba" returned: 0 in 0.355s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-38a5e408-9fa6-45c2-acaf-ab465fb888b6 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b65c5429-cd4c-4dda-bab3-e46cf5cdfaba {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:27 devstack sudo[105563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b65c5429-cd4c-4dda-bab3-e46cf5cdfaba Sep 03 11:31:27 devstack sudo[105563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:27 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7d31c382-2cec-474c-9ac5-e0d2539f5ee4 tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633.info" returned: 0 in 0.263s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7d31c382-2cec-474c-9ac5-e0d2539f5ee4 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.968s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-baa64235-8d8f-4ee3-96c0-1c6bf510dcac tempest-CinderUnicodeTest-1349351074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.468s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-baa64235-8d8f-4ee3-96c0-1c6bf510dcac tempest-CinderUnicodeTest-1349351074 None] Creating offline snapshot d7f1a2cf-222e-4f6b-b1e5-a61e14b45ea8 of volume 0d5f61b9-8b1f-4210-9d58-6989315d255e {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:31:27 devstack sudo[105563]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-38a5e408-9fa6-45c2-acaf-ab465fb888b6 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b65c5429-cd4c-4dda-bab3-e46cf5cdfaba" returned: 0 in 0.264s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:27 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fc3de7-6f4a-418f-845f-4a3c313581a3]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-baa64235-8d8f-4ee3-96c0-1c6bf510dcac tempest-CinderUnicodeTest-1349351074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:27 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-7d31c382-2cec-474c-9ac5-e0d2539f5ee4 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Create snapshot completed successfully Sep 03 11:31:27 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-38a5e408-9fa6-45c2-acaf-ab465fb888b6 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "cinder-quobyte-b65c5429-cd4c-4dda-bab3-e46cf5cdfaba" released by "delete_volume" :: held 0.681s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:27 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-38a5e408-9fa6-45c2-acaf-ab465fb888b6 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Created reservations ['e81903bc-c7d3-4065-b738-1015c7f83ab9', 'a5270a57-b307-446d-bb2d-826688730316', '687749f5-f624-440a-908f-f55b9c2319cb', 'd360b54a-98e4-4d2b-8d1d-ee408bd6382d'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:31:27 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e Sep 03 11:31:27 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-38a5e408-9fa6-45c2-acaf-ab465fb888b6 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-38a5e408-9fa6-45c2-acaf-ab465fb888b6 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-38a5e408-9fa6-45c2-acaf-ab465fb888b6 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-38a5e408-9fa6-45c2-acaf-ab465fb888b6 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-38a5e408-9fa6-45c2-acaf-ab465fb888b6 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-38a5e408-9fa6-45c2-acaf-ab465fb888b6 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:27 devstack sudo[105569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:31:27 devstack sudo[105569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:28 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-baa64235-8d8f-4ee3-96c0-1c6bf510dcac tempest-CinderUnicodeTest-1349351074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e" returned: 0 in 0.372s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-baa64235-8d8f-4ee3-96c0-1c6bf510dcac tempest-CinderUnicodeTest-1349351074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e.d7f1a2cf-222e-4f6b-b1e5-a61e14b45ea8 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:28 devstack sudo[105569]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-38a5e408-9fa6-45c2-acaf-ab465fb888b6 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.262s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:28 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-38a5e408-9fa6-45c2-acaf-ab465fb888b6 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:31:28 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e.d7f1a2cf-222e-4f6b-b1e5-a61e14b45ea8 1G Sep 03 11:31:28 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:28 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-38a5e408-9fa6-45c2-acaf-ab465fb888b6 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Deleted volume successfully. Sep 03 11:31:28 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-38a5e408-9fa6-45c2-acaf-ab465fb888b6 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "cinder-b65c5429-cd4c-4dda-bab3-e46cf5cdfaba-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:28 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-59bff41d-edb6-4370-bb95-6af27718ede4 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Acquiring lock "cinder-f22e4ea5-2815-4466-b2c7-447cc54e9821-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:28 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-59bff41d-edb6-4370-bb95-6af27718ede4 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "cinder-f22e4ea5-2815-4466-b2c7-447cc54e9821-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:28 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-59bff41d-edb6-4370-bb95-6af27718ede4 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Acquiring lock "cinder-quobyte-f22e4ea5-2815-4466-b2c7-447cc54e9821" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:28 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-59bff41d-edb6-4370-bb95-6af27718ede4 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "cinder-quobyte-f22e4ea5-2815-4466-b2c7-447cc54e9821" acquired by "delete_volume" :: waited 0.015s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:28 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0c01c2-763a-426b-8eaf-8fed1fe111e3]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-59bff41d-edb6-4370-bb95-6af27718ede4 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f22e4ea5-2815-4466-b2c7-447cc54e9821 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:28 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f22e4ea5-2815-4466-b2c7-447cc54e9821 Sep 03 11:31:28 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:28 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-baa64235-8d8f-4ee3-96c0-1c6bf510dcac tempest-CinderUnicodeTest-1349351074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e.d7f1a2cf-222e-4f6b-b1e5-a61e14b45ea8 1G" returned: 0 in 0.403s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-baa64235-8d8f-4ee3-96c0-1c6bf510dcac tempest-CinderUnicodeTest-1349351074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d5f61b9-8b1f-4210-9d58-6989315d255e -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e.d7f1a2cf-222e-4f6b-b1e5-a61e14b45ea8 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:28 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d5f61b9-8b1f-4210-9d58-6989315d255e -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e.d7f1a2cf-222e-4f6b-b1e5-a61e14b45ea8 Sep 03 11:31:28 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:28 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-59bff41d-edb6-4370-bb95-6af27718ede4 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f22e4ea5-2815-4466-b2c7-447cc54e9821" returned: 0 in 0.366s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-59bff41d-edb6-4370-bb95-6af27718ede4 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f22e4ea5-2815-4466-b2c7-447cc54e9821 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:28 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f22e4ea5-2815-4466-b2c7-447cc54e9821 Sep 03 11:31:28 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:28 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-baa64235-8d8f-4ee3-96c0-1c6bf510dcac tempest-CinderUnicodeTest-1349351074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d5f61b9-8b1f-4210-9d58-6989315d255e -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e.d7f1a2cf-222e-4f6b-b1e5-a61e14b45ea8" returned: 0 in 0.316s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:28 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-baa64235-8d8f-4ee3-96c0-1c6bf510dcac tempest-CinderUnicodeTest-1349351074 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e.d7f1a2cf-222e-4f6b-b1e5-a61e14b45ea8 is being set with open permissions: ugo+rw Sep 03 11:31:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-baa64235-8d8f-4ee3-96c0-1c6bf510dcac tempest-CinderUnicodeTest-1349351074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e.d7f1a2cf-222e-4f6b-b1e5-a61e14b45ea8 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:28 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e.d7f1a2cf-222e-4f6b-b1e5-a61e14b45ea8 Sep 03 11:31:28 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:28 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-59bff41d-edb6-4370-bb95-6af27718ede4 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-f22e4ea5-2815-4466-b2c7-447cc54e9821" returned: 0 in 0.272s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:28 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-59bff41d-edb6-4370-bb95-6af27718ede4 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "cinder-quobyte-f22e4ea5-2815-4466-b2c7-447cc54e9821" released by "delete_volume" :: held 0.682s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-59bff41d-edb6-4370-bb95-6af27718ede4 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Created reservations ['9fad6e57-5f1d-4e05-a686-9a9311a44924', '5f78627c-cede-4e17-b97d-26c9bc4f9ca0', 'e685b751-db41-4224-b838-edce00e28344', '083d0f6c-56e0-494a-b699-fe6ea40f2cb7'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:31:29 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-baa64235-8d8f-4ee3-96c0-1c6bf510dcac tempest-CinderUnicodeTest-1349351074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e.d7f1a2cf-222e-4f6b-b1e5-a61e14b45ea8" returned: 0 in 0.273s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-59bff41d-edb6-4370-bb95-6af27718ede4 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-59bff41d-edb6-4370-bb95-6af27718ede4 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-59bff41d-edb6-4370-bb95-6af27718ede4 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-59bff41d-edb6-4370-bb95-6af27718ede4 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-59bff41d-edb6-4370-bb95-6af27718ede4 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-59bff41d-edb6-4370-bb95-6af27718ede4 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:29 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:31:29 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-baa64235-8d8f-4ee3-96c0-1c6bf510dcac tempest-CinderUnicodeTest-1349351074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:29 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e.info Sep 03 11:31:29 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-07e5a247-5bb3-44c4-9a72-51dbab6a7809 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:31:29 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-07e5a247-5bb3-44c4-9a72-51dbab6a7809 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Flow 'volume_create_manager' (28afe064-bc3a-4e7f-904c-6d0f66ae0b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-07e5a247-5bb3-44c4-9a72-51dbab6a7809 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e41f52c8-55ea-420a-9c50-878d055ff9d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-59bff41d-edb6-4370-bb95-6af27718ede4 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.292s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-59bff41d-edb6-4370-bb95-6af27718ede4 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-07e5a247-5bb3-44c4-9a72-51dbab6a7809 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e41f52c8-55ea-420a-9c50-878d055ff9d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-504331456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dea2bf5-d1c6-4b13-8257-5f2fb813f458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='277eb90f50004faa903c51161079a23c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:29Z,use_quota=True,user_id='0a4310dc1f0d4895b79d13aa5fe5c14f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-07e5a247-5bb3-44c4-9a72-51dbab6a7809 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed58ec1f-7c75-4e93-8c22-63e70f98ee3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-07e5a247-5bb3-44c4-9a72-51dbab6a7809 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed58ec1f-7c75-4e93-8c22-63e70f98ee3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-07e5a247-5bb3-44c4-9a72-51dbab6a7809 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cba145a6-6ed8-4291-a7aa-00d2bba5adb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-07e5a247-5bb3-44c4-9a72-51dbab6a7809 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cba145a6-6ed8-4291-a7aa-00d2bba5adb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dea2bf5-d1c6-4b13-8257-5f2fb813f458', 'volume_name': 'volume-8dea2bf5-d1c6-4b13-8257-5f2fb813f458', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-07e5a247-5bb3-44c4-9a72-51dbab6a7809 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (020e5fc2-95c3-4232-ad66-97751ecf7de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-07e5a247-5bb3-44c4-9a72-51dbab6a7809 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (020e5fc2-95c3-4232-ad66-97751ecf7de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-07e5a247-5bb3-44c4-9a72-51dbab6a7809 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (562b1009-839f-47cf-8746-3dd3c6d48284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:29 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-07e5a247-5bb3-44c4-9a72-51dbab6a7809 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Volume 8dea2bf5-d1c6-4b13-8257-5f2fb813f458: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dea2bf5-d1c6-4b13-8257-5f2fb813f458', 'volume_size': 1} Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-07e5a247-5bb3-44c4-9a72-51dbab6a7809 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:29 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-59bff41d-edb6-4370-bb95-6af27718ede4 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Deleted volume successfully. Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-9a2ef4b7-9a48-45e7-a56a-3450b222d1c9 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Acquiring lock "cinder-5b6a0d30-3bfb-42ff-995f-73cb505889c1-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-9a2ef4b7-9a48-45e7-a56a-3450b222d1c9 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "cinder-5b6a0d30-3bfb-42ff-995f-73cb505889c1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-59bff41d-edb6-4370-bb95-6af27718ede4 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "cinder-f22e4ea5-2815-4466-b2c7-447cc54e9821-delete_volume" released by "delete_volume" :: held 1.294s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-9a2ef4b7-9a48-45e7-a56a-3450b222d1c9 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Acquiring lock "cinder-quobyte-5b6a0d30-3bfb-42ff-995f-73cb505889c1" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-9a2ef4b7-9a48-45e7-a56a-3450b222d1c9 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "cinder-quobyte-5b6a0d30-3bfb-42ff-995f-73cb505889c1" acquired by "delete_volume" :: waited 0.027s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50648cf-edd7-490a-ab5f-4367957475e7]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9a2ef4b7-9a48-45e7-a56a-3450b222d1c9 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5b6a0d30-3bfb-42ff-995f-73cb505889c1 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:29 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-baa64235-8d8f-4ee3-96c0-1c6bf510dcac tempest-CinderUnicodeTest-1349351074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e.info" returned: 0 in 0.461s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:29 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-baa64235-8d8f-4ee3-96c0-1c6bf510dcac tempest-CinderUnicodeTest-1349351074 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e.info is being set with open permissions: ugo+rw Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-baa64235-8d8f-4ee3-96c0-1c6bf510dcac tempest-CinderUnicodeTest-1349351074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:29 devstack sudo[105604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e.info Sep 03 11:31:29 devstack sudo[105604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:29 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5b6a0d30-3bfb-42ff-995f-73cb505889c1 Sep 03 11:31:29 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-5ba75fdc-0e10-416d-ba10-91d986eaf650 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5ba75fdc-0e10-416d-ba10-91d986eaf650 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Flow 'volume_create_manager' (25c7247c-edb1-441b-adc2-85b75efc9c32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5ba75fdc-0e10-416d-ba10-91d986eaf650 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deee4983-9f38-4932-a3f6-c8726c1f5c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5ba75fdc-0e10-416d-ba10-91d986eaf650 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (deee4983-9f38-4932-a3f6-c8726c1f5c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1087955299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64b7fc7f-f7b0-4f07-9d8b-9508eca975bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='277eb90f50004faa903c51161079a23c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:30Z,use_quota=True,user_id='0a4310dc1f0d4895b79d13aa5fe5c14f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5ba75fdc-0e10-416d-ba10-91d986eaf650 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3556bd33-a662-407b-a4f6-d2e085cbe9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5ba75fdc-0e10-416d-ba10-91d986eaf650 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3556bd33-a662-407b-a4f6-d2e085cbe9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5ba75fdc-0e10-416d-ba10-91d986eaf650 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f31dfcc9-faf8-4bf7-87e2-bac03e42076a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5ba75fdc-0e10-416d-ba10-91d986eaf650 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f31dfcc9-faf8-4bf7-87e2-bac03e42076a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64b7fc7f-f7b0-4f07-9d8b-9508eca975bb', 'volume_name': 'volume-64b7fc7f-f7b0-4f07-9d8b-9508eca975bb', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5ba75fdc-0e10-416d-ba10-91d986eaf650 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (460dd64b-9378-4bc9-8467-24a5dee54d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5ba75fdc-0e10-416d-ba10-91d986eaf650 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (460dd64b-9378-4bc9-8467-24a5dee54d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5ba75fdc-0e10-416d-ba10-91d986eaf650 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c85a1045-da1e-4026-8e35-19183f2bfa76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:29 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-5ba75fdc-0e10-416d-ba10-91d986eaf650 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Volume 64b7fc7f-f7b0-4f07-9d8b-9508eca975bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64b7fc7f-f7b0-4f07-9d8b-9508eca975bb', 'volume_size': 1} Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5ba75fdc-0e10-416d-ba10-91d986eaf650 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:29 devstack sudo[105604]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-baa64235-8d8f-4ee3-96c0-1c6bf510dcac tempest-CinderUnicodeTest-1349351074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e.info" returned: 0 in 0.338s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-baa64235-8d8f-4ee3-96c0-1c6bf510dcac tempest-CinderUnicodeTest-1349351074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.296s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.211s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:22Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcb5f500-7cd5-4fbd-af23-7ffa469e3176,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd46f0cbce1345459333210a1d785473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:23Z,use_quota=True,user_id='b387ed421509412c97cb0ab458de5d95',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5762589-bf45-4acf-a698-9d326d65db23),volume_type_id=e5762589-bf45-4acf-a698-9d326d65db23)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Creating volume dcb5f500-7cd5-4fbd-af23-7ffa469e3176 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:31:30 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-dcb5f500-7cd5-4fbd-af23-7ffa469e3176 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:30 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-dcb5f500-7cd5-4fbd-af23-7ffa469e3176 1073741824 Sep 03 11:31:30 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:30 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-baa64235-8d8f-4ee3-96c0-1c6bf510dcac tempest-CinderUnicodeTest-1349351074 None] Create snapshot completed successfully Sep 03 11:31:30 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9a2ef4b7-9a48-45e7-a56a-3450b222d1c9 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5b6a0d30-3bfb-42ff-995f-73cb505889c1" returned: 0 in 0.489s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9a2ef4b7-9a48-45e7-a56a-3450b222d1c9 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5b6a0d30-3bfb-42ff-995f-73cb505889c1 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bdb4ccc-5f81-44e4-bf03-db5d8d01090e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:31:30 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5b6a0d30-3bfb-42ff-995f-73cb505889c1 Sep 03 11:31:30 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5bdb4ccc-5f81-44e4-bf03-db5d8d01090e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Flow 'volume_create_manager' (add3984f-b1e5-45d5-bffa-47961c100a94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5bdb4ccc-5f81-44e4-bf03-db5d8d01090e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1da3405-1f51-4c6e-bd7e-21c4b5fcadad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5bdb4ccc-5f81-44e4-bf03-db5d8d01090e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1da3405-1f51-4c6e-bd7e-21c4b5fcadad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1441007417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d18fc2cb-521d-4359-a10e-1196562f49c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='277eb90f50004faa903c51161079a23c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:30Z,use_quota=True,user_id='0a4310dc1f0d4895b79d13aa5fe5c14f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5bdb4ccc-5f81-44e4-bf03-db5d8d01090e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76090879-2b3e-44f0-9d30-edd6d2c4ef21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5bdb4ccc-5f81-44e4-bf03-db5d8d01090e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76090879-2b3e-44f0-9d30-edd6d2c4ef21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5bdb4ccc-5f81-44e4-bf03-db5d8d01090e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5435a8f0-c4d2-4bdc-b903-43228b094925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5bdb4ccc-5f81-44e4-bf03-db5d8d01090e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5435a8f0-c4d2-4bdc-b903-43228b094925) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd18fc2cb-521d-4359-a10e-1196562f49c6', 'volume_name': 'volume-d18fc2cb-521d-4359-a10e-1196562f49c6', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5bdb4ccc-5f81-44e4-bf03-db5d8d01090e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (450fdc62-cb59-4447-a94d-8c8193b0a659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5bdb4ccc-5f81-44e4-bf03-db5d8d01090e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (450fdc62-cb59-4447-a94d-8c8193b0a659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5bdb4ccc-5f81-44e4-bf03-db5d8d01090e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54c80c31-f40a-4d93-837d-ba1d159e346b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:30 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-5bdb4ccc-5f81-44e4-bf03-db5d8d01090e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Volume d18fc2cb-521d-4359-a10e-1196562f49c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d18fc2cb-521d-4359-a10e-1196562f49c6', 'volume_size': 1} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5bdb4ccc-5f81-44e4-bf03-db5d8d01090e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:30 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9a2ef4b7-9a48-45e7-a56a-3450b222d1c9 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5b6a0d30-3bfb-42ff-995f-73cb505889c1" returned: 0 in 0.380s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-9a2ef4b7-9a48-45e7-a56a-3450b222d1c9 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "cinder-quobyte-5b6a0d30-3bfb-42ff-995f-73cb505889c1" released by "delete_volume" :: held 0.934s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-06c235ec-1922-4d01-8c16-04ed6a95e346 tempest-CinderUnicodeTest-1349351074 None] Acquiring lock "cinder-d7f1a2cf-222e-4f6b-b1e5-a61e14b45ea8-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:30 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-dcb5f500-7cd5-4fbd-af23-7ffa469e3176 1073741824" returned: 0 in 0.556s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-06c235ec-1922-4d01-8c16-04ed6a95e346 tempest-CinderUnicodeTest-1349351074 None] Lock "cinder-d7f1a2cf-222e-4f6b-b1e5-a61e14b45ea8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-06c235ec-1922-4d01-8c16-04ed6a95e346 tempest-CinderUnicodeTest-1349351074 None] Acquiring lock "cinder-quobyte-0d5f61b9-8b1f-4210-9d58-6989315d255e" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9d37e88-e13f-4e3e-ad8d-ba88d17a24cf tempest-CreateVolumesFromSnapshotTest-2066319807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a9d37e88-e13f-4e3e-ad8d-ba88d17a24cf tempest-CreateVolumesFromSnapshotTest-2066319807 None] Flow 'volume_create_manager' (8b5d4186-303c-4d97-9373-0de4eeebdc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a9d37e88-e13f-4e3e-ad8d-ba88d17a24cf tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce97051-fe76-4c52-b902-07a08325d102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-06c235ec-1922-4d01-8c16-04ed6a95e346 tempest-CinderUnicodeTest-1349351074 None] Lock "cinder-quobyte-0d5f61b9-8b1f-4210-9d58-6989315d255e" acquired by "delete_snapshot" :: waited 0.077s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-06c235ec-1922-4d01-8c16-04ed6a95e346 tempest-CinderUnicodeTest-1349351074 None] Acquiring lock "cinder-quobyte-d7f1a2cf-222e-4f6b-b1e5-a61e14b45ea8" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a9d37e88-e13f-4e3e-ad8d-ba88d17a24cf tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ce97051-fe76-4c52-b902-07a08325d102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2101448938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de67e6a-e496-42a7-80d3-812ef90a215c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='277eb90f50004faa903c51161079a23c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:30Z,use_quota=True,user_id='0a4310dc1f0d4895b79d13aa5fe5c14f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a9d37e88-e13f-4e3e-ad8d-ba88d17a24cf tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e41ae18-2646-40cc-ae32-1c14bf4f3b12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a9d37e88-e13f-4e3e-ad8d-ba88d17a24cf tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e41ae18-2646-40cc-ae32-1c14bf4f3b12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a9d37e88-e13f-4e3e-ad8d-ba88d17a24cf tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (120c9a29-de01-43fa-8548-a57aa97723c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a9d37e88-e13f-4e3e-ad8d-ba88d17a24cf tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (120c9a29-de01-43fa-8548-a57aa97723c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4de67e6a-e496-42a7-80d3-812ef90a215c', 'volume_name': 'volume-4de67e6a-e496-42a7-80d3-812ef90a215c', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a9d37e88-e13f-4e3e-ad8d-ba88d17a24cf tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16638f24-d4d3-4ec8-9820-d279dac56001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a9d37e88-e13f-4e3e-ad8d-ba88d17a24cf tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16638f24-d4d3-4ec8-9820-d279dac56001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a9d37e88-e13f-4e3e-ad8d-ba88d17a24cf tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01508250-291a-4565-baad-23609d7273bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:30 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-a9d37e88-e13f-4e3e-ad8d-ba88d17a24cf tempest-CreateVolumesFromSnapshotTest-2066319807 None] Volume 4de67e6a-e496-42a7-80d3-812ef90a215c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4de67e6a-e496-42a7-80d3-812ef90a215c', 'volume_size': 1} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a9d37e88-e13f-4e3e-ad8d-ba88d17a24cf tempest-CreateVolumesFromSnapshotTest-2066319807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-9a2ef4b7-9a48-45e7-a56a-3450b222d1c9 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Created reservations ['3b7ff8d2-e2f8-4a3f-85d4-b70324c19196', 'c452ecb4-4605-4ef0-b2ca-2e7839296423', '50fa9623-d345-4690-bde1-9fd0cdb74b17', '25bd4c77-985d-48c2-8f49-df28ecc210f7'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-06c235ec-1922-4d01-8c16-04ed6a95e346 tempest-CinderUnicodeTest-1349351074 None] Lock "cinder-quobyte-d7f1a2cf-222e-4f6b-b1e5-a61e14b45ea8" acquired by "_delete_snapshot" :: waited 0.064s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-06c235ec-1922-4d01-8c16-04ed6a95e346 tempest-CinderUnicodeTest-1349351074 None] Deleting offline snapshot d7f1a2cf-222e-4f6b-b1e5-a61e14b45ea8 of volume 0d5f61b9-8b1f-4210-9d58-6989315d255e {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-06c235ec-1922-4d01-8c16-04ed6a95e346 tempest-CinderUnicodeTest-1349351074 None] snapshot_file for this snap is: volume-0d5f61b9-8b1f-4210-9d58-6989315d255e.d7f1a2cf-222e-4f6b-b1e5-a61e14b45ea8 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6b02d8-4d5a-4499-97c7-4072ab983772]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-06c235ec-1922-4d01-8c16-04ed6a95e346 tempest-CinderUnicodeTest-1349351074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e.d7f1a2cf-222e-4f6b-b1e5-a61e14b45ea8 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-dcb5f500-7cd5-4fbd-af23-7ffa469e3176 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:30 devstack sudo[105621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-dcb5f500-7cd5-4fbd-af23-7ffa469e3176 Sep 03 11:31:30 devstack sudo[105621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9a2ef4b7-9a48-45e7-a56a-3450b222d1c9 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9a2ef4b7-9a48-45e7-a56a-3450b222d1c9 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-9a2ef4b7-9a48-45e7-a56a-3450b222d1c9 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-9a2ef4b7-9a48-45e7-a56a-3450b222d1c9 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9a2ef4b7-9a48-45e7-a56a-3450b222d1c9 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9a2ef4b7-9a48-45e7-a56a-3450b222d1c9 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:30 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:31:30 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e.d7f1a2cf-222e-4f6b-b1e5-a61e14b45ea8 Sep 03 11:31:30 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:30 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:30 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-1047cdfb-0f38-489b-b32a-62978b7e8a03 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1047cdfb-0f38-489b-b32a-62978b7e8a03 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Flow 'volume_create_manager' (5a3bd206-c7cd-49b9-9481-188491e99fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1047cdfb-0f38-489b-b32a-62978b7e8a03 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34f5edcc-9ac7-499f-a947-81dd5b398753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1047cdfb-0f38-489b-b32a-62978b7e8a03 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34f5edcc-9ac7-499f-a947-81dd5b398753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1209496925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7671b51-3afe-4a64-b37d-0442e6e5d725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='277eb90f50004faa903c51161079a23c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:31Z,use_quota=True,user_id='0a4310dc1f0d4895b79d13aa5fe5c14f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1047cdfb-0f38-489b-b32a-62978b7e8a03 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (647b6446-172f-482f-8ef5-a78b744ede05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1047cdfb-0f38-489b-b32a-62978b7e8a03 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (647b6446-172f-482f-8ef5-a78b744ede05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1047cdfb-0f38-489b-b32a-62978b7e8a03 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (800bc832-56b1-43fe-8b50-829278dd77eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1047cdfb-0f38-489b-b32a-62978b7e8a03 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (800bc832-56b1-43fe-8b50-829278dd77eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7671b51-3afe-4a64-b37d-0442e6e5d725', 'volume_name': 'volume-e7671b51-3afe-4a64-b37d-0442e6e5d725', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1047cdfb-0f38-489b-b32a-62978b7e8a03 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db4989f-5753-475b-bfd7-b8a84347b70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1047cdfb-0f38-489b-b32a-62978b7e8a03 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0db4989f-5753-475b-bfd7-b8a84347b70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1047cdfb-0f38-489b-b32a-62978b7e8a03 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ac8fde0-6a85-4282-81a8-18974b9f2b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:31 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-1047cdfb-0f38-489b-b32a-62978b7e8a03 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Volume e7671b51-3afe-4a64-b37d-0442e6e5d725: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7671b51-3afe-4a64-b37d-0442e6e5d725', 'volume_size': 1} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1047cdfb-0f38-489b-b32a-62978b7e8a03 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:31 devstack sudo[105621]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-dcb5f500-7cd5-4fbd-af23-7ffa469e3176" returned: 0 in 0.332s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-07e5a247-5bb3-44c4-9a72-51dbab6a7809 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.663s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-07e5a247-5bb3-44c4-9a72-51dbab6a7809 tempest-CreateVolumesFromSnapshotTest-2066319807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-504331456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dea2bf5-d1c6-4b13-8257-5f2fb813f458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='277eb90f50004faa903c51161079a23c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:29Z,use_quota=True,user_id='0a4310dc1f0d4895b79d13aa5fe5c14f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-07e5a247-5bb3-44c4-9a72-51dbab6a7809 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Creating volume 8dea2bf5-d1c6-4b13-8257-5f2fb813f458 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-07e5a247-5bb3-44c4-9a72-51dbab6a7809 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-07e5a247-5bb3-44c4-9a72-51dbab6a7809 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-07e5a247-5bb3-44c4-9a72-51dbab6a7809 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-07e5a247-5bb3-44c4-9a72-51dbab6a7809 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-07e5a247-5bb3-44c4-9a72-51dbab6a7809 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-07e5a247-5bb3-44c4-9a72-51dbab6a7809 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:31:31 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-07e5a247-5bb3-44c4-9a72-51dbab6a7809 tempest-CreateVolumesFromSnapshotTest-2066319807 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-07e5a247-5bb3-44c4-9a72-51dbab6a7809 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8dea2bf5-d1c6-4b13-8257-5f2fb813f458 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:31 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8dea2bf5-d1c6-4b13-8257-5f2fb813f458 1073741824 Sep 03 11:31:31 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:31 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG cinder.volume.volume_utils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Attempting download of 4b1b7596-9bae-476b-a48d-c3f9aa0969c7 ((None, [{'url': 'file:///opt/stack/data/glance/images/4b1b7596-9bae-476b-a48d-c3f9aa0969c7', 'metadata': {}}])) to volume dcb5f500-7cd5-4fbd-af23-7ffa469e3176. {{(pid=87038) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9a2ef4b7-9a48-45e7-a56a-3450b222d1c9 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.299s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-9a2ef4b7-9a48-45e7-a56a-3450b222d1c9 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:31:31 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-9a2ef4b7-9a48-45e7-a56a-3450b222d1c9 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Deleted volume successfully. Sep 03 11:31:31 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-06c235ec-1922-4d01-8c16-04ed6a95e346 tempest-CinderUnicodeTest-1349351074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e.d7f1a2cf-222e-4f6b-b1e5-a61e14b45ea8" returned: 0 in 0.441s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-06c235ec-1922-4d01-8c16-04ed6a95e346 tempest-CinderUnicodeTest-1349351074 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d5f61b9-8b1f-4210-9d58-6989315d255e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-9a2ef4b7-9a48-45e7-a56a-3450b222d1c9 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "cinder-5b6a0d30-3bfb-42ff-995f-73cb505889c1-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c61a44d-2286-4f7d-9239-d7c18b99ade0]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-06c235ec-1922-4d01-8c16-04ed6a95e346 tempest-CinderUnicodeTest-1349351074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[694f42b1-77f0-47de-8726-d813ce1a1376]: (4, 'raw') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b1b7596-9bae-476b-a48d-c3f9aa0969c7_2_hw9if4 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:31 devstack sudo[105633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e Sep 03 11:31:31 devstack sudo[105633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:31 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b1b7596-9bae-476b-a48d-c3f9aa0969c7_2_hw9if4 Sep 03 11:31:31 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:31 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-07e5a247-5bb3-44c4-9a72-51dbab6a7809 tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8dea2bf5-d1c6-4b13-8257-5f2fb813f458 1073741824" returned: 0 in 0.442s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:31 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4b1b7596-9bae-476b-a48d-c3f9aa0969c7_2_hw9if4" returned: 0 in 0.348s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b1b7596-9bae-476b-a48d-c3f9aa0969c7_2_hw9if4 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-07e5a247-5bb3-44c4-9a72-51dbab6a7809 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8dea2bf5-d1c6-4b13-8257-5f2fb813f458 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:31 devstack sudo[105633]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-06c235ec-1922-4d01-8c16-04ed6a95e346 tempest-CinderUnicodeTest-1349351074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e" returned: 0 in 0.423s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-06c235ec-1922-4d01-8c16-04ed6a95e346 tempest-CinderUnicodeTest-1349351074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e.d7f1a2cf-222e-4f6b-b1e5-a61e14b45ea8 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:31 devstack sudo[105648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8dea2bf5-d1c6-4b13-8257-5f2fb813f458 Sep 03 11:31:31 devstack sudo[105648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:31 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e.d7f1a2cf-222e-4f6b-b1e5-a61e14b45ea8 Sep 03 11:31:31 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:31 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b1b7596-9bae-476b-a48d-c3f9aa0969c7_2_hw9if4 Sep 03 11:31:31 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e62136f0-af63-4837-97f4-d6107ffd7a3d tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Acquiring lock "cinder-6ed0050f-301e-4d21-94ce-5ca858e47ba0-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e62136f0-af63-4837-97f4-d6107ffd7a3d tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "cinder-6ed0050f-301e-4d21-94ce-5ca858e47ba0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e62136f0-af63-4837-97f4-d6107ffd7a3d tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Acquiring lock "cinder-quobyte-6ed0050f-301e-4d21-94ce-5ca858e47ba0" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e62136f0-af63-4837-97f4-d6107ffd7a3d tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "cinder-quobyte-6ed0050f-301e-4d21-94ce-5ca858e47ba0" acquired by "delete_volume" :: waited 0.018s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff4051a-a669-4d8c-9ca6-2ca6a2a43151]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e62136f0-af63-4837-97f4-d6107ffd7a3d tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6ed0050f-301e-4d21-94ce-5ca858e47ba0 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:31 devstack sudo[105648]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-07e5a247-5bb3-44c4-9a72-51dbab6a7809 tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8dea2bf5-d1c6-4b13-8257-5f2fb813f458" returned: 0 in 0.307s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-07e5a247-5bb3-44c4-9a72-51dbab6a7809 tempest-CreateVolumesFromSnapshotTest-2066319807 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-07e5a247-5bb3-44c4-9a72-51dbab6a7809 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5ba75fdc-0e10-416d-ba10-91d986eaf650 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.120s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5ba75fdc-0e10-416d-ba10-91d986eaf650 tempest-CreateVolumesFromSnapshotTest-2066319807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1087955299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64b7fc7f-f7b0-4f07-9d8b-9508eca975bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='277eb90f50004faa903c51161079a23c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:30Z,use_quota=True,user_id='0a4310dc1f0d4895b79d13aa5fe5c14f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-5ba75fdc-0e10-416d-ba10-91d986eaf650 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Creating volume 64b7fc7f-f7b0-4f07-9d8b-9508eca975bb {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5ba75fdc-0e10-416d-ba10-91d986eaf650 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5ba75fdc-0e10-416d-ba10-91d986eaf650 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5ba75fdc-0e10-416d-ba10-91d986eaf650 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5ba75fdc-0e10-416d-ba10-91d986eaf650 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5ba75fdc-0e10-416d-ba10-91d986eaf650 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5ba75fdc-0e10-416d-ba10-91d986eaf650 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:31:31 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-5ba75fdc-0e10-416d-ba10-91d986eaf650 tempest-CreateVolumesFromSnapshotTest-2066319807 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:31:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5ba75fdc-0e10-416d-ba10-91d986eaf650 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-64b7fc7f-f7b0-4f07-9d8b-9508eca975bb 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-07e5a247-5bb3-44c4-9a72-51dbab6a7809 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (562b1009-839f-47cf-8746-3dd3c6d48284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dea2bf5-d1c6-4b13-8257-5f2fb813f458', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:32 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-64b7fc7f-f7b0-4f07-9d8b-9508eca975bb 1073741824 Sep 03 11:31:32 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-07e5a247-5bb3-44c4-9a72-51dbab6a7809 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdbf98aa-6ea7-41ee-a691-5740d9b9f12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:32 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-07e5a247-5bb3-44c4-9a72-51dbab6a7809 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Volume volume-8dea2bf5-d1c6-4b13-8257-5f2fb813f458 (8dea2bf5-d1c6-4b13-8257-5f2fb813f458): created successfully Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-07e5a247-5bb3-44c4-9a72-51dbab6a7809 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdbf98aa-6ea7-41ee-a691-5740d9b9f12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:32 devstack sudo[105654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6ed0050f-301e-4d21-94ce-5ca858e47ba0 Sep 03 11:31:32 devstack sudo[105654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:32 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-07e5a247-5bb3-44c4-9a72-51dbab6a7809 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Flow 'volume_create_manager' (28afe064-bc3a-4e7f-904c-6d0f66ae0b21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b1b7596-9bae-476b-a48d-c3f9aa0969c7_2_hw9if4" returned: 1 in 0.444s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4b1b7596-9bae-476b-a48d-c3f9aa0969c7_2_hw9if4' failed. Not Retrying. {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[c012ace8-f865-4fc7-826e-5aef85a48cc8]: (4, 'raw') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b1b7596-9bae-476b-a48d-c3f9aa0969c7_ueo8rhbedevstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:32 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-07e5a247-5bb3-44c4-9a72-51dbab6a7809 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Created volume successfully. Sep 03 11:31:32 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-06c235ec-1922-4d01-8c16-04ed6a95e346 tempest-CinderUnicodeTest-1349351074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e.d7f1a2cf-222e-4f6b-b1e5-a61e14b45ea8" returned: 0 in 0.481s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-06c235ec-1922-4d01-8c16-04ed6a95e346 tempest-CinderUnicodeTest-1349351074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e.d7f1a2cf-222e-4f6b-b1e5-a61e14b45ea8 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:32 devstack sudo[105664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e.d7f1a2cf-222e-4f6b-b1e5-a61e14b45ea8 Sep 03 11:31:32 devstack sudo[105664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:32 devstack sudo[105663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b1b7596-9bae-476b-a48d-c3f9aa0969c7_ueo8rhbedevstack@QuobyteHD Sep 03 11:31:32 devstack sudo[105663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:32 devstack sudo[105654]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e62136f0-af63-4837-97f4-d6107ffd7a3d tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6ed0050f-301e-4d21-94ce-5ca858e47ba0" returned: 0 in 0.501s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e62136f0-af63-4837-97f4-d6107ffd7a3d tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6ed0050f-301e-4d21-94ce-5ca858e47ba0 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:32 devstack sudo[105674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6ed0050f-301e-4d21-94ce-5ca858e47ba0 Sep 03 11:31:32 devstack sudo[105674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:32 devstack sudo[105664]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:32 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-06c235ec-1922-4d01-8c16-04ed6a95e346 tempest-CinderUnicodeTest-1349351074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e.d7f1a2cf-222e-4f6b-b1e5-a61e14b45ea8" returned: 0 in 0.320s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5ba75fdc-0e10-416d-ba10-91d986eaf650 tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-64b7fc7f-f7b0-4f07-9d8b-9508eca975bb 1073741824" returned: 0 in 0.519s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:32 devstack sudo[105663]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_4b1b7596-9bae-476b-a48d-c3f9aa0969c7_ueo8rhbedevstack@QuobyteHD" returned: 0 in 0.466s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b1b7596-9bae-476b-a48d-c3f9aa0969c7_ueo8rhbedevstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-06c235ec-1922-4d01-8c16-04ed6a95e346 tempest-CinderUnicodeTest-1349351074 None] Lock "cinder-quobyte-d7f1a2cf-222e-4f6b-b1e5-a61e14b45ea8" released by "_delete_snapshot" :: held 1.826s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-06c235ec-1922-4d01-8c16-04ed6a95e346 tempest-CinderUnicodeTest-1349351074 None] Lock "cinder-quobyte-0d5f61b9-8b1f-4210-9d58-6989315d255e" released by "delete_snapshot" :: held 1.913s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5ba75fdc-0e10-416d-ba10-91d986eaf650 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-64b7fc7f-f7b0-4f07-9d8b-9508eca975bb {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:32 devstack sudo[105680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-64b7fc7f-f7b0-4f07-9d8b-9508eca975bb Sep 03 11:31:32 devstack sudo[105680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:32 devstack sudo[105679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b1b7596-9bae-476b-a48d-c3f9aa0969c7_ueo8rhbedevstack@QuobyteHD Sep 03 11:31:32 devstack sudo[105679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-06c235ec-1922-4d01-8c16-04ed6a95e346 tempest-CinderUnicodeTest-1349351074 None] Created reservations ['013af635-240e-412b-9f89-e9eca9f868a3', '74c81e66-db8a-43e9-8c8d-1df920b32e15', '4eb62682-1173-4261-a8c9-1614c6d3d720', '5267d455-f8c1-485c-a6c9-182412a8cf84'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:31:32 devstack sudo[105674]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e62136f0-af63-4837-97f4-d6107ffd7a3d tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6ed0050f-301e-4d21-94ce-5ca858e47ba0" returned: 0 in 0.337s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e62136f0-af63-4837-97f4-d6107ffd7a3d tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "cinder-quobyte-6ed0050f-301e-4d21-94ce-5ca858e47ba0" released by "delete_volume" :: held 0.883s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:32 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-06c235ec-1922-4d01-8c16-04ed6a95e346 tempest-CinderUnicodeTest-1349351074 None] Delete snapshot completed successfully. Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-06c235ec-1922-4d01-8c16-04ed6a95e346 tempest-CinderUnicodeTest-1349351074 None] Lock "cinder-d7f1a2cf-222e-4f6b-b1e5-a61e14b45ea8-delete_snapshot" released by "delete_snapshot" :: held 2.203s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-e62136f0-af63-4837-97f4-d6107ffd7a3d tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Created reservations ['d3aa492c-eaa8-409f-bb27-183b7db0eb26', '25ea677d-c66f-4b5a-8420-df9e5ef1bd3b', '6eb248eb-1a7a-4c23-894d-511930ce6e5d', '64ab64b7-abba-47ea-a528-efaba515b9d8'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:31:32 devstack sudo[105680]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5ba75fdc-0e10-416d-ba10-91d986eaf650 tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-64b7fc7f-f7b0-4f07-9d8b-9508eca975bb" returned: 0 in 0.310s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e62136f0-af63-4837-97f4-d6107ffd7a3d tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e62136f0-af63-4837-97f4-d6107ffd7a3d tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e62136f0-af63-4837-97f4-d6107ffd7a3d tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e62136f0-af63-4837-97f4-d6107ffd7a3d tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e62136f0-af63-4837-97f4-d6107ffd7a3d tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e62136f0-af63-4837-97f4-d6107ffd7a3d tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:32 devstack sudo[105679]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5ba75fdc-0e10-416d-ba10-91d986eaf650 tempest-CreateVolumesFromSnapshotTest-2066319807 None] <== create_volume: return (976ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5ba75fdc-0e10-416d-ba10-91d986eaf650 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5bdb4ccc-5f81-44e4-bf03-db5d8d01090e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.747s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5bdb4ccc-5f81-44e4-bf03-db5d8d01090e tempest-CreateVolumesFromSnapshotTest-2066319807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1441007417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d18fc2cb-521d-4359-a10e-1196562f49c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='277eb90f50004faa903c51161079a23c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:30Z,use_quota=True,user_id='0a4310dc1f0d4895b79d13aa5fe5c14f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-5bdb4ccc-5f81-44e4-bf03-db5d8d01090e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Creating volume d18fc2cb-521d-4359-a10e-1196562f49c6 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5bdb4ccc-5f81-44e4-bf03-db5d8d01090e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5bdb4ccc-5f81-44e4-bf03-db5d8d01090e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5bdb4ccc-5f81-44e4-bf03-db5d8d01090e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:32 devstack sudo[105688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:31:32 devstack sudo[105688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5bdb4ccc-5f81-44e4-bf03-db5d8d01090e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5bdb4ccc-5f81-44e4-bf03-db5d8d01090e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5bdb4ccc-5f81-44e4-bf03-db5d8d01090e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:31:32 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-5bdb4ccc-5f81-44e4-bf03-db5d8d01090e tempest-CreateVolumesFromSnapshotTest-2066319807 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:31:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5bdb4ccc-5f81-44e4-bf03-db5d8d01090e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d18fc2cb-521d-4359-a10e-1196562f49c6 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b1b7596-9bae-476b-a48d-c3f9aa0969c7_ueo8rhbedevstack@QuobyteHD" returned: 1 in 0.457s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_4b1b7596-9bae-476b-a48d-c3f9aa0969c7_ueo8rhbedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] 4b1b7596-9bae-476b-a48d-c3f9aa0969c7 was raw, converting to qcow2 {{(pid=87038) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4b1b7596-9bae-476b-a48d-c3f9aa0969c7_ueo8rhbedevstack@QuobyteHD /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-dcb5f500-7cd5-4fbd-af23-7ffa469e3176 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:33 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d18fc2cb-521d-4359-a10e-1196562f49c6 1073741824 Sep 03 11:31:33 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5ba75fdc-0e10-416d-ba10-91d986eaf650 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c85a1045-da1e-4026-8e35-19183f2bfa76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64b7fc7f-f7b0-4f07-9d8b-9508eca975bb', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:33 devstack sudo[105692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4b1b7596-9bae-476b-a48d-c3f9aa0969c7_ueo8rhbedevstack@QuobyteHD /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-dcb5f500-7cd5-4fbd-af23-7ffa469e3176 Sep 03 11:31:33 devstack sudo[105692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5ba75fdc-0e10-416d-ba10-91d986eaf650 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (245b8b2d-4283-4135-a54a-1a2ae8524b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-de2796af-735e-47ed-b73a-48e6e6cbe596 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Acquiring lock "cinder-2dc7a26f-15db-42dc-95fc-16bc0e6ea6f2-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:33 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-5ba75fdc-0e10-416d-ba10-91d986eaf650 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Volume volume-64b7fc7f-f7b0-4f07-9d8b-9508eca975bb (64b7fc7f-f7b0-4f07-9d8b-9508eca975bb): created successfully Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5ba75fdc-0e10-416d-ba10-91d986eaf650 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (245b8b2d-4283-4135-a54a-1a2ae8524b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5ba75fdc-0e10-416d-ba10-91d986eaf650 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Flow 'volume_create_manager' (25c7247c-edb1-441b-adc2-85b75efc9c32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-de2796af-735e-47ed-b73a-48e6e6cbe596 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "cinder-2dc7a26f-15db-42dc-95fc-16bc0e6ea6f2-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:33 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-5ba75fdc-0e10-416d-ba10-91d986eaf650 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Created volume successfully. Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-de2796af-735e-47ed-b73a-48e6e6cbe596 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Acquiring lock "cinder-quobyte-2dc7a26f-15db-42dc-95fc-16bc0e6ea6f2" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-de2796af-735e-47ed-b73a-48e6e6cbe596 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "cinder-quobyte-2dc7a26f-15db-42dc-95fc-16bc0e6ea6f2" acquired by "delete_volume" :: waited 0.021s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:33 devstack sudo[105688]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d4b2f84-71fd-40cb-ac91-74dc72cb9fe9]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-de2796af-735e-47ed-b73a-48e6e6cbe596 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2dc7a26f-15db-42dc-95fc-16bc0e6ea6f2 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e62136f0-af63-4837-97f4-d6107ffd7a3d tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.354s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-e62136f0-af63-4837-97f4-d6107ffd7a3d tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:31:33 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-e62136f0-af63-4837-97f4-d6107ffd7a3d tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Deleted volume successfully. Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e62136f0-af63-4837-97f4-d6107ffd7a3d tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "cinder-6ed0050f-301e-4d21-94ce-5ca858e47ba0-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:33 devstack sudo[105695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2dc7a26f-15db-42dc-95fc-16bc0e6ea6f2 Sep 03 11:31:33 devstack sudo[105695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:33 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5bdb4ccc-5f81-44e4-bf03-db5d8d01090e tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d18fc2cb-521d-4359-a10e-1196562f49c6 1073741824" returned: 0 in 0.550s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5bdb4ccc-5f81-44e4-bf03-db5d8d01090e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d18fc2cb-521d-4359-a10e-1196562f49c6 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:33 devstack sudo[105692]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_4b1b7596-9bae-476b-a48d-c3f9aa0969c7_ueo8rhbedevstack@QuobyteHD /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-dcb5f500-7cd5-4fbd-af23-7ffa469e3176" returned: 0 in 0.556s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4b1b7596-9bae-476b-a48d-c3f9aa0969c7_ueo8rhbedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-dcb5f500-7cd5-4fbd-af23-7ffa469e3176 {{(pid=87038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:31:33 devstack cinder-volume[87038]: INFO cinder.image.image_utils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Converted 0.00 MB image at 0.00 MB/s Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-dcb5f500-7cd5-4fbd-af23-7ffa469e3176 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:33 devstack sudo[105705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d18fc2cb-521d-4359-a10e-1196562f49c6 Sep 03 11:31:33 devstack sudo[105705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:33 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-dcb5f500-7cd5-4fbd-af23-7ffa469e3176 1G Sep 03 11:31:33 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:33 devstack sudo[105695]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-de2796af-735e-47ed-b73a-48e6e6cbe596 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2dc7a26f-15db-42dc-95fc-16bc0e6ea6f2" returned: 0 in 0.439s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-de2796af-735e-47ed-b73a-48e6e6cbe596 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2dc7a26f-15db-42dc-95fc-16bc0e6ea6f2 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:33 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2dc7a26f-15db-42dc-95fc-16bc0e6ea6f2 Sep 03 11:31:33 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-911d60a0-3392-4c48-aaec-b544dd086155 tempest-CinderUnicodeTest-1349351074 None] Acquiring lock "cinder-0d5f61b9-8b1f-4210-9d58-6989315d255e-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-911d60a0-3392-4c48-aaec-b544dd086155 tempest-CinderUnicodeTest-1349351074 None] Lock "cinder-0d5f61b9-8b1f-4210-9d58-6989315d255e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-911d60a0-3392-4c48-aaec-b544dd086155 tempest-CinderUnicodeTest-1349351074 None] Acquiring lock "cinder-quobyte-0d5f61b9-8b1f-4210-9d58-6989315d255e" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:33 devstack sudo[105705]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5bdb4ccc-5f81-44e4-bf03-db5d8d01090e tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d18fc2cb-521d-4359-a10e-1196562f49c6" returned: 0 in 0.312s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5bdb4ccc-5f81-44e4-bf03-db5d8d01090e tempest-CreateVolumesFromSnapshotTest-2066319807 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5bdb4ccc-5f81-44e4-bf03-db5d8d01090e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a9d37e88-e13f-4e3e-ad8d-ba88d17a24cf tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.156s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a9d37e88-e13f-4e3e-ad8d-ba88d17a24cf tempest-CreateVolumesFromSnapshotTest-2066319807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2101448938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4de67e6a-e496-42a7-80d3-812ef90a215c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='277eb90f50004faa903c51161079a23c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:30Z,use_quota=True,user_id='0a4310dc1f0d4895b79d13aa5fe5c14f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-a9d37e88-e13f-4e3e-ad8d-ba88d17a24cf tempest-CreateVolumesFromSnapshotTest-2066319807 None] Creating volume 4de67e6a-e496-42a7-80d3-812ef90a215c {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a9d37e88-e13f-4e3e-ad8d-ba88d17a24cf tempest-CreateVolumesFromSnapshotTest-2066319807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a9d37e88-e13f-4e3e-ad8d-ba88d17a24cf tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a9d37e88-e13f-4e3e-ad8d-ba88d17a24cf tempest-CreateVolumesFromSnapshotTest-2066319807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a9d37e88-e13f-4e3e-ad8d-ba88d17a24cf tempest-CreateVolumesFromSnapshotTest-2066319807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a9d37e88-e13f-4e3e-ad8d-ba88d17a24cf tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a9d37e88-e13f-4e3e-ad8d-ba88d17a24cf tempest-CreateVolumesFromSnapshotTest-2066319807 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:31:33 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-a9d37e88-e13f-4e3e-ad8d-ba88d17a24cf tempest-CreateVolumesFromSnapshotTest-2066319807 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a9d37e88-e13f-4e3e-ad8d-ba88d17a24cf tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4de67e6a-e496-42a7-80d3-812ef90a215c 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5bdb4ccc-5f81-44e4-bf03-db5d8d01090e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54c80c31-f40a-4d93-837d-ba1d159e346b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d18fc2cb-521d-4359-a10e-1196562f49c6', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:33 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4de67e6a-e496-42a7-80d3-812ef90a215c 1073741824 Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5bdb4ccc-5f81-44e4-bf03-db5d8d01090e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (329066bc-5491-44cd-8026-7bebb7452c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:33 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-911d60a0-3392-4c48-aaec-b544dd086155 tempest-CinderUnicodeTest-1349351074 None] Lock "cinder-quobyte-0d5f61b9-8b1f-4210-9d58-6989315d255e" acquired by "delete_volume" :: waited 0.072s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:33 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-dcb5f500-7cd5-4fbd-af23-7ffa469e3176 1G" returned: 0 in 0.396s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG cinder.volume.volume_utils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Downloaded image 4b1b7596-9bae-476b-a48d-c3f9aa0969c7 ((None, [{'url': 'file:///opt/stack/data/glance/images/4b1b7596-9bae-476b-a48d-c3f9aa0969c7', 'metadata': {}}])) to volume dcb5f500-7cd5-4fbd-af23-7ffa469e3176 successfully. {{(pid=87038) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Temporary image 4b1b7596-9bae-476b-a48d-c3f9aa0969c7 for user b387ed421509412c97cb0ab458de5d95 is deleted. {{(pid=87038) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG cinder.volume.volume_utils [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Marking volume dcb5f500-7cd5-4fbd-af23-7ffa469e3176 as bootable. {{(pid=87038) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22352f7-726d-4f2a-a693-3adee36ac2d7]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-911d60a0-3392-4c48-aaec-b544dd086155 tempest-CinderUnicodeTest-1349351074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:34 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-5bdb4ccc-5f81-44e4-bf03-db5d8d01090e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Volume volume-d18fc2cb-521d-4359-a10e-1196562f49c6 (d18fc2cb-521d-4359-a10e-1196562f49c6): created successfully Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5bdb4ccc-5f81-44e4-bf03-db5d8d01090e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (329066bc-5491-44cd-8026-7bebb7452c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5bdb4ccc-5f81-44e4-bf03-db5d8d01090e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Flow 'volume_create_manager' (add3984f-b1e5-45d5-bffa-47961c100a94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:34 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-de2796af-735e-47ed-b73a-48e6e6cbe596 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2dc7a26f-15db-42dc-95fc-16bc0e6ea6f2" returned: 0 in 0.302s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Copying metadata from image 4b1b7596-9bae-476b-a48d-c3f9aa0969c7 to dcb5f500-7cd5-4fbd-af23-7ffa469e3176. {{(pid=87038) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Creating volume glance metadata for volume dcb5f500-7cd5-4fbd-af23-7ffa469e3176 backed by image 4b1b7596-9bae-476b-a48d-c3f9aa0969c7 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '4b1b7596-9bae-476b-a48d-c3f9aa0969c7', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '3633e444fa91dd2c9bb1cfde120a1030', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87038) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 11:31:34 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-5bdb4ccc-5f81-44e4-bf03-db5d8d01090e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Created volume successfully. Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-de2796af-735e-47ed-b73a-48e6e6cbe596 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "cinder-quobyte-2dc7a26f-15db-42dc-95fc-16bc0e6ea6f2" released by "delete_volume" :: held 0.810s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:34 devstack sudo[105724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e Sep 03 11:31:34 devstack sudo[105724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-de2796af-735e-47ed-b73a-48e6e6cbe596 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Created reservations ['b37bf18b-8bb1-40f9-9b4d-cb1055d12d8c', '48d1e14f-ff20-4d5e-972a-e4456ce2c9a6', '2b811e00-23ff-4499-9418-e384e2d51cf6', '7e16098a-47f2-4769-a618-87a4d180773c'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7555a84-e183-45c1-8157-917da7687b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcb5f500-7cd5-4fbd-af23-7ffa469e3176', 'volume_size': 1, 'image_id': '4b1b7596-9bae-476b-a48d-c3f9aa0969c7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4b1b7596-9bae-476b-a48d-c3f9aa0969c7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '3633e444fa91dd2c9bb1cfde120a1030', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cd46f0cbce1345459333210a1d785473', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '5a0c0301bcae32f4fd0fcdd63c14c03a1fa628b561537bc7043a1dee73e84f9e984a61588c716053694c31bc7fd9683b58750b30b25effdd256b3ab23915cc07', 'id': '4b1b7596-9bae-476b-a48d-c3f9aa0969c7', 'created_at': datetime.datetime(2026, 9, 3, 9, 31, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 31, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4b1b7596-9bae-476b-a48d-c3f9aa0969c7/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5980a41-29f0-48a7-8dc5-87647729b7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:34 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Volume volume-dcb5f500-7cd5-4fbd-af23-7ffa469e3176 (dcb5f500-7cd5-4fbd-af23-7ffa469e3176): created successfully Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5980a41-29f0-48a7-8dc5-87647729b7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Flow 'volume_create_manager' (4a24ed9c-a8de-45da-b95c-70ad3838a4ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:34 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-af3c9ac9-5f9e-4293-a4c5-94528be3a7a4 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Created volume successfully. Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-de2796af-735e-47ed-b73a-48e6e6cbe596 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-de2796af-735e-47ed-b73a-48e6e6cbe596 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-de2796af-735e-47ed-b73a-48e6e6cbe596 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-de2796af-735e-47ed-b73a-48e6e6cbe596 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-de2796af-735e-47ed-b73a-48e6e6cbe596 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-de2796af-735e-47ed-b73a-48e6e6cbe596 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:34 devstack sudo[105729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:31:34 devstack sudo[105729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f20fb286-ddfd-48dc-a447-f1796f5f61bd tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Acquiring lock "cinder-1e59ae1f-b054-40fa-a465-902cd6d6d00f-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f20fb286-ddfd-48dc-a447-f1796f5f61bd tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "cinder-1e59ae1f-b054-40fa-a465-902cd6d6d00f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f20fb286-ddfd-48dc-a447-f1796f5f61bd tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Acquiring lock "cinder-quobyte-1e59ae1f-b054-40fa-a465-902cd6d6d00f" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:34 devstack sudo[105724]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f20fb286-ddfd-48dc-a447-f1796f5f61bd tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "cinder-quobyte-1e59ae1f-b054-40fa-a465-902cd6d6d00f" acquired by "delete_volume" :: waited 0.029s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4bf16bf2-cfbc-412c-afa6-5e8073b36366 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Acquiring lock "cinder-dcb5f500-7cd5-4fbd-af23-7ffa469e3176-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-911d60a0-3392-4c48-aaec-b544dd086155 tempest-CinderUnicodeTest-1349351074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e" returned: 0 in 0.564s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-911d60a0-3392-4c48-aaec-b544dd086155 tempest-CinderUnicodeTest-1349351074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c182cf-9736-4b54-aac6-81242d90547d]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f20fb286-ddfd-48dc-a447-f1796f5f61bd tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1e59ae1f-b054-40fa-a465-902cd6d6d00f {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:34 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e Sep 03 11:31:34 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4bf16bf2-cfbc-412c-afa6-5e8073b36366 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Lock "cinder-dcb5f500-7cd5-4fbd-af23-7ffa469e3176-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:34 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a9d37e88-e13f-4e3e-ad8d-ba88d17a24cf tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4de67e6a-e496-42a7-80d3-812ef90a215c 1073741824" returned: 0 in 0.732s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:34 devstack sudo[105729]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-de2796af-735e-47ed-b73a-48e6e6cbe596 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.397s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-de2796af-735e-47ed-b73a-48e6e6cbe596 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4bf16bf2-cfbc-412c-afa6-5e8073b36366 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Acquiring lock "cinder-quobyte-dcb5f500-7cd5-4fbd-af23-7ffa469e3176" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a9d37e88-e13f-4e3e-ad8d-ba88d17a24cf tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4de67e6a-e496-42a7-80d3-812ef90a215c {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:34 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-de2796af-735e-47ed-b73a-48e6e6cbe596 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Deleted volume successfully. Sep 03 11:31:34 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1e59ae1f-b054-40fa-a465-902cd6d6d00f Sep 03 11:31:34 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:34 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4de67e6a-e496-42a7-80d3-812ef90a215c Sep 03 11:31:34 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4bf16bf2-cfbc-412c-afa6-5e8073b36366 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Lock "cinder-quobyte-dcb5f500-7cd5-4fbd-af23-7ffa469e3176" acquired by "delete_volume" :: waited 0.047s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-de2796af-735e-47ed-b73a-48e6e6cbe596 tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "cinder-2dc7a26f-15db-42dc-95fc-16bc0e6ea6f2-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7db4501-edaf-4c8a-8414-a8ba60b0c098]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4bf16bf2-cfbc-412c-afa6-5e8073b36366 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-dcb5f500-7cd5-4fbd-af23-7ffa469e3176 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:34 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-911d60a0-3392-4c48-aaec-b544dd086155 tempest-CinderUnicodeTest-1349351074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-0d5f61b9-8b1f-4210-9d58-6989315d255e" returned: 0 in 0.322s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:34 devstack sudo[105742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-dcb5f500-7cd5-4fbd-af23-7ffa469e3176 Sep 03 11:31:34 devstack sudo[105742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-911d60a0-3392-4c48-aaec-b544dd086155 tempest-CinderUnicodeTest-1349351074 None] Lock "cinder-quobyte-0d5f61b9-8b1f-4210-9d58-6989315d255e" released by "delete_volume" :: held 0.971s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:34 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a9d37e88-e13f-4e3e-ad8d-ba88d17a24cf tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4de67e6a-e496-42a7-80d3-812ef90a215c" returned: 0 in 0.286s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a9d37e88-e13f-4e3e-ad8d-ba88d17a24cf tempest-CreateVolumesFromSnapshotTest-2066319807 None] <== create_volume: return (1092ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a9d37e88-e13f-4e3e-ad8d-ba88d17a24cf tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1047cdfb-0f38-489b-b32a-62978b7e8a03 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.904s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1047cdfb-0f38-489b-b32a-62978b7e8a03 tempest-CreateVolumesFromSnapshotTest-2066319807 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1209496925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7671b51-3afe-4a64-b37d-0442e6e5d725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='277eb90f50004faa903c51161079a23c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:31Z,use_quota=True,user_id='0a4310dc1f0d4895b79d13aa5fe5c14f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-1047cdfb-0f38-489b-b32a-62978b7e8a03 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Creating volume e7671b51-3afe-4a64-b37d-0442e6e5d725 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1047cdfb-0f38-489b-b32a-62978b7e8a03 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1047cdfb-0f38-489b-b32a-62978b7e8a03 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1047cdfb-0f38-489b-b32a-62978b7e8a03 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:34 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1047cdfb-0f38-489b-b32a-62978b7e8a03 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1047cdfb-0f38-489b-b32a-62978b7e8a03 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1047cdfb-0f38-489b-b32a-62978b7e8a03 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:31:34 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-1047cdfb-0f38-489b-b32a-62978b7e8a03 tempest-CreateVolumesFromSnapshotTest-2066319807 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:31:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1047cdfb-0f38-489b-b32a-62978b7e8a03 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e7671b51-3afe-4a64-b37d-0442e6e5d725 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f20fb286-ddfd-48dc-a447-f1796f5f61bd tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1e59ae1f-b054-40fa-a465-902cd6d6d00f" returned: 0 in 0.439s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f20fb286-ddfd-48dc-a447-f1796f5f61bd tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1e59ae1f-b054-40fa-a465-902cd6d6d00f {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:35 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e7671b51-3afe-4a64-b37d-0442e6e5d725 1073741824 Sep 03 11:31:35 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a9d37e88-e13f-4e3e-ad8d-ba88d17a24cf tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01508250-291a-4565-baad-23609d7273bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4de67e6a-e496-42a7-80d3-812ef90a215c', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a9d37e88-e13f-4e3e-ad8d-ba88d17a24cf tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b8e0330-d144-488e-8460-b61f6a3e2d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:35 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1e59ae1f-b054-40fa-a465-902cd6d6d00f Sep 03 11:31:35 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:35 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-a9d37e88-e13f-4e3e-ad8d-ba88d17a24cf tempest-CreateVolumesFromSnapshotTest-2066319807 None] Volume volume-4de67e6a-e496-42a7-80d3-812ef90a215c (4de67e6a-e496-42a7-80d3-812ef90a215c): created successfully Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a9d37e88-e13f-4e3e-ad8d-ba88d17a24cf tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b8e0330-d144-488e-8460-b61f6a3e2d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a9d37e88-e13f-4e3e-ad8d-ba88d17a24cf tempest-CreateVolumesFromSnapshotTest-2066319807 None] Flow 'volume_create_manager' (8b5d4186-303c-4d97-9373-0de4eeebdc49) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-911d60a0-3392-4c48-aaec-b544dd086155 tempest-CinderUnicodeTest-1349351074 None] Created reservations ['bdfebaf7-dabe-43e3-8dca-3b8b622df968', '215d46b2-0549-48ea-b0a1-1baccca05d60', 'a9c1689b-d790-40fc-9c5e-329327c7cf95', 'a1409eef-e909-454e-8a49-2976bf800aca'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:31:35 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-a9d37e88-e13f-4e3e-ad8d-ba88d17a24cf tempest-CreateVolumesFromSnapshotTest-2066319807 None] Created volume successfully. Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-911d60a0-3392-4c48-aaec-b544dd086155 tempest-CinderUnicodeTest-1349351074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-911d60a0-3392-4c48-aaec-b544dd086155 tempest-CinderUnicodeTest-1349351074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-911d60a0-3392-4c48-aaec-b544dd086155 tempest-CinderUnicodeTest-1349351074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-911d60a0-3392-4c48-aaec-b544dd086155 tempest-CinderUnicodeTest-1349351074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-911d60a0-3392-4c48-aaec-b544dd086155 tempest-CinderUnicodeTest-1349351074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-911d60a0-3392-4c48-aaec-b544dd086155 tempest-CinderUnicodeTest-1349351074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:35 devstack sudo[105742]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4bf16bf2-cfbc-412c-afa6-5e8073b36366 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-dcb5f500-7cd5-4fbd-af23-7ffa469e3176" returned: 0 in 0.422s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4bf16bf2-cfbc-412c-afa6-5e8073b36366 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-dcb5f500-7cd5-4fbd-af23-7ffa469e3176 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:35 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:31:35 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:35 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-dcb5f500-7cd5-4fbd-af23-7ffa469e3176 Sep 03 11:31:35 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:35 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f20fb286-ddfd-48dc-a447-f1796f5f61bd tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-1e59ae1f-b054-40fa-a465-902cd6d6d00f" returned: 0 in 0.341s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f20fb286-ddfd-48dc-a447-f1796f5f61bd tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "cinder-quobyte-1e59ae1f-b054-40fa-a465-902cd6d6d00f" released by "delete_volume" :: held 0.853s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:35 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-911d60a0-3392-4c48-aaec-b544dd086155 tempest-CinderUnicodeTest-1349351074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.266s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-911d60a0-3392-4c48-aaec-b544dd086155 tempest-CinderUnicodeTest-1349351074 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-f20fb286-ddfd-48dc-a447-f1796f5f61bd tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Created reservations ['76ccb418-aaa8-4279-9392-047eef7a8ca1', '92e2a49e-5914-42fc-a14a-38e5f6f3a8d1', 'bceb3fba-ae69-4f1d-af40-037f8347d8f6', '49336657-06cb-4c17-9762-74bce2b58c12'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:31:35 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-911d60a0-3392-4c48-aaec-b544dd086155 tempest-CinderUnicodeTest-1349351074 None] Deleted volume successfully. Sep 03 11:31:35 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:35 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4bf16bf2-cfbc-412c-afa6-5e8073b36366 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-dcb5f500-7cd5-4fbd-af23-7ffa469e3176" returned: 0 in 0.290s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-911d60a0-3392-4c48-aaec-b544dd086155 tempest-CinderUnicodeTest-1349351074 None] Lock "cinder-0d5f61b9-8b1f-4210-9d58-6989315d255e-delete_volume" released by "delete_volume" :: held 1.677s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1047cdfb-0f38-489b-b32a-62978b7e8a03 tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e7671b51-3afe-4a64-b37d-0442e6e5d725 1073741824" returned: 0 in 0.504s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4bf16bf2-cfbc-412c-afa6-5e8073b36366 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Lock "cinder-quobyte-dcb5f500-7cd5-4fbd-af23-7ffa469e3176" released by "delete_volume" :: held 0.780s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1047cdfb-0f38-489b-b32a-62978b7e8a03 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e7671b51-3afe-4a64-b37d-0442e6e5d725 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f20fb286-ddfd-48dc-a447-f1796f5f61bd tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f20fb286-ddfd-48dc-a447-f1796f5f61bd tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f20fb286-ddfd-48dc-a447-f1796f5f61bd tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f20fb286-ddfd-48dc-a447-f1796f5f61bd tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f20fb286-ddfd-48dc-a447-f1796f5f61bd tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f20fb286-ddfd-48dc-a447-f1796f5f61bd tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:35 devstack sudo[105770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e7671b51-3afe-4a64-b37d-0442e6e5d725 Sep 03 11:31:35 devstack sudo[105770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:35 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:31:35 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-4bf16bf2-cfbc-412c-afa6-5e8073b36366 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Created reservations ['1e12790d-5156-4bf3-89a2-3f24555ee298', '46cca21a-5de6-4f44-ac4b-dbd94ab51b0f', '1d8707d4-a8fb-4d4d-88ee-11ef2d332450', '7c682ad0-515d-4084-9c68-0179d314b2ec'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4bf16bf2-cfbc-412c-afa6-5e8073b36366 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4bf16bf2-cfbc-412c-afa6-5e8073b36366 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4bf16bf2-cfbc-412c-afa6-5e8073b36366 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4bf16bf2-cfbc-412c-afa6-5e8073b36366 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4bf16bf2-cfbc-412c-afa6-5e8073b36366 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4bf16bf2-cfbc-412c-afa6-5e8073b36366 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:35 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:31:35 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:35 devstack sudo[105770]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1047cdfb-0f38-489b-b32a-62978b7e8a03 tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e7671b51-3afe-4a64-b37d-0442e6e5d725" returned: 0 in 0.290s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1047cdfb-0f38-489b-b32a-62978b7e8a03 tempest-CreateVolumesFromSnapshotTest-2066319807 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1047cdfb-0f38-489b-b32a-62978b7e8a03 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1047cdfb-0f38-489b-b32a-62978b7e8a03 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ac8fde0-6a85-4282-81a8-18974b9f2b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7671b51-3afe-4a64-b37d-0442e6e5d725', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1047cdfb-0f38-489b-b32a-62978b7e8a03 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a711c9f-61a2-4a60-8612-cad68e26aec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:35 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f20fb286-ddfd-48dc-a447-f1796f5f61bd tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.289s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-f20fb286-ddfd-48dc-a447-f1796f5f61bd tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:31:35 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-f20fb286-ddfd-48dc-a447-f1796f5f61bd tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Deleted volume successfully. Sep 03 11:31:35 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-1047cdfb-0f38-489b-b32a-62978b7e8a03 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Volume volume-e7671b51-3afe-4a64-b37d-0442e6e5d725 (e7671b51-3afe-4a64-b37d-0442e6e5d725): created successfully Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1047cdfb-0f38-489b-b32a-62978b7e8a03 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a711c9f-61a2-4a60-8612-cad68e26aec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1047cdfb-0f38-489b-b32a-62978b7e8a03 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Flow 'volume_create_manager' (5a3bd206-c7cd-49b9-9481-188491e99fb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f20fb286-ddfd-48dc-a447-f1796f5f61bd tempest-CreateVolumesFromSourceVolumeTest-1898904079 None] Lock "cinder-1e59ae1f-b054-40fa-a465-902cd6d6d00f-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:35 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-1047cdfb-0f38-489b-b32a-62978b7e8a03 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Created volume successfully. Sep 03 11:31:36 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4bf16bf2-cfbc-412c-afa6-5e8073b36366 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.290s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:36 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-4bf16bf2-cfbc-412c-afa6-5e8073b36366 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:31:36 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-4bf16bf2-cfbc-412c-afa6-5e8073b36366 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Deleted volume successfully. Sep 03 11:31:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4bf16bf2-cfbc-412c-afa6-5e8073b36366 tempest-VolumeAndVolumeTypeFromImageTest-820967044 None] Lock "cinder-dcb5f500-7cd5-4fbd-af23-7ffa469e3176-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-9055fb6d-6333-49e6-978a-249044f14e96 tempest-CinderUnicodeTest-1349351074 None] Acquiring lock "cinder-53cdebdc-9cfd-4afd-be0b-d0ac488e13a1-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-9055fb6d-6333-49e6-978a-249044f14e96 tempest-CinderUnicodeTest-1349351074 None] Lock "cinder-53cdebdc-9cfd-4afd-be0b-d0ac488e13a1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-9055fb6d-6333-49e6-978a-249044f14e96 tempest-CinderUnicodeTest-1349351074 None] Acquiring lock "cinder-quobyte-53cdebdc-9cfd-4afd-be0b-d0ac488e13a1" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-9055fb6d-6333-49e6-978a-249044f14e96 tempest-CinderUnicodeTest-1349351074 None] Lock "cinder-quobyte-53cdebdc-9cfd-4afd-be0b-d0ac488e13a1" acquired by "delete_volume" :: waited 0.016s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:36 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[ead10746-073f-467b-b771-b3b0d8a2e6d8]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9055fb6d-6333-49e6-978a-249044f14e96 tempest-CinderUnicodeTest-1349351074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-53cdebdc-9cfd-4afd-be0b-d0ac488e13a1 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:36 devstack sudo[105784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-53cdebdc-9cfd-4afd-be0b-d0ac488e13a1 Sep 03 11:31:36 devstack sudo[105784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:36 devstack sudo[105784]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9055fb6d-6333-49e6-978a-249044f14e96 tempest-CinderUnicodeTest-1349351074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-53cdebdc-9cfd-4afd-be0b-d0ac488e13a1" returned: 0 in 0.380s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9055fb6d-6333-49e6-978a-249044f14e96 tempest-CinderUnicodeTest-1349351074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-53cdebdc-9cfd-4afd-be0b-d0ac488e13a1 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:36 devstack sudo[105790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-53cdebdc-9cfd-4afd-be0b-d0ac488e13a1 Sep 03 11:31:36 devstack sudo[105790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2ab65741-e22e-4fb8-8d15-2c30c2e38d9c tempest-CreateVolumesFromSnapshotTest-2066319807 None] Acquiring lock "cinder-e7671b51-3afe-4a64-b37d-0442e6e5d725-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2ab65741-e22e-4fb8-8d15-2c30c2e38d9c tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "cinder-e7671b51-3afe-4a64-b37d-0442e6e5d725-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2ab65741-e22e-4fb8-8d15-2c30c2e38d9c tempest-CreateVolumesFromSnapshotTest-2066319807 None] Acquiring lock "cinder-quobyte-e7671b51-3afe-4a64-b37d-0442e6e5d725" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2ab65741-e22e-4fb8-8d15-2c30c2e38d9c tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "cinder-quobyte-e7671b51-3afe-4a64-b37d-0442e6e5d725" acquired by "delete_volume" :: waited 0.022s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:36 devstack sudo[105790]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9055fb6d-6333-49e6-978a-249044f14e96 tempest-CinderUnicodeTest-1349351074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-53cdebdc-9cfd-4afd-be0b-d0ac488e13a1" returned: 0 in 0.316s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:36 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[79d4e1e5-4606-43f1-9af8-7c759b59c165]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2ab65741-e22e-4fb8-8d15-2c30c2e38d9c tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e7671b51-3afe-4a64-b37d-0442e6e5d725 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-9055fb6d-6333-49e6-978a-249044f14e96 tempest-CinderUnicodeTest-1349351074 None] Lock "cinder-quobyte-53cdebdc-9cfd-4afd-be0b-d0ac488e13a1" released by "delete_volume" :: held 0.752s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:36 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-9055fb6d-6333-49e6-978a-249044f14e96 tempest-CinderUnicodeTest-1349351074 None] Created reservations ['5bd5f2b9-7480-4ecf-9971-3676b794e3c3', '310e2d69-94fe-4ea2-baaa-f88df5872d94', '2bb1a077-c3fa-4921-a52e-2e5e2a7946d2', '76bc3b46-6dc0-4087-8c01-cfd85929c747'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:31:37 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e7671b51-3afe-4a64-b37d-0442e6e5d725 Sep 03 11:31:37 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9055fb6d-6333-49e6-978a-249044f14e96 tempest-CinderUnicodeTest-1349351074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9055fb6d-6333-49e6-978a-249044f14e96 tempest-CinderUnicodeTest-1349351074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:37 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-9055fb6d-6333-49e6-978a-249044f14e96 tempest-CinderUnicodeTest-1349351074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:37 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-9055fb6d-6333-49e6-978a-249044f14e96 tempest-CinderUnicodeTest-1349351074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9055fb6d-6333-49e6-978a-249044f14e96 tempest-CinderUnicodeTest-1349351074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9055fb6d-6333-49e6-978a-249044f14e96 tempest-CinderUnicodeTest-1349351074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:37 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:31:37 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:37 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2ab65741-e22e-4fb8-8d15-2c30c2e38d9c tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e7671b51-3afe-4a64-b37d-0442e6e5d725" returned: 0 in 0.471s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2ab65741-e22e-4fb8-8d15-2c30c2e38d9c tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e7671b51-3afe-4a64-b37d-0442e6e5d725 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:37 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e7671b51-3afe-4a64-b37d-0442e6e5d725 Sep 03 11:31:37 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:37 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9055fb6d-6333-49e6-978a-249044f14e96 tempest-CinderUnicodeTest-1349351074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.330s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:37 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-9055fb6d-6333-49e6-978a-249044f14e96 tempest-CinderUnicodeTest-1349351074 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:31:37 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-9055fb6d-6333-49e6-978a-249044f14e96 tempest-CinderUnicodeTest-1349351074 None] Deleted volume successfully. Sep 03 11:31:37 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-9055fb6d-6333-49e6-978a-249044f14e96 tempest-CinderUnicodeTest-1349351074 None] Lock "cinder-53cdebdc-9cfd-4afd-be0b-d0ac488e13a1-delete_volume" released by "delete_volume" :: held 1.361s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:37 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2ab65741-e22e-4fb8-8d15-2c30c2e38d9c tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e7671b51-3afe-4a64-b37d-0442e6e5d725" returned: 0 in 0.304s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:37 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2ab65741-e22e-4fb8-8d15-2c30c2e38d9c tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "cinder-quobyte-e7671b51-3afe-4a64-b37d-0442e6e5d725" released by "delete_volume" :: held 0.838s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:37 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-2ab65741-e22e-4fb8-8d15-2c30c2e38d9c tempest-CreateVolumesFromSnapshotTest-2066319807 None] Created reservations ['6a97ddbd-8fe0-49d2-bfad-a15fbb5893ac', 'e1f8a2ab-629f-4051-9ad7-1e57b9caf6bd', '6b0783df-9b44-4bfb-8143-0356b634bb5f', '147b6c2d-9c1c-4993-997a-5595ac02cdd1'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:31:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2ab65741-e22e-4fb8-8d15-2c30c2e38d9c tempest-CreateVolumesFromSnapshotTest-2066319807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2ab65741-e22e-4fb8-8d15-2c30c2e38d9c tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:37 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2ab65741-e22e-4fb8-8d15-2c30c2e38d9c tempest-CreateVolumesFromSnapshotTest-2066319807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:37 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2ab65741-e22e-4fb8-8d15-2c30c2e38d9c tempest-CreateVolumesFromSnapshotTest-2066319807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2ab65741-e22e-4fb8-8d15-2c30c2e38d9c tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2ab65741-e22e-4fb8-8d15-2c30c2e38d9c tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:37 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:31:37 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:37 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4e6975e3-6762-4b0b-9627-53b6bfd8d99b tempest-CreateVolumesFromSnapshotTest-2066319807 None] Acquiring lock "cinder-4de67e6a-e496-42a7-80d3-812ef90a215c-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:37 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4e6975e3-6762-4b0b-9627-53b6bfd8d99b tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "cinder-4de67e6a-e496-42a7-80d3-812ef90a215c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:38 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4e6975e3-6762-4b0b-9627-53b6bfd8d99b tempest-CreateVolumesFromSnapshotTest-2066319807 None] Acquiring lock "cinder-quobyte-4de67e6a-e496-42a7-80d3-812ef90a215c" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:38 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4e6975e3-6762-4b0b-9627-53b6bfd8d99b tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "cinder-quobyte-4de67e6a-e496-42a7-80d3-812ef90a215c" acquired by "delete_volume" :: waited 0.023s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:38 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2ab65741-e22e-4fb8-8d15-2c30c2e38d9c tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.299s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:38 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-2ab65741-e22e-4fb8-8d15-2c30c2e38d9c tempest-CreateVolumesFromSnapshotTest-2066319807 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:31:38 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-2ab65741-e22e-4fb8-8d15-2c30c2e38d9c tempest-CreateVolumesFromSnapshotTest-2066319807 None] Deleted volume successfully. Sep 03 11:31:38 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[45907fee-b55d-4437-8b43-585367cee18d]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4e6975e3-6762-4b0b-9627-53b6bfd8d99b tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4de67e6a-e496-42a7-80d3-812ef90a215c {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:38 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2ab65741-e22e-4fb8-8d15-2c30c2e38d9c tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "cinder-e7671b51-3afe-4a64-b37d-0442e6e5d725-delete_volume" released by "delete_volume" :: held 1.406s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:38 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4de67e6a-e496-42a7-80d3-812ef90a215c Sep 03 11:31:38 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:38 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4e6975e3-6762-4b0b-9627-53b6bfd8d99b tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4de67e6a-e496-42a7-80d3-812ef90a215c" returned: 0 in 0.483s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4e6975e3-6762-4b0b-9627-53b6bfd8d99b tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4de67e6a-e496-42a7-80d3-812ef90a215c {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:38 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4de67e6a-e496-42a7-80d3-812ef90a215c Sep 03 11:31:38 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:38 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4e6975e3-6762-4b0b-9627-53b6bfd8d99b tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4de67e6a-e496-42a7-80d3-812ef90a215c" returned: 0 in 0.361s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:39 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4e6975e3-6762-4b0b-9627-53b6bfd8d99b tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "cinder-quobyte-4de67e6a-e496-42a7-80d3-812ef90a215c" released by "delete_volume" :: held 0.924s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:39 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-4e6975e3-6762-4b0b-9627-53b6bfd8d99b tempest-CreateVolumesFromSnapshotTest-2066319807 None] Created reservations ['24064ab3-03a0-4092-8045-f545d9f9e031', 'fe9b9b92-8862-4cd7-b6cc-561bec5e922a', '45893fbb-5154-4c87-903d-e746d95cf15a', '92fe4f26-5a9d-4fb8-adba-5cffa2f5021f'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:31:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4e6975e3-6762-4b0b-9627-53b6bfd8d99b tempest-CreateVolumesFromSnapshotTest-2066319807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4e6975e3-6762-4b0b-9627-53b6bfd8d99b tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4e6975e3-6762-4b0b-9627-53b6bfd8d99b tempest-CreateVolumesFromSnapshotTest-2066319807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-4e6975e3-6762-4b0b-9627-53b6bfd8d99b tempest-CreateVolumesFromSnapshotTest-2066319807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4e6975e3-6762-4b0b-9627-53b6bfd8d99b tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4e6975e3-6762-4b0b-9627-53b6bfd8d99b tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:39 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:31:39 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:39 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4e6975e3-6762-4b0b-9627-53b6bfd8d99b tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.376s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:39 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-4e6975e3-6762-4b0b-9627-53b6bfd8d99b tempest-CreateVolumesFromSnapshotTest-2066319807 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:31:39 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-4e6975e3-6762-4b0b-9627-53b6bfd8d99b tempest-CreateVolumesFromSnapshotTest-2066319807 None] Deleted volume successfully. Sep 03 11:31:39 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4e6975e3-6762-4b0b-9627-53b6bfd8d99b tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "cinder-4de67e6a-e496-42a7-80d3-812ef90a215c-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:40 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f5426f09-faaf-42a3-a156-5a457ff19f69 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Acquiring lock "cinder-d18fc2cb-521d-4359-a10e-1196562f49c6-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:40 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f5426f09-faaf-42a3-a156-5a457ff19f69 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "cinder-d18fc2cb-521d-4359-a10e-1196562f49c6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:40 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f5426f09-faaf-42a3-a156-5a457ff19f69 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Acquiring lock "cinder-quobyte-d18fc2cb-521d-4359-a10e-1196562f49c6" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:40 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f5426f09-faaf-42a3-a156-5a457ff19f69 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "cinder-quobyte-d18fc2cb-521d-4359-a10e-1196562f49c6" acquired by "delete_volume" :: waited 0.024s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:40 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[92efd730-50a8-46e3-9d35-18ee388fdddb]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f5426f09-faaf-42a3-a156-5a457ff19f69 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d18fc2cb-521d-4359-a10e-1196562f49c6 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:40 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d18fc2cb-521d-4359-a10e-1196562f49c6 Sep 03 11:31:40 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:40 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f5426f09-faaf-42a3-a156-5a457ff19f69 tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d18fc2cb-521d-4359-a10e-1196562f49c6" returned: 0 in 0.417s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f5426f09-faaf-42a3-a156-5a457ff19f69 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d18fc2cb-521d-4359-a10e-1196562f49c6 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:40 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d18fc2cb-521d-4359-a10e-1196562f49c6 Sep 03 11:31:40 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:41 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f5426f09-faaf-42a3-a156-5a457ff19f69 tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d18fc2cb-521d-4359-a10e-1196562f49c6" returned: 0 in 0.281s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f5426f09-faaf-42a3-a156-5a457ff19f69 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "cinder-quobyte-d18fc2cb-521d-4359-a10e-1196562f49c6" released by "delete_volume" :: held 0.758s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:41 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-f5426f09-faaf-42a3-a156-5a457ff19f69 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Created reservations ['c64832f7-e232-4ede-99d0-255c54524fff', '449b19c5-187e-4f1b-be2c-8fa72fe4ebd5', 'a2f847c0-cf29-462d-82cd-41e7e88efd3b', '4cf6e898-762a-4672-8909-88dc3b81ad06'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:31:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f5426f09-faaf-42a3-a156-5a457ff19f69 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f5426f09-faaf-42a3-a156-5a457ff19f69 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:41 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f5426f09-faaf-42a3-a156-5a457ff19f69 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:41 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f5426f09-faaf-42a3-a156-5a457ff19f69 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f5426f09-faaf-42a3-a156-5a457ff19f69 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f5426f09-faaf-42a3-a156-5a457ff19f69 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:41 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:31:41 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-6422d446-a2d3-4c11-90ad-9dee05a8337f tempest-CreateVolumesFromSnapshotTest-2066319807 None] Acquiring lock "cinder-64b7fc7f-f7b0-4f07-9d8b-9508eca975bb-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-6422d446-a2d3-4c11-90ad-9dee05a8337f tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "cinder-64b7fc7f-f7b0-4f07-9d8b-9508eca975bb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-6422d446-a2d3-4c11-90ad-9dee05a8337f tempest-CreateVolumesFromSnapshotTest-2066319807 None] Acquiring lock "cinder-quobyte-64b7fc7f-f7b0-4f07-9d8b-9508eca975bb" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:41 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f5426f09-faaf-42a3-a156-5a457ff19f69 tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.315s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:41 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-f5426f09-faaf-42a3-a156-5a457ff19f69 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:31:41 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-f5426f09-faaf-42a3-a156-5a457ff19f69 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Deleted volume successfully. Sep 03 11:31:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-6422d446-a2d3-4c11-90ad-9dee05a8337f tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "cinder-quobyte-64b7fc7f-f7b0-4f07-9d8b-9508eca975bb" acquired by "delete_volume" :: waited 0.030s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f5426f09-faaf-42a3-a156-5a457ff19f69 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "cinder-d18fc2cb-521d-4359-a10e-1196562f49c6-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:41 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf77f9cc-4b99-4869-bf3a-7465bc22dff6]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6422d446-a2d3-4c11-90ad-9dee05a8337f tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-64b7fc7f-f7b0-4f07-9d8b-9508eca975bb {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:41 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-64b7fc7f-f7b0-4f07-9d8b-9508eca975bb Sep 03 11:31:41 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:42 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6422d446-a2d3-4c11-90ad-9dee05a8337f tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-64b7fc7f-f7b0-4f07-9d8b-9508eca975bb" returned: 0 in 0.451s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6422d446-a2d3-4c11-90ad-9dee05a8337f tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-64b7fc7f-f7b0-4f07-9d8b-9508eca975bb {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:42 devstack sudo[105837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-64b7fc7f-f7b0-4f07-9d8b-9508eca975bb Sep 03 11:31:42 devstack sudo[105837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:42 devstack sudo[105837]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6422d446-a2d3-4c11-90ad-9dee05a8337f tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-64b7fc7f-f7b0-4f07-9d8b-9508eca975bb" returned: 0 in 0.279s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:42 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-6422d446-a2d3-4c11-90ad-9dee05a8337f tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "cinder-quobyte-64b7fc7f-f7b0-4f07-9d8b-9508eca975bb" released by "delete_volume" :: held 0.787s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:42 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-6422d446-a2d3-4c11-90ad-9dee05a8337f tempest-CreateVolumesFromSnapshotTest-2066319807 None] Created reservations ['bbff99db-1974-4c01-aee3-6ad1e5936068', 'afaf6e48-0c41-46dc-886c-8f1926c84579', '574e2c98-248f-42f7-a407-571d87beb753', '34e0d312-df63-473a-8f1b-a12c27f8644e'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:31:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6422d446-a2d3-4c11-90ad-9dee05a8337f tempest-CreateVolumesFromSnapshotTest-2066319807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6422d446-a2d3-4c11-90ad-9dee05a8337f tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:42 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6422d446-a2d3-4c11-90ad-9dee05a8337f tempest-CreateVolumesFromSnapshotTest-2066319807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:42 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6422d446-a2d3-4c11-90ad-9dee05a8337f tempest-CreateVolumesFromSnapshotTest-2066319807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6422d446-a2d3-4c11-90ad-9dee05a8337f tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6422d446-a2d3-4c11-90ad-9dee05a8337f tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:42 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:31:42 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:42 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-728d59fd-9d1a-4e58-88ce-585c92b68235 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Acquiring lock "cinder-8dea2bf5-d1c6-4b13-8257-5f2fb813f458-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:42 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-728d59fd-9d1a-4e58-88ce-585c92b68235 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "cinder-8dea2bf5-d1c6-4b13-8257-5f2fb813f458-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:42 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-728d59fd-9d1a-4e58-88ce-585c92b68235 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Acquiring lock "cinder-quobyte-8dea2bf5-d1c6-4b13-8257-5f2fb813f458" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:42 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-728d59fd-9d1a-4e58-88ce-585c92b68235 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "cinder-quobyte-8dea2bf5-d1c6-4b13-8257-5f2fb813f458" acquired by "delete_volume" :: waited 0.022s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd355efc-0b3c-4c43-9dde-55d04a07a3a6]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-728d59fd-9d1a-4e58-88ce-585c92b68235 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8dea2bf5-d1c6-4b13-8257-5f2fb813f458 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:43 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6422d446-a2d3-4c11-90ad-9dee05a8337f tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.402s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-6422d446-a2d3-4c11-90ad-9dee05a8337f tempest-CreateVolumesFromSnapshotTest-2066319807 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:31:43 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-6422d446-a2d3-4c11-90ad-9dee05a8337f tempest-CreateVolumesFromSnapshotTest-2066319807 None] Deleted volume successfully. Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-6422d446-a2d3-4c11-90ad-9dee05a8337f tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "cinder-64b7fc7f-f7b0-4f07-9d8b-9508eca975bb-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b95a222-849a-40c6-9ab3-cad0a8824b12 tempest-ProjectReaderTests-1706512272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0b95a222-849a-40c6-9ab3-cad0a8824b12 tempest-ProjectReaderTests-1706512272 None] Flow 'volume_create_manager' (d60635a0-c641-439b-b143-98929e1dbcd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0b95a222-849a-40c6-9ab3-cad0a8824b12 tempest-ProjectReaderTests-1706512272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a907726c-2ab3-4dc1-8f66-a21e067265f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0b95a222-849a-40c6-9ab3-cad0a8824b12 tempest-ProjectReaderTests-1706512272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a907726c-2ab3-4dc1-8f66-a21e067265f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1829907019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30353c7b-92fb-47e2-93a2-d7c20d31f2e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34172391a9b54e849dad54bb44ecaa7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:43Z,use_quota=True,user_id='652bb9fce2214af7a43bd927d891e265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0b95a222-849a-40c6-9ab3-cad0a8824b12 tempest-ProjectReaderTests-1706512272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a79f977-2c84-4315-8dbc-75c71641575a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0b95a222-849a-40c6-9ab3-cad0a8824b12 tempest-ProjectReaderTests-1706512272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a79f977-2c84-4315-8dbc-75c71641575a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0b95a222-849a-40c6-9ab3-cad0a8824b12 tempest-ProjectReaderTests-1706512272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beb316bc-e010-4dc5-8805-50af6eaad768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0b95a222-849a-40c6-9ab3-cad0a8824b12 tempest-ProjectReaderTests-1706512272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (beb316bc-e010-4dc5-8805-50af6eaad768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30353c7b-92fb-47e2-93a2-d7c20d31f2e4', 'volume_name': 'volume-30353c7b-92fb-47e2-93a2-d7c20d31f2e4', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0b95a222-849a-40c6-9ab3-cad0a8824b12 tempest-ProjectReaderTests-1706512272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9b28124-0eb3-4d15-a882-dadfeb11a94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:43 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8dea2bf5-d1c6-4b13-8257-5f2fb813f458 Sep 03 11:31:43 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0b95a222-849a-40c6-9ab3-cad0a8824b12 tempest-ProjectReaderTests-1706512272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9b28124-0eb3-4d15-a882-dadfeb11a94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0b95a222-849a-40c6-9ab3-cad0a8824b12 tempest-ProjectReaderTests-1706512272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90748f81-0eac-45f4-aa35-ed9d67cc7da2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:43 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-0b95a222-849a-40c6-9ab3-cad0a8824b12 tempest-ProjectReaderTests-1706512272 None] Volume 30353c7b-92fb-47e2-93a2-d7c20d31f2e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30353c7b-92fb-47e2-93a2-d7c20d31f2e4', 'volume_size': 1} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0b95a222-849a-40c6-9ab3-cad0a8824b12 tempest-ProjectReaderTests-1706512272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0b95a222-849a-40c6-9ab3-cad0a8824b12 tempest-ProjectReaderTests-1706512272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0b95a222-849a-40c6-9ab3-cad0a8824b12 tempest-ProjectReaderTests-1706512272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1829907019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30353c7b-92fb-47e2-93a2-d7c20d31f2e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34172391a9b54e849dad54bb44ecaa7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:43Z,use_quota=True,user_id='652bb9fce2214af7a43bd927d891e265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-0b95a222-849a-40c6-9ab3-cad0a8824b12 tempest-ProjectReaderTests-1706512272 None] Creating volume 30353c7b-92fb-47e2-93a2-d7c20d31f2e4 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0b95a222-849a-40c6-9ab3-cad0a8824b12 tempest-ProjectReaderTests-1706512272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0b95a222-849a-40c6-9ab3-cad0a8824b12 tempest-ProjectReaderTests-1706512272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0b95a222-849a-40c6-9ab3-cad0a8824b12 tempest-ProjectReaderTests-1706512272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0b95a222-849a-40c6-9ab3-cad0a8824b12 tempest-ProjectReaderTests-1706512272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0b95a222-849a-40c6-9ab3-cad0a8824b12 tempest-ProjectReaderTests-1706512272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0b95a222-849a-40c6-9ab3-cad0a8824b12 tempest-ProjectReaderTests-1706512272 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:31:43 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-0b95a222-849a-40c6-9ab3-cad0a8824b12 tempest-ProjectReaderTests-1706512272 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0b95a222-849a-40c6-9ab3-cad0a8824b12 tempest-ProjectReaderTests-1706512272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-30353c7b-92fb-47e2-93a2-d7c20d31f2e4 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:31:43 devstack sudo[105845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-30353c7b-92fb-47e2-93a2-d7c20d31f2e4 1073741824 Sep 03 11:31:43 devstack sudo[105845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Flow 'volume_create_manager' (5a174fb4-d9c3-4906-aa52-83772798c164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (346c90f1-4889-4e3a-8405-f9ff9867dd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (346c90f1-4889-4e3a-8405-f9ff9867dd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84fcf367-0e7a-4bca-942b-7d9d44ac9f79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9fddfe1f73e47838e45eb249d934913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:43Z,use_quota=True,user_id='f0ff1e3319ad4b2eb01a8b39b5b22862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81729688-b323-4c4c-9d16-c3e2e164e454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (81729688-b323-4c4c-9d16-c3e2e164e454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa5d278b-efb0-4ef2-a5fa-2c39ddfe675b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.image.glance [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Creating Keystone auth plugin from conf {{(pid=87038) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f0c9029-3981-4f1f-a0c9-8c7ef6acb39b tempest-CreateVolumesFromImageTest-2002239375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7f0c9029-3981-4f1f-a0c9-8c7ef6acb39b tempest-CreateVolumesFromImageTest-2002239375 None] Flow 'volume_create_manager' (34ef6474-c2ef-44c1-b585-6e3f0823d268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7f0c9029-3981-4f1f-a0c9-8c7ef6acb39b tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd117380-863b-44e7-a7ae-89374c821a15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7f0c9029-3981-4f1f-a0c9-8c7ef6acb39b tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd117380-863b-44e7-a7ae-89374c821a15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1153066848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8914e7d5-d958-4138-a8e5-7af6cb81ddbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16336534399b443cab33d66042944c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:43Z,use_quota=True,user_id='a062e4d3291344028446b9e38d3255c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7f0c9029-3981-4f1f-a0c9-8c7ef6acb39b tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (426fc845-f118-495a-ae68-1fb0c2aa55fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7f0c9029-3981-4f1f-a0c9-8c7ef6acb39b tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (426fc845-f118-495a-ae68-1fb0c2aa55fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7f0c9029-3981-4f1f-a0c9-8c7ef6acb39b tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3463c00-4784-41e4-a28b-e8ed637a43ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7f0c9029-3981-4f1f-a0c9-8c7ef6acb39b tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3463c00-4784-41e4-a28b-e8ed637a43ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8914e7d5-d958-4138-a8e5-7af6cb81ddbc', 'volume_name': 'volume-8914e7d5-d958-4138-a8e5-7af6cb81ddbc', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7f0c9029-3981-4f1f-a0c9-8c7ef6acb39b tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (118e09e0-86c3-4197-a810-5c5ec58de574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7f0c9029-3981-4f1f-a0c9-8c7ef6acb39b tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (118e09e0-86c3-4197-a810-5c5ec58de574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7f0c9029-3981-4f1f-a0c9-8c7ef6acb39b tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ed7bdb-6d30-48e9-b10b-cc8b78fd28b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:43 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-7f0c9029-3981-4f1f-a0c9-8c7ef6acb39b tempest-CreateVolumesFromImageTest-2002239375 None] Volume 8914e7d5-d958-4138-a8e5-7af6cb81ddbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8914e7d5-d958-4138-a8e5-7af6cb81ddbc', 'volume_size': 1} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7f0c9029-3981-4f1f-a0c9-8c7ef6acb39b tempest-CreateVolumesFromImageTest-2002239375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:43 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-728d59fd-9d1a-4e58-88ce-585c92b68235 tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8dea2bf5-d1c6-4b13-8257-5f2fb813f458" returned: 0 in 0.626s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-728d59fd-9d1a-4e58-88ce-585c92b68235 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8dea2bf5-d1c6-4b13-8257-5f2fb813f458 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:43 devstack sudo[105853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8dea2bf5-d1c6-4b13-8257-5f2fb813f458 Sep 03 11:31:43 devstack sudo[105853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f017ed8-2f22-45a4-8799-a1f017cca359 tempest-CreateVolumesFromImageTest-2002239375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5f017ed8-2f22-45a4-8799-a1f017cca359 tempest-CreateVolumesFromImageTest-2002239375 None] Flow 'volume_create_manager' (df9ab352-2ed3-49bd-a56f-ea39b205d002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5f017ed8-2f22-45a4-8799-a1f017cca359 tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05101980-47a9-490a-b1e8-37e376879b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5f017ed8-2f22-45a4-8799-a1f017cca359 tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05101980-47a9-490a-b1e8-37e376879b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1623045638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5883ef09-0775-4b73-888f-2e708db8c4a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16336534399b443cab33d66042944c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:44Z,use_quota=True,user_id='a062e4d3291344028446b9e38d3255c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5f017ed8-2f22-45a4-8799-a1f017cca359 tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28dbc728-d291-439a-a1ee-d55e1eb18b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5f017ed8-2f22-45a4-8799-a1f017cca359 tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28dbc728-d291-439a-a1ee-d55e1eb18b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5f017ed8-2f22-45a4-8799-a1f017cca359 tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (532dfb45-a271-4abf-bb24-743a4576dbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5f017ed8-2f22-45a4-8799-a1f017cca359 tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (532dfb45-a271-4abf-bb24-743a4576dbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5883ef09-0775-4b73-888f-2e708db8c4a1', 'volume_name': 'volume-5883ef09-0775-4b73-888f-2e708db8c4a1', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5f017ed8-2f22-45a4-8799-a1f017cca359 tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3fb898d-dcad-40d6-874f-21dac025b262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5f017ed8-2f22-45a4-8799-a1f017cca359 tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3fb898d-dcad-40d6-874f-21dac025b262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5f017ed8-2f22-45a4-8799-a1f017cca359 tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7cc3a81-0737-44cc-ad7c-a9fc11cf1ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:43 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-5f017ed8-2f22-45a4-8799-a1f017cca359 tempest-CreateVolumesFromImageTest-2002239375 None] Volume 5883ef09-0775-4b73-888f-2e708db8c4a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5883ef09-0775-4b73-888f-2e708db8c4a1', 'volume_size': 1} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5f017ed8-2f22-45a4-8799-a1f017cca359 tempest-CreateVolumesFromImageTest-2002239375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:43 devstack sudo[105845]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0b95a222-849a-40c6-9ab3-cad0a8824b12 tempest-ProjectReaderTests-1706512272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-30353c7b-92fb-47e2-93a2-d7c20d31f2e4 1073741824" returned: 0 in 0.738s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa5d278b-efb0-4ef2-a5fa-2c39ddfe675b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '84fcf367-0e7a-4bca-942b-7d9d44ac9f79', 'volume_name': 'volume-84fcf367-0e7a-4bca-942b-7d9d44ac9f79', 'volume_size': 1, 'image_id': 'e4b52f5b-3d69-48b7-9519-2f066d3a86cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e4b52f5b-3d69-48b7-9519-2f066d3a86cf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6768403b2b7d475521ba623387d7c5d8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c9fddfe1f73e47838e45eb249d934913', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '37da4928afbd20e1e2b17aa44e67dff5c3c3445d391d4b8fe530ba9bfd4d261e373033ee8f0fdfd515b705e7e34c8e9c607b5b0d0a4e586a54e2fee82f50f375', 'id': 'e4b52f5b-3d69-48b7-9519-2f066d3a86cf', 'created_at': datetime.datetime(2026, 9, 3, 9, 31, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 31, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e4b52f5b-3d69-48b7-9519-2f066d3a86cf/file', 'properties': {}}, 'image_service': }' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b81954-95bd-4636-95a4-7a2cb0e94c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9b81954-95bd-4636-95a4-7a2cb0e94c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:44 devstack sudo[105853]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (823a34df-ff93-4753-89a3-a7bc4aead31b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:44 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Volume 84fcf367-0e7a-4bca-942b-7d9d44ac9f79: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-84fcf367-0e7a-4bca-942b-7d9d44ac9f79', 'volume_size': 1, 'image_id': 'e4b52f5b-3d69-48b7-9519-2f066d3a86cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e4b52f5b-3d69-48b7-9519-2f066d3a86cf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6768403b2b7d475521ba623387d7c5d8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c9fddfe1f73e47838e45eb249d934913', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '37da4928afbd20e1e2b17aa44e67dff5c3c3445d391d4b8fe530ba9bfd4d261e373033ee8f0fdfd515b705e7e34c8e9c607b5b0d0a4e586a54e2fee82f50f375', 'id': 'e4b52f5b-3d69-48b7-9519-2f066d3a86cf', 'created_at': datetime.datetime(2026, 9, 3, 9, 31, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 31, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e4b52f5b-3d69-48b7-9519-2f066d3a86cf/file', 'properties': {}}, 'image_service': } Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Trying to clone 84fcf367-0e7a-4bca-942b-7d9d44ac9f79 from image e4b52f5b-3d69-48b7-9519-2f066d3a86cf at location (None, [{'url': 'file:///opt/stack/data/glance/images/e4b52f5b-3d69-48b7-9519-2f066d3a86cf', 'metadata': {}}]). {{(pid=87038) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-728d59fd-9d1a-4e58-88ce-585c92b68235 tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8dea2bf5-d1c6-4b13-8257-5f2fb813f458" returned: 0 in 0.393s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-728d59fd-9d1a-4e58-88ce-585c92b68235 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "cinder-quobyte-8dea2bf5-d1c6-4b13-8257-5f2fb813f458" released by "delete_volume" :: held 1.077s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0b95a222-849a-40c6-9ab3-cad0a8824b12 tempest-ProjectReaderTests-1706512272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-30353c7b-92fb-47e2-93a2-d7c20d31f2e4 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:44 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-30353c7b-92fb-47e2-93a2-d7c20d31f2e4 Sep 03 11:31:44 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-728d59fd-9d1a-4e58-88ce-585c92b68235 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Created reservations ['1c4d9182-438a-4598-b68f-c099d8dc27cf', '2c077aa8-796f-4dac-b9ca-e58cacaff47d', '74a47a2a-a795-49e2-9bda-57bf0714336b', 'aa43b943-5cae-412d-87ce-043136f407d8'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e4b52f5b-3d69-48b7-9519-2f066d3a86cf_57kl6y77devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87038) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 11:31:44 devstack cinder-volume[87038]: INFO cinder.image.image_utils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Image download 0.00 MB at 0.00 MB/s Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b339811-73d7-45ed-88e1-4462ef0d556c]: (4, 'raw') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b52f5b-3d69-48b7-9519-2f066d3a86cf_57kl6y77devstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-b18d69dc-8c2d-47ff-baba-ae366c066732 tempest-CreateVolumesFromImageTest-2002239375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-b18d69dc-8c2d-47ff-baba-ae366c066732 tempest-CreateVolumesFromImageTest-2002239375 None] Flow 'volume_create_manager' (f3decbaf-d9f1-490a-837b-bbc6409c2ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-b18d69dc-8c2d-47ff-baba-ae366c066732 tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81278c35-0456-4490-951f-4f6ba2f00ecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-728d59fd-9d1a-4e58-88ce-585c92b68235 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-728d59fd-9d1a-4e58-88ce-585c92b68235 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-728d59fd-9d1a-4e58-88ce-585c92b68235 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-728d59fd-9d1a-4e58-88ce-585c92b68235 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-728d59fd-9d1a-4e58-88ce-585c92b68235 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-728d59fd-9d1a-4e58-88ce-585c92b68235 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-b18d69dc-8c2d-47ff-baba-ae366c066732 tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81278c35-0456-4490-951f-4f6ba2f00ecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-728280356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ce63040-9fea-4d68-a6cd-bd50344c4706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16336534399b443cab33d66042944c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:44Z,use_quota=True,user_id='a062e4d3291344028446b9e38d3255c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-b18d69dc-8c2d-47ff-baba-ae366c066732 tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4353a6fe-f7a4-4288-8012-d9a440dc2d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-b18d69dc-8c2d-47ff-baba-ae366c066732 tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4353a6fe-f7a4-4288-8012-d9a440dc2d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:44 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:31:44 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-b18d69dc-8c2d-47ff-baba-ae366c066732 tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0045685-c273-4731-b79e-2f48bff7d19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-b18d69dc-8c2d-47ff-baba-ae366c066732 tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0045685-c273-4731-b79e-2f48bff7d19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ce63040-9fea-4d68-a6cd-bd50344c4706', 'volume_name': 'volume-5ce63040-9fea-4d68-a6cd-bd50344c4706', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:44 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-b18d69dc-8c2d-47ff-baba-ae366c066732 tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce1e3637-4b0e-46ba-92f2-9b607823abad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-b18d69dc-8c2d-47ff-baba-ae366c066732 tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce1e3637-4b0e-46ba-92f2-9b607823abad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-b18d69dc-8c2d-47ff-baba-ae366c066732 tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d52cfae4-ca92-418e-a7ae-4fbaa03125f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:44 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-b18d69dc-8c2d-47ff-baba-ae366c066732 tempest-CreateVolumesFromImageTest-2002239375 None] Volume 5ce63040-9fea-4d68-a6cd-bd50344c4706: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ce63040-9fea-4d68-a6cd-bd50344c4706', 'volume_size': 1} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b18d69dc-8c2d-47ff-baba-ae366c066732 tempest-CreateVolumesFromImageTest-2002239375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0b95a222-849a-40c6-9ab3-cad0a8824b12 tempest-ProjectReaderTests-1706512272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-30353c7b-92fb-47e2-93a2-d7c20d31f2e4" returned: 0 in 0.378s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0b95a222-849a-40c6-9ab3-cad0a8824b12 tempest-ProjectReaderTests-1706512272 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0b95a222-849a-40c6-9ab3-cad0a8824b12 tempest-ProjectReaderTests-1706512272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.250s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7f0c9029-3981-4f1f-a0c9-8c7ef6acb39b tempest-CreateVolumesFromImageTest-2002239375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.950s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7f0c9029-3981-4f1f-a0c9-8c7ef6acb39b tempest-CreateVolumesFromImageTest-2002239375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1153066848',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8914e7d5-d958-4138-a8e5-7af6cb81ddbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16336534399b443cab33d66042944c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:43Z,use_quota=True,user_id='a062e4d3291344028446b9e38d3255c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-7f0c9029-3981-4f1f-a0c9-8c7ef6acb39b tempest-CreateVolumesFromImageTest-2002239375 None] Creating volume 8914e7d5-d958-4138-a8e5-7af6cb81ddbc {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7f0c9029-3981-4f1f-a0c9-8c7ef6acb39b tempest-CreateVolumesFromImageTest-2002239375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7f0c9029-3981-4f1f-a0c9-8c7ef6acb39b tempest-CreateVolumesFromImageTest-2002239375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7f0c9029-3981-4f1f-a0c9-8c7ef6acb39b tempest-CreateVolumesFromImageTest-2002239375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7f0c9029-3981-4f1f-a0c9-8c7ef6acb39b tempest-CreateVolumesFromImageTest-2002239375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7f0c9029-3981-4f1f-a0c9-8c7ef6acb39b tempest-CreateVolumesFromImageTest-2002239375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7f0c9029-3981-4f1f-a0c9-8c7ef6acb39b tempest-CreateVolumesFromImageTest-2002239375 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:31:44 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-7f0c9029-3981-4f1f-a0c9-8c7ef6acb39b tempest-CreateVolumesFromImageTest-2002239375 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7f0c9029-3981-4f1f-a0c9-8c7ef6acb39b tempest-CreateVolumesFromImageTest-2002239375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8914e7d5-d958-4138-a8e5-7af6cb81ddbc 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:44 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b52f5b-3d69-48b7-9519-2f066d3a86cf_57kl6y77devstack@QuobyteHD Sep 03 11:31:44 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0b95a222-849a-40c6-9ab3-cad0a8824b12 tempest-ProjectReaderTests-1706512272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90748f81-0eac-45f4-aa35-ed9d67cc7da2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30353c7b-92fb-47e2-93a2-d7c20d31f2e4', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0b95a222-849a-40c6-9ab3-cad0a8824b12 tempest-ProjectReaderTests-1706512272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2035e09b-e9ce-4810-8e44-48ac1be13a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:44 devstack sudo[105863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8914e7d5-d958-4138-a8e5-7af6cb81ddbc 1073741824 Sep 03 11:31:44 devstack sudo[105863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:44 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-0b95a222-849a-40c6-9ab3-cad0a8824b12 tempest-ProjectReaderTests-1706512272 None] Volume volume-30353c7b-92fb-47e2-93a2-d7c20d31f2e4 (30353c7b-92fb-47e2-93a2-d7c20d31f2e4): created successfully Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0b95a222-849a-40c6-9ab3-cad0a8824b12 tempest-ProjectReaderTests-1706512272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2035e09b-e9ce-4810-8e44-48ac1be13a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-0b95a222-849a-40c6-9ab3-cad0a8824b12 tempest-ProjectReaderTests-1706512272 None] Flow 'volume_create_manager' (d60635a0-c641-439b-b143-98929e1dbcd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:44 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-0b95a222-849a-40c6-9ab3-cad0a8824b12 tempest-ProjectReaderTests-1706512272 None] Created volume successfully. Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-a06c5937-4544-41b4-ae46-51cc4900a48b tempest-CreateVolumesFromImageTest-2002239375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:31:44 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a06c5937-4544-41b4-ae46-51cc4900a48b tempest-CreateVolumesFromImageTest-2002239375 None] Flow 'volume_create_manager' (d525abf0-3731-4502-991f-40004f89f3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a06c5937-4544-41b4-ae46-51cc4900a48b tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f2e128b-f3ca-4c51-82c4-9289c89a0085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b52f5b-3d69-48b7-9519-2f066d3a86cf_57kl6y77devstack@QuobyteHD" returned: 0 in 0.453s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b52f5b-3d69-48b7-9519-2f066d3a86cf_57kl6y77devstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a06c5937-4544-41b4-ae46-51cc4900a48b tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f2e128b-f3ca-4c51-82c4-9289c89a0085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1018612203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6db3dce9-657b-40af-b069-29e0e915b18b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16336534399b443cab33d66042944c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:45Z,use_quota=True,user_id='a062e4d3291344028446b9e38d3255c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a06c5937-4544-41b4-ae46-51cc4900a48b tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ada4f289-934b-4f52-bdf3-7489b6e1f70f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a06c5937-4544-41b4-ae46-51cc4900a48b tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ada4f289-934b-4f52-bdf3-7489b6e1f70f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a06c5937-4544-41b4-ae46-51cc4900a48b tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8cbff6c-691a-4c85-a4c3-4f87e472e6ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a06c5937-4544-41b4-ae46-51cc4900a48b tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8cbff6c-691a-4c85-a4c3-4f87e472e6ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6db3dce9-657b-40af-b069-29e0e915b18b', 'volume_name': 'volume-6db3dce9-657b-40af-b069-29e0e915b18b', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a06c5937-4544-41b4-ae46-51cc4900a48b tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31435d69-33a6-42f1-8004-b2ecae94f643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a06c5937-4544-41b4-ae46-51cc4900a48b tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31435d69-33a6-42f1-8004-b2ecae94f643) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a06c5937-4544-41b4-ae46-51cc4900a48b tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5caa7df8-2667-4c45-bd6b-ded61e74ece0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:44 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-a06c5937-4544-41b4-ae46-51cc4900a48b tempest-CreateVolumesFromImageTest-2002239375 None] Volume 6db3dce9-657b-40af-b069-29e0e915b18b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6db3dce9-657b-40af-b069-29e0e915b18b', 'volume_size': 1} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a06c5937-4544-41b4-ae46-51cc4900a48b tempest-CreateVolumesFromImageTest-2002239375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:44 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-728d59fd-9d1a-4e58-88ce-585c92b68235 tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.494s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-728d59fd-9d1a-4e58-88ce-585c92b68235 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:31:44 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-728d59fd-9d1a-4e58-88ce-585c92b68235 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Deleted volume successfully. Sep 03 11:31:44 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-728d59fd-9d1a-4e58-88ce-585c92b68235 tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "cinder-8dea2bf5-d1c6-4b13-8257-5f2fb813f458-delete_volume" released by "delete_volume" :: held 2.009s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:44 devstack sudo[105867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b52f5b-3d69-48b7-9519-2f066d3a86cf_57kl6y77devstack@QuobyteHD Sep 03 11:31:44 devstack sudo[105867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:45 devstack sudo[105863]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7f0c9029-3981-4f1f-a0c9-8c7ef6acb39b tempest-CreateVolumesFromImageTest-2002239375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8914e7d5-d958-4138-a8e5-7af6cb81ddbc 1073741824" returned: 0 in 0.645s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7f0c9029-3981-4f1f-a0c9-8c7ef6acb39b tempest-CreateVolumesFromImageTest-2002239375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8914e7d5-d958-4138-a8e5-7af6cb81ddbc {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:45 devstack sudo[105867]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:45 devstack sudo[105877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8914e7d5-d958-4138-a8e5-7af6cb81ddbc Sep 03 11:31:45 devstack sudo[105877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b52f5b-3d69-48b7-9519-2f066d3a86cf_57kl6y77devstack@QuobyteHD" returned: 1 in 0.493s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b52f5b-3d69-48b7-9519-2f066d3a86cf_57kl6y77devstack@QuobyteHD' failed. Not Retrying. {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Temporary image e4b52f5b-3d69-48b7-9519-2f066d3a86cf is fetched for user f0ff1e3319ad4b2eb01a8b39b5b22862. {{(pid=87038) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fe37739e-5e36-48b0-b110-df662bb9d60e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Acquiring lock "cinder-1595d3d8-59a8-4ede-a1b3-23795d19aa84-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fe37739e-5e36-48b0-b110-df662bb9d60e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "cinder-1595d3d8-59a8-4ede-a1b3-23795d19aa84-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fe37739e-5e36-48b0-b110-df662bb9d60e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Acquiring lock "cinder-quobyte-27fad037-87dd-42ea-b527-77f67f40b633" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-52332281-3cd4-455c-aca2-82d453999c78 tempest-CreateVolumesFromImageTest-2002239375 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-52332281-3cd4-455c-aca2-82d453999c78 tempest-CreateVolumesFromImageTest-2002239375 None] Flow 'volume_create_manager' (5826cdf0-136f-47c1-b1ed-bf97f7e242ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-52332281-3cd4-455c-aca2-82d453999c78 tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32a741f2-a1f1-44f9-b459-99d118e39233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b0407102-eb85-4884-9a33-13ca53b30a0e tempest-ProjectReaderTests-1706512272 None] Acquiring lock "cinder-30353c7b-92fb-47e2-93a2-d7c20d31f2e4-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-52332281-3cd4-455c-aca2-82d453999c78 tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32a741f2-a1f1-44f9-b459-99d118e39233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-936277581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdba6f2b-30ff-41f3-a41d-60be6677a399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16336534399b443cab33d66042944c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:45Z,use_quota=True,user_id='a062e4d3291344028446b9e38d3255c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-52332281-3cd4-455c-aca2-82d453999c78 tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (473ead23-d1a1-4b5f-9d65-d108fbb28c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-52332281-3cd4-455c-aca2-82d453999c78 tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (473ead23-d1a1-4b5f-9d65-d108fbb28c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-52332281-3cd4-455c-aca2-82d453999c78 tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84f420a6-c37e-4246-a061-2ef3b957917a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-52332281-3cd4-455c-aca2-82d453999c78 tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84f420a6-c37e-4246-a061-2ef3b957917a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdba6f2b-30ff-41f3-a41d-60be6677a399', 'volume_name': 'volume-fdba6f2b-30ff-41f3-a41d-60be6677a399', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-52332281-3cd4-455c-aca2-82d453999c78 tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3925ade7-5c5c-4496-931c-2e39c652f5f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-52332281-3cd4-455c-aca2-82d453999c78 tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3925ade7-5c5c-4496-931c-2e39c652f5f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-52332281-3cd4-455c-aca2-82d453999c78 tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee11603-cfc4-40fa-83b3-296ab4205fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:45 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-52332281-3cd4-455c-aca2-82d453999c78 tempest-CreateVolumesFromImageTest-2002239375 None] Volume fdba6f2b-30ff-41f3-a41d-60be6677a399: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdba6f2b-30ff-41f3-a41d-60be6677a399', 'volume_size': 1} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-52332281-3cd4-455c-aca2-82d453999c78 tempest-CreateVolumesFromImageTest-2002239375 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fe37739e-5e36-48b0-b110-df662bb9d60e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "cinder-quobyte-27fad037-87dd-42ea-b527-77f67f40b633" acquired by "delete_snapshot" :: waited 0.124s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fe37739e-5e36-48b0-b110-df662bb9d60e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Acquiring lock "cinder-quobyte-1595d3d8-59a8-4ede-a1b3-23795d19aa84" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b0407102-eb85-4884-9a33-13ca53b30a0e tempest-ProjectReaderTests-1706512272 None] Lock "cinder-30353c7b-92fb-47e2-93a2-d7c20d31f2e4-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fe37739e-5e36-48b0-b110-df662bb9d60e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "cinder-quobyte-1595d3d8-59a8-4ede-a1b3-23795d19aa84" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-fe37739e-5e36-48b0-b110-df662bb9d60e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Deleting offline snapshot 1595d3d8-59a8-4ede-a1b3-23795d19aa84 of volume 27fad037-87dd-42ea-b527-77f67f40b633 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-fe37739e-5e36-48b0-b110-df662bb9d60e tempest-CreateVolumesFromSnapshotTest-2066319807 None] snapshot_file for this snap is: volume-27fad037-87dd-42ea-b527-77f67f40b633.1595d3d8-59a8-4ede-a1b3-23795d19aa84 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd23536a-58a8-4fa3-9d40-2b1d5fc64ba3]: (4, 'raw') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b52f5b-3d69-48b7-9519-2f066d3a86cf_57kl6y77devstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[e179621c-79aa-4ec0-935f-655fe7014a09]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fe37739e-5e36-48b0-b110-df662bb9d60e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633.1595d3d8-59a8-4ede-a1b3-23795d19aa84 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:45 devstack sudo[105877]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7f0c9029-3981-4f1f-a0c9-8c7ef6acb39b tempest-CreateVolumesFromImageTest-2002239375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8914e7d5-d958-4138-a8e5-7af6cb81ddbc" returned: 0 in 0.341s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7f0c9029-3981-4f1f-a0c9-8c7ef6acb39b tempest-CreateVolumesFromImageTest-2002239375 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7f0c9029-3981-4f1f-a0c9-8c7ef6acb39b tempest-CreateVolumesFromImageTest-2002239375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5f017ed8-2f22-45a4-8799-a1f017cca359 tempest-CreateVolumesFromImageTest-2002239375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.610s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5f017ed8-2f22-45a4-8799-a1f017cca359 tempest-CreateVolumesFromImageTest-2002239375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1623045638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5883ef09-0775-4b73-888f-2e708db8c4a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16336534399b443cab33d66042944c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:44Z,use_quota=True,user_id='a062e4d3291344028446b9e38d3255c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-5f017ed8-2f22-45a4-8799-a1f017cca359 tempest-CreateVolumesFromImageTest-2002239375 None] Creating volume 5883ef09-0775-4b73-888f-2e708db8c4a1 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5f017ed8-2f22-45a4-8799-a1f017cca359 tempest-CreateVolumesFromImageTest-2002239375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5f017ed8-2f22-45a4-8799-a1f017cca359 tempest-CreateVolumesFromImageTest-2002239375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5f017ed8-2f22-45a4-8799-a1f017cca359 tempest-CreateVolumesFromImageTest-2002239375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5f017ed8-2f22-45a4-8799-a1f017cca359 tempest-CreateVolumesFromImageTest-2002239375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5f017ed8-2f22-45a4-8799-a1f017cca359 tempest-CreateVolumesFromImageTest-2002239375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5f017ed8-2f22-45a4-8799-a1f017cca359 tempest-CreateVolumesFromImageTest-2002239375 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:31:45 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-5f017ed8-2f22-45a4-8799-a1f017cca359 tempest-CreateVolumesFromImageTest-2002239375 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5f017ed8-2f22-45a4-8799-a1f017cca359 tempest-CreateVolumesFromImageTest-2002239375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5883ef09-0775-4b73-888f-2e708db8c4a1 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b0407102-eb85-4884-9a33-13ca53b30a0e tempest-ProjectReaderTests-1706512272 None] Acquiring lock "cinder-quobyte-30353c7b-92fb-47e2-93a2-d7c20d31f2e4" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:45 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b52f5b-3d69-48b7-9519-2f066d3a86cf_57kl6y77devstack@QuobyteHD Sep 03 11:31:45 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:45 devstack sudo[105883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5883ef09-0775-4b73-888f-2e708db8c4a1 1073741824 Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7f0c9029-3981-4f1f-a0c9-8c7ef6acb39b tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8ed7bdb-6d30-48e9-b10b-cc8b78fd28b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8914e7d5-d958-4138-a8e5-7af6cb81ddbc', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:45 devstack sudo[105883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7f0c9029-3981-4f1f-a0c9-8c7ef6acb39b tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3431fc9-ee72-4959-8606-192ff624cb4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b0407102-eb85-4884-9a33-13ca53b30a0e tempest-ProjectReaderTests-1706512272 None] Lock "cinder-quobyte-30353c7b-92fb-47e2-93a2-d7c20d31f2e4" acquired by "delete_volume" :: waited 0.072s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:45 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633.1595d3d8-59a8-4ede-a1b3-23795d19aa84 Sep 03 11:31:45 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:45 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-7f0c9029-3981-4f1f-a0c9-8c7ef6acb39b tempest-CreateVolumesFromImageTest-2002239375 None] Volume volume-8914e7d5-d958-4138-a8e5-7af6cb81ddbc (8914e7d5-d958-4138-a8e5-7af6cb81ddbc): created successfully Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7f0c9029-3981-4f1f-a0c9-8c7ef6acb39b tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3431fc9-ee72-4959-8606-192ff624cb4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7f0c9029-3981-4f1f-a0c9-8c7ef6acb39b tempest-CreateVolumesFromImageTest-2002239375 None] Flow 'volume_create_manager' (34ef6474-c2ef-44c1-b585-6e3f0823d268) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9aafab-ea4a-4d4f-8d9b-ed94ddd00988]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b0407102-eb85-4884-9a33-13ca53b30a0e tempest-ProjectReaderTests-1706512272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-30353c7b-92fb-47e2-93a2-d7c20d31f2e4 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:45 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-7f0c9029-3981-4f1f-a0c9-8c7ef6acb39b tempest-CreateVolumesFromImageTest-2002239375 None] Created volume successfully. Sep 03 11:31:45 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b52f5b-3d69-48b7-9519-2f066d3a86cf_57kl6y77devstack@QuobyteHD" returned: 0 in 0.369s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b52f5b-3d69-48b7-9519-2f066d3a86cf_57kl6y77devstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:45 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-30353c7b-92fb-47e2-93a2-d7c20d31f2e4 Sep 03 11:31:45 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:45 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fe37739e-5e36-48b0-b110-df662bb9d60e tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633.1595d3d8-59a8-4ede-a1b3-23795d19aa84" returned: 0 in 0.443s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-fe37739e-5e36-48b0-b110-df662bb9d60e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-27fad037-87dd-42ea-b527-77f67f40b633(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[806855a8-14ea-411c-bc27-48893c396145]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fe37739e-5e36-48b0-b110-df662bb9d60e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:45 devstack sudo[105891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b52f5b-3d69-48b7-9519-2f066d3a86cf_57kl6y77devstack@QuobyteHD Sep 03 11:31:45 devstack sudo[105891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:46 devstack sudo[105898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633 Sep 03 11:31:46 devstack sudo[105898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:46 devstack sudo[105883]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5f017ed8-2f22-45a4-8799-a1f017cca359 tempest-CreateVolumesFromImageTest-2002239375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5883ef09-0775-4b73-888f-2e708db8c4a1 1073741824" returned: 0 in 0.585s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:46 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b0407102-eb85-4884-9a33-13ca53b30a0e tempest-ProjectReaderTests-1706512272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-30353c7b-92fb-47e2-93a2-d7c20d31f2e4" returned: 0 in 0.474s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b0407102-eb85-4884-9a33-13ca53b30a0e tempest-ProjectReaderTests-1706512272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-30353c7b-92fb-47e2-93a2-d7c20d31f2e4 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:46 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-30353c7b-92fb-47e2-93a2-d7c20d31f2e4 Sep 03 11:31:46 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5f017ed8-2f22-45a4-8799-a1f017cca359 tempest-CreateVolumesFromImageTest-2002239375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5883ef09-0775-4b73-888f-2e708db8c4a1 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:46 devstack sudo[105891]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:46 devstack sudo[105909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5883ef09-0775-4b73-888f-2e708db8c4a1 Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b52f5b-3d69-48b7-9519-2f066d3a86cf_57kl6y77devstack@QuobyteHD" returned: 1 in 0.406s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b52f5b-3d69-48b7-9519-2f066d3a86cf_57kl6y77devstack@QuobyteHD' failed. Not Retrying. {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:46 devstack sudo[105909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:46 devstack sudo[105898]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fe37739e-5e36-48b0-b110-df662bb9d60e tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633" returned: 0 in 0.435s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fe37739e-5e36-48b0-b110-df662bb9d60e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633.1595d3d8-59a8-4ede-a1b3-23795d19aa84 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:46 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633.1595d3d8-59a8-4ede-a1b3-23795d19aa84 Sep 03 11:31:46 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:46 devstack sudo[105909]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:46 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5f017ed8-2f22-45a4-8799-a1f017cca359 tempest-CreateVolumesFromImageTest-2002239375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5883ef09-0775-4b73-888f-2e708db8c4a1" returned: 0 in 0.279s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5f017ed8-2f22-45a4-8799-a1f017cca359 tempest-CreateVolumesFromImageTest-2002239375 None] <== create_volume: return (949ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5f017ed8-2f22-45a4-8799-a1f017cca359 tempest-CreateVolumesFromImageTest-2002239375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b18d69dc-8c2d-47ff-baba-ae366c066732 tempest-CreateVolumesFromImageTest-2002239375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.040s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-b18d69dc-8c2d-47ff-baba-ae366c066732 tempest-CreateVolumesFromImageTest-2002239375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-728280356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ce63040-9fea-4d68-a6cd-bd50344c4706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16336534399b443cab33d66042944c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:44Z,use_quota=True,user_id='a062e4d3291344028446b9e38d3255c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-b18d69dc-8c2d-47ff-baba-ae366c066732 tempest-CreateVolumesFromImageTest-2002239375 None] Creating volume 5ce63040-9fea-4d68-a6cd-bd50344c4706 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b18d69dc-8c2d-47ff-baba-ae366c066732 tempest-CreateVolumesFromImageTest-2002239375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b18d69dc-8c2d-47ff-baba-ae366c066732 tempest-CreateVolumesFromImageTest-2002239375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-b18d69dc-8c2d-47ff-baba-ae366c066732 tempest-CreateVolumesFromImageTest-2002239375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-b18d69dc-8c2d-47ff-baba-ae366c066732 tempest-CreateVolumesFromImageTest-2002239375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b18d69dc-8c2d-47ff-baba-ae366c066732 tempest-CreateVolumesFromImageTest-2002239375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-b18d69dc-8c2d-47ff-baba-ae366c066732 tempest-CreateVolumesFromImageTest-2002239375 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:31:46 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-b18d69dc-8c2d-47ff-baba-ae366c066732 tempest-CreateVolumesFromImageTest-2002239375 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b18d69dc-8c2d-47ff-baba-ae366c066732 tempest-CreateVolumesFromImageTest-2002239375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5ce63040-9fea-4d68-a6cd-bd50344c4706 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b0407102-eb85-4884-9a33-13ca53b30a0e tempest-ProjectReaderTests-1706512272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-30353c7b-92fb-47e2-93a2-d7c20d31f2e4" returned: 0 in 0.345s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:46 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5ce63040-9fea-4d68-a6cd-bd50344c4706 1073741824 Sep 03 11:31:46 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b0407102-eb85-4884-9a33-13ca53b30a0e tempest-ProjectReaderTests-1706512272 None] Lock "cinder-quobyte-30353c7b-92fb-47e2-93a2-d7c20d31f2e4" released by "delete_volume" :: held 0.906s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5f017ed8-2f22-45a4-8799-a1f017cca359 tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7cc3a81-0737-44cc-ad7c-a9fc11cf1ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5883ef09-0775-4b73-888f-2e708db8c4a1', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5f017ed8-2f22-45a4-8799-a1f017cca359 tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df2f0c4d-9d3b-48f2-b0b3-a54265aca772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:46 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-5f017ed8-2f22-45a4-8799-a1f017cca359 tempest-CreateVolumesFromImageTest-2002239375 None] Volume volume-5883ef09-0775-4b73-888f-2e708db8c4a1 (5883ef09-0775-4b73-888f-2e708db8c4a1): created successfully Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5f017ed8-2f22-45a4-8799-a1f017cca359 tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df2f0c4d-9d3b-48f2-b0b3-a54265aca772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-5f017ed8-2f22-45a4-8799-a1f017cca359 tempest-CreateVolumesFromImageTest-2002239375 None] Flow 'volume_create_manager' (df9ab352-2ed3-49bd-a56f-ea39b205d002) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:46 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-5f017ed8-2f22-45a4-8799-a1f017cca359 tempest-CreateVolumesFromImageTest-2002239375 None] Created volume successfully. Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-b0407102-eb85-4884-9a33-13ca53b30a0e tempest-ProjectReaderTests-1706512272 None] Created reservations ['e8170591-3d5b-432e-81f8-c09195daaba8', '5c94eb80-43c8-4313-bf39-d7496e611001', '95ecc7bd-eacf-44ad-8d17-30655d1e39e4', '9e62d8a8-b1cb-4c19-a7d6-b9fcf3e5a33b'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b0407102-eb85-4884-9a33-13ca53b30a0e tempest-ProjectReaderTests-1706512272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b0407102-eb85-4884-9a33-13ca53b30a0e tempest-ProjectReaderTests-1706512272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-b0407102-eb85-4884-9a33-13ca53b30a0e tempest-ProjectReaderTests-1706512272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-b0407102-eb85-4884-9a33-13ca53b30a0e tempest-ProjectReaderTests-1706512272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b0407102-eb85-4884-9a33-13ca53b30a0e tempest-ProjectReaderTests-1706512272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b0407102-eb85-4884-9a33-13ca53b30a0e tempest-ProjectReaderTests-1706512272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:46 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:31:46 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:46 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fe37739e-5e36-48b0-b110-df662bb9d60e tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633.1595d3d8-59a8-4ede-a1b3-23795d19aa84" returned: 0 in 0.376s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fe37739e-5e36-48b0-b110-df662bb9d60e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633.1595d3d8-59a8-4ede-a1b3-23795d19aa84 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:46 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633.1595d3d8-59a8-4ede-a1b3-23795d19aa84 Sep 03 11:31:46 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:46 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b18d69dc-8c2d-47ff-baba-ae366c066732 tempest-CreateVolumesFromImageTest-2002239375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5ce63040-9fea-4d68-a6cd-bd50344c4706 1073741824" returned: 0 in 0.442s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b18d69dc-8c2d-47ff-baba-ae366c066732 tempest-CreateVolumesFromImageTest-2002239375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5ce63040-9fea-4d68-a6cd-bd50344c4706 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:46 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b0407102-eb85-4884-9a33-13ca53b30a0e tempest-ProjectReaderTests-1706512272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.281s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:47 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-b0407102-eb85-4884-9a33-13ca53b30a0e tempest-ProjectReaderTests-1706512272 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:31:47 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-b0407102-eb85-4884-9a33-13ca53b30a0e tempest-ProjectReaderTests-1706512272 None] Deleted volume successfully. Sep 03 11:31:47 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5ce63040-9fea-4d68-a6cd-bd50344c4706 Sep 03 11:31:47 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:47 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b0407102-eb85-4884-9a33-13ca53b30a0e tempest-ProjectReaderTests-1706512272 None] Lock "cinder-30353c7b-92fb-47e2-93a2-d7c20d31f2e4-delete_volume" released by "delete_volume" :: held 1.595s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:47 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fe37739e-5e36-48b0-b110-df662bb9d60e tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633.1595d3d8-59a8-4ede-a1b3-23795d19aa84" returned: 0 in 0.264s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:47 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fe37739e-5e36-48b0-b110-df662bb9d60e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "cinder-quobyte-1595d3d8-59a8-4ede-a1b3-23795d19aa84" released by "_delete_snapshot" :: held 1.636s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:47 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fe37739e-5e36-48b0-b110-df662bb9d60e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "cinder-quobyte-27fad037-87dd-42ea-b527-77f67f40b633" released by "delete_snapshot" :: held 1.674s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:47 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-fe37739e-5e36-48b0-b110-df662bb9d60e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Created reservations ['5cce66bc-eb93-4a3c-8fe8-cce3eb635b54', '83b5bc9a-f716-4092-942e-daef04e1928b', '7fcc9903-2c92-49d6-ab5c-488d34448ccb', '0bc49b42-9dda-46fb-8850-a56964a32c12'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:31:47 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-fe37739e-5e36-48b0-b110-df662bb9d60e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Delete snapshot completed successfully. Sep 03 11:31:47 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fe37739e-5e36-48b0-b110-df662bb9d60e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "cinder-1595d3d8-59a8-4ede-a1b3-23795d19aa84-delete_snapshot" released by "delete_snapshot" :: held 1.926s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:47 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b18d69dc-8c2d-47ff-baba-ae366c066732 tempest-CreateVolumesFromImageTest-2002239375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5ce63040-9fea-4d68-a6cd-bd50344c4706" returned: 0 in 0.244s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:47 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-b18d69dc-8c2d-47ff-baba-ae366c066732 tempest-CreateVolumesFromImageTest-2002239375 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:31:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b18d69dc-8c2d-47ff-baba-ae366c066732 tempest-CreateVolumesFromImageTest-2002239375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a06c5937-4544-41b4-ae46-51cc4900a48b tempest-CreateVolumesFromImageTest-2002239375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.413s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:47 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a06c5937-4544-41b4-ae46-51cc4900a48b tempest-CreateVolumesFromImageTest-2002239375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1018612203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6db3dce9-657b-40af-b069-29e0e915b18b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16336534399b443cab33d66042944c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:45Z,use_quota=True,user_id='a062e4d3291344028446b9e38d3255c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:31:47 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-a06c5937-4544-41b4-ae46-51cc4900a48b tempest-CreateVolumesFromImageTest-2002239375 None] Creating volume 6db3dce9-657b-40af-b069-29e0e915b18b {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:31:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a06c5937-4544-41b4-ae46-51cc4900a48b tempest-CreateVolumesFromImageTest-2002239375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a06c5937-4544-41b4-ae46-51cc4900a48b tempest-CreateVolumesFromImageTest-2002239375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:47 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a06c5937-4544-41b4-ae46-51cc4900a48b tempest-CreateVolumesFromImageTest-2002239375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:47 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a06c5937-4544-41b4-ae46-51cc4900a48b tempest-CreateVolumesFromImageTest-2002239375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a06c5937-4544-41b4-ae46-51cc4900a48b tempest-CreateVolumesFromImageTest-2002239375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:47 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a06c5937-4544-41b4-ae46-51cc4900a48b tempest-CreateVolumesFromImageTest-2002239375 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:31:47 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-a06c5937-4544-41b4-ae46-51cc4900a48b tempest-CreateVolumesFromImageTest-2002239375 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:31:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a06c5937-4544-41b4-ae46-51cc4900a48b tempest-CreateVolumesFromImageTest-2002239375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6db3dce9-657b-40af-b069-29e0e915b18b 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-b18d69dc-8c2d-47ff-baba-ae366c066732 tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d52cfae4-ca92-418e-a7ae-4fbaa03125f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ce63040-9fea-4d68-a6cd-bd50344c4706', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:47 devstack sudo[105937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6db3dce9-657b-40af-b069-29e0e915b18b 1073741824 Sep 03 11:31:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-b18d69dc-8c2d-47ff-baba-ae366c066732 tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc7debcc-e658-4d72-a69d-491efc728d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:47 devstack sudo[105937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:47 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-b18d69dc-8c2d-47ff-baba-ae366c066732 tempest-CreateVolumesFromImageTest-2002239375 None] Volume volume-5ce63040-9fea-4d68-a6cd-bd50344c4706 (5ce63040-9fea-4d68-a6cd-bd50344c4706): created successfully Sep 03 11:31:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-b18d69dc-8c2d-47ff-baba-ae366c066732 tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc7debcc-e658-4d72-a69d-491efc728d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:47 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-b18d69dc-8c2d-47ff-baba-ae366c066732 tempest-CreateVolumesFromImageTest-2002239375 None] Flow 'volume_create_manager' (f3decbaf-d9f1-490a-837b-bbc6409c2ac7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:47 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-b18d69dc-8c2d-47ff-baba-ae366c066732 tempest-CreateVolumesFromImageTest-2002239375 None] Created volume successfully. Sep 03 11:31:47 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3d89d630-c0fb-4f0a-993a-961cfdcac09e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Acquiring lock "cinder-27fad037-87dd-42ea-b527-77f67f40b633-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:47 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3d89d630-c0fb-4f0a-993a-961cfdcac09e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "cinder-27fad037-87dd-42ea-b527-77f67f40b633-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:47 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3d89d630-c0fb-4f0a-993a-961cfdcac09e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Acquiring lock "cinder-quobyte-27fad037-87dd-42ea-b527-77f67f40b633" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:47 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3d89d630-c0fb-4f0a-993a-961cfdcac09e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "cinder-quobyte-27fad037-87dd-42ea-b527-77f67f40b633" acquired by "delete_volume" :: waited 0.021s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:47 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[26118a52-8ef5-4475-acaf-6ec3a0f1e0e9]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3d89d630-c0fb-4f0a-993a-961cfdcac09e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:47 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633 Sep 03 11:31:47 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:47 devstack sudo[105937]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a06c5937-4544-41b4-ae46-51cc4900a48b tempest-CreateVolumesFromImageTest-2002239375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6db3dce9-657b-40af-b069-29e0e915b18b 1073741824" returned: 0 in 0.490s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a06c5937-4544-41b4-ae46-51cc4900a48b tempest-CreateVolumesFromImageTest-2002239375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6db3dce9-657b-40af-b069-29e0e915b18b {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:47 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6db3dce9-657b-40af-b069-29e0e915b18b Sep 03 11:31:47 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:48 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3d89d630-c0fb-4f0a-993a-961cfdcac09e tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633" returned: 0 in 0.420s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3d89d630-c0fb-4f0a-993a-961cfdcac09e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:48 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a06c5937-4544-41b4-ae46-51cc4900a48b tempest-CreateVolumesFromImageTest-2002239375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6db3dce9-657b-40af-b069-29e0e915b18b" returned: 0 in 0.274s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:48 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633 Sep 03 11:31:48 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a06c5937-4544-41b4-ae46-51cc4900a48b tempest-CreateVolumesFromImageTest-2002239375 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a06c5937-4544-41b4-ae46-51cc4900a48b tempest-CreateVolumesFromImageTest-2002239375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-52332281-3cd4-455c-aca2-82d453999c78 tempest-CreateVolumesFromImageTest-2002239375 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.637s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-52332281-3cd4-455c-aca2-82d453999c78 tempest-CreateVolumesFromImageTest-2002239375 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-936277581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdba6f2b-30ff-41f3-a41d-60be6677a399,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='16336534399b443cab33d66042944c00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:45Z,use_quota=True,user_id='a062e4d3291344028446b9e38d3255c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-52332281-3cd4-455c-aca2-82d453999c78 tempest-CreateVolumesFromImageTest-2002239375 None] Creating volume fdba6f2b-30ff-41f3-a41d-60be6677a399 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-52332281-3cd4-455c-aca2-82d453999c78 tempest-CreateVolumesFromImageTest-2002239375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-52332281-3cd4-455c-aca2-82d453999c78 tempest-CreateVolumesFromImageTest-2002239375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-52332281-3cd4-455c-aca2-82d453999c78 tempest-CreateVolumesFromImageTest-2002239375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-52332281-3cd4-455c-aca2-82d453999c78 tempest-CreateVolumesFromImageTest-2002239375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-52332281-3cd4-455c-aca2-82d453999c78 tempest-CreateVolumesFromImageTest-2002239375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-52332281-3cd4-455c-aca2-82d453999c78 tempest-CreateVolumesFromImageTest-2002239375 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:31:48 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-52332281-3cd4-455c-aca2-82d453999c78 tempest-CreateVolumesFromImageTest-2002239375 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-52332281-3cd4-455c-aca2-82d453999c78 tempest-CreateVolumesFromImageTest-2002239375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fdba6f2b-30ff-41f3-a41d-60be6677a399 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:48 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fdba6f2b-30ff-41f3-a41d-60be6677a399 1073741824 Sep 03 11:31:48 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a06c5937-4544-41b4-ae46-51cc4900a48b tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5caa7df8-2667-4c45-bd6b-ded61e74ece0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6db3dce9-657b-40af-b069-29e0e915b18b', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a06c5937-4544-41b4-ae46-51cc4900a48b tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (872a5261-de78-4649-8f2c-ec242c0c165d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:48 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-a06c5937-4544-41b4-ae46-51cc4900a48b tempest-CreateVolumesFromImageTest-2002239375 None] Volume volume-6db3dce9-657b-40af-b069-29e0e915b18b (6db3dce9-657b-40af-b069-29e0e915b18b): created successfully Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a06c5937-4544-41b4-ae46-51cc4900a48b tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (872a5261-de78-4649-8f2c-ec242c0c165d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a06c5937-4544-41b4-ae46-51cc4900a48b tempest-CreateVolumesFromImageTest-2002239375 None] Flow 'volume_create_manager' (d525abf0-3731-4502-991f-40004f89f3ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae1c793b-0dc9-407f-927b-0aa99d06b8a3 tempest-ProjectReaderTests-1706512272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ae1c793b-0dc9-407f-927b-0aa99d06b8a3 tempest-ProjectReaderTests-1706512272 None] Flow 'volume_create_manager' (b84c298c-674b-4aec-96ca-cf0e03b9dc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ae1c793b-0dc9-407f-927b-0aa99d06b8a3 tempest-ProjectReaderTests-1706512272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d03024a-60d4-4b40-89a4-b56b425065b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:48 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-a06c5937-4544-41b4-ae46-51cc4900a48b tempest-CreateVolumesFromImageTest-2002239375 None] Created volume successfully. Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ae1c793b-0dc9-407f-927b-0aa99d06b8a3 tempest-ProjectReaderTests-1706512272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d03024a-60d4-4b40-89a4-b56b425065b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-283590364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4f66560-6f93-4a1b-b78f-9861745b88c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34172391a9b54e849dad54bb44ecaa7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:48Z,use_quota=True,user_id='652bb9fce2214af7a43bd927d891e265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ae1c793b-0dc9-407f-927b-0aa99d06b8a3 tempest-ProjectReaderTests-1706512272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46dbfef2-9342-4871-8ef1-67c9b775d224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ae1c793b-0dc9-407f-927b-0aa99d06b8a3 tempest-ProjectReaderTests-1706512272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46dbfef2-9342-4871-8ef1-67c9b775d224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ae1c793b-0dc9-407f-927b-0aa99d06b8a3 tempest-ProjectReaderTests-1706512272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74fdd740-77f9-4db6-af61-15c2366527f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ae1c793b-0dc9-407f-927b-0aa99d06b8a3 tempest-ProjectReaderTests-1706512272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74fdd740-77f9-4db6-af61-15c2366527f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4f66560-6f93-4a1b-b78f-9861745b88c1', 'volume_name': 'volume-c4f66560-6f93-4a1b-b78f-9861745b88c1', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ae1c793b-0dc9-407f-927b-0aa99d06b8a3 tempest-ProjectReaderTests-1706512272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e8736dc-b833-405b-997d-9085a27fae32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ae1c793b-0dc9-407f-927b-0aa99d06b8a3 tempest-ProjectReaderTests-1706512272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e8736dc-b833-405b-997d-9085a27fae32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ae1c793b-0dc9-407f-927b-0aa99d06b8a3 tempest-ProjectReaderTests-1706512272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71565a7f-0f2b-4dc0-a1fd-32a42a0b6072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:48 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-ae1c793b-0dc9-407f-927b-0aa99d06b8a3 tempest-ProjectReaderTests-1706512272 None] Volume c4f66560-6f93-4a1b-b78f-9861745b88c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4f66560-6f93-4a1b-b78f-9861745b88c1', 'volume_size': 1} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ae1c793b-0dc9-407f-927b-0aa99d06b8a3 tempest-ProjectReaderTests-1706512272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:48 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3d89d630-c0fb-4f0a-993a-961cfdcac09e tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-27fad037-87dd-42ea-b527-77f67f40b633" returned: 0 in 0.256s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3d89d630-c0fb-4f0a-993a-961cfdcac09e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "cinder-quobyte-27fad037-87dd-42ea-b527-77f67f40b633" released by "delete_volume" :: held 0.729s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-3d89d630-c0fb-4f0a-993a-961cfdcac09e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Created reservations ['923bb14d-edfa-4df5-a91e-82a0e256f549', '51b19dab-617a-4a62-92a4-c4c35b361e52', 'cc03ddc1-3279-426b-8f92-0005826d9277', 'dc0682b1-072c-489a-8e2d-9127f197abcf'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3d89d630-c0fb-4f0a-993a-961cfdcac09e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3d89d630-c0fb-4f0a-993a-961cfdcac09e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-3d89d630-c0fb-4f0a-993a-961cfdcac09e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-3d89d630-c0fb-4f0a-993a-961cfdcac09e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3d89d630-c0fb-4f0a-993a-961cfdcac09e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3d89d630-c0fb-4f0a-993a-961cfdcac09e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:48 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:31:48 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:48 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-52332281-3cd4-455c-aca2-82d453999c78 tempest-CreateVolumesFromImageTest-2002239375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fdba6f2b-30ff-41f3-a41d-60be6677a399 1073741824" returned: 0 in 0.478s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-52332281-3cd4-455c-aca2-82d453999c78 tempest-CreateVolumesFromImageTest-2002239375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fdba6f2b-30ff-41f3-a41d-60be6677a399 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:48 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fdba6f2b-30ff-41f3-a41d-60be6677a399 Sep 03 11:31:48 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:48 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3d89d630-c0fb-4f0a-993a-961cfdcac09e tempest-CreateVolumesFromSnapshotTest-2066319807 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.273s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-3d89d630-c0fb-4f0a-993a-961cfdcac09e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:31:48 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-3d89d630-c0fb-4f0a-993a-961cfdcac09e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Deleted volume successfully. Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-3d89d630-c0fb-4f0a-993a-961cfdcac09e tempest-CreateVolumesFromSnapshotTest-2066319807 None] Lock "cinder-27fad037-87dd-42ea-b527-77f67f40b633-delete_volume" released by "delete_volume" :: held 1.234s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:48 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-52332281-3cd4-455c-aca2-82d453999c78 tempest-CreateVolumesFromImageTest-2002239375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fdba6f2b-30ff-41f3-a41d-60be6677a399" returned: 0 in 0.262s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-52332281-3cd4-455c-aca2-82d453999c78 tempest-CreateVolumesFromImageTest-2002239375 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-52332281-3cd4-455c-aca2-82d453999c78 tempest-CreateVolumesFromImageTest-2002239375 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.799s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.601s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84fcf367-0e7a-4bca-942b-7d9d44ac9f79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9fddfe1f73e47838e45eb249d934913',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:43Z,use_quota=True,user_id='f0ff1e3319ad4b2eb01a8b39b5b22862',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Creating volume 84fcf367-0e7a-4bca-942b-7d9d44ac9f79 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:31:48 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-84fcf367-0e7a-4bca-942b-7d9d44ac9f79 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-52332281-3cd4-455c-aca2-82d453999c78 tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee11603-cfc4-40fa-83b3-296ab4205fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdba6f2b-30ff-41f3-a41d-60be6677a399', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:48 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-84fcf367-0e7a-4bca-942b-7d9d44ac9f79 1073741824 Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-52332281-3cd4-455c-aca2-82d453999c78 tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27fa028b-f778-41a2-9fa8-c0e0cb025cae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:48 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:48 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-52332281-3cd4-455c-aca2-82d453999c78 tempest-CreateVolumesFromImageTest-2002239375 None] Volume volume-fdba6f2b-30ff-41f3-a41d-60be6677a399 (fdba6f2b-30ff-41f3-a41d-60be6677a399): created successfully Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-52332281-3cd4-455c-aca2-82d453999c78 tempest-CreateVolumesFromImageTest-2002239375 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27fa028b-f778-41a2-9fa8-c0e0cb025cae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:48 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-52332281-3cd4-455c-aca2-82d453999c78 tempest-CreateVolumesFromImageTest-2002239375 None] Flow 'volume_create_manager' (5826cdf0-136f-47c1-b1ed-bf97f7e242ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:48 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-52332281-3cd4-455c-aca2-82d453999c78 tempest-CreateVolumesFromImageTest-2002239375 None] Created volume successfully. Sep 03 11:31:49 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-84fcf367-0e7a-4bca-942b-7d9d44ac9f79 1073741824" returned: 0 in 0.480s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-84fcf367-0e7a-4bca-942b-7d9d44ac9f79 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:49 devstack sudo[105973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-84fcf367-0e7a-4bca-942b-7d9d44ac9f79 Sep 03 11:31:49 devstack sudo[105973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:49 devstack sudo[105973]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-84fcf367-0e7a-4bca-942b-7d9d44ac9f79" returned: 0 in 0.249s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:49 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:31:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ae1c793b-0dc9-407f-927b-0aa99d06b8a3 tempest-ProjectReaderTests-1706512272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.461s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:49 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ae1c793b-0dc9-407f-927b-0aa99d06b8a3 tempest-ProjectReaderTests-1706512272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-283590364',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4f66560-6f93-4a1b-b78f-9861745b88c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34172391a9b54e849dad54bb44ecaa7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:48Z,use_quota=True,user_id='652bb9fce2214af7a43bd927d891e265',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:31:49 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-ae1c793b-0dc9-407f-927b-0aa99d06b8a3 tempest-ProjectReaderTests-1706512272 None] Creating volume c4f66560-6f93-4a1b-b78f-9861745b88c1 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:31:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ae1c793b-0dc9-407f-927b-0aa99d06b8a3 tempest-ProjectReaderTests-1706512272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ae1c793b-0dc9-407f-927b-0aa99d06b8a3 tempest-ProjectReaderTests-1706512272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:49 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ae1c793b-0dc9-407f-927b-0aa99d06b8a3 tempest-ProjectReaderTests-1706512272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:49 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ae1c793b-0dc9-407f-927b-0aa99d06b8a3 tempest-ProjectReaderTests-1706512272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ae1c793b-0dc9-407f-927b-0aa99d06b8a3 tempest-ProjectReaderTests-1706512272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:49 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ae1c793b-0dc9-407f-927b-0aa99d06b8a3 tempest-ProjectReaderTests-1706512272 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:31:49 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-ae1c793b-0dc9-407f-927b-0aa99d06b8a3 tempest-ProjectReaderTests-1706512272 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:31:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ae1c793b-0dc9-407f-927b-0aa99d06b8a3 tempest-ProjectReaderTests-1706512272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c4f66560-6f93-4a1b-b78f-9861745b88c1 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:49 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c4f66560-6f93-4a1b-b78f-9861745b88c1 1073741824 Sep 03 11:31:49 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:49 devstack cinder-volume[87038]: DEBUG cinder.volume.volume_utils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Attempting download of e4b52f5b-3d69-48b7-9519-2f066d3a86cf ((None, [{'url': 'file:///opt/stack/data/glance/images/e4b52f5b-3d69-48b7-9519-2f066d3a86cf', 'metadata': {}}])) to volume 84fcf367-0e7a-4bca-942b-7d9d44ac9f79. {{(pid=87038) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 11:31:49 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[007f813d-ea64-49e7-b953-f054fcf5c1df]: (4, 'raw') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e4b52f5b-3d69-48b7-9519-2f066d3a86cf_3_j698de {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:49 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b167021b-3903-422a-9118-ca476809d508 tempest-CreateVolumesFromImageTest-2002239375 None] Acquiring lock "cinder-fdba6f2b-30ff-41f3-a41d-60be6677a399-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:49 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b167021b-3903-422a-9118-ca476809d508 tempest-CreateVolumesFromImageTest-2002239375 None] Lock "cinder-fdba6f2b-30ff-41f3-a41d-60be6677a399-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:49 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b167021b-3903-422a-9118-ca476809d508 tempest-CreateVolumesFromImageTest-2002239375 None] Acquiring lock "cinder-quobyte-fdba6f2b-30ff-41f3-a41d-60be6677a399" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:49 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b167021b-3903-422a-9118-ca476809d508 tempest-CreateVolumesFromImageTest-2002239375 None] Lock "cinder-quobyte-fdba6f2b-30ff-41f3-a41d-60be6677a399" acquired by "delete_volume" :: waited 0.017s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:49 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[104a7ada-abe4-4ac2-afc0-604412900226]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b167021b-3903-422a-9118-ca476809d508 tempest-CreateVolumesFromImageTest-2002239375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fdba6f2b-30ff-41f3-a41d-60be6677a399 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:49 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e4b52f5b-3d69-48b7-9519-2f066d3a86cf_3_j698de Sep 03 11:31:49 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:50 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fdba6f2b-30ff-41f3-a41d-60be6677a399 Sep 03 11:31:50 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:50 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ae1c793b-0dc9-407f-927b-0aa99d06b8a3 tempest-ProjectReaderTests-1706512272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c4f66560-6f93-4a1b-b78f-9861745b88c1 1073741824" returned: 0 in 0.558s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ae1c793b-0dc9-407f-927b-0aa99d06b8a3 tempest-ProjectReaderTests-1706512272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c4f66560-6f93-4a1b-b78f-9861745b88c1 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:50 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e4b52f5b-3d69-48b7-9519-2f066d3a86cf_3_j698de" returned: 0 in 0.533s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4b52f5b-3d69-48b7-9519-2f066d3a86cf_3_j698de {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:50 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c4f66560-6f93-4a1b-b78f-9861745b88c1 Sep 03 11:31:50 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:50 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b167021b-3903-422a-9118-ca476809d508 tempest-CreateVolumesFromImageTest-2002239375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fdba6f2b-30ff-41f3-a41d-60be6677a399" returned: 0 in 0.470s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b167021b-3903-422a-9118-ca476809d508 tempest-CreateVolumesFromImageTest-2002239375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fdba6f2b-30ff-41f3-a41d-60be6677a399 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:50 devstack sudo[105995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fdba6f2b-30ff-41f3-a41d-60be6677a399 Sep 03 11:31:50 devstack sudo[105995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:50 devstack sudo[105991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4b52f5b-3d69-48b7-9519-2f066d3a86cf_3_j698de Sep 03 11:31:50 devstack sudo[105991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:50 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ae1c793b-0dc9-407f-927b-0aa99d06b8a3 tempest-ProjectReaderTests-1706512272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c4f66560-6f93-4a1b-b78f-9861745b88c1" returned: 0 in 0.344s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:50 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ae1c793b-0dc9-407f-927b-0aa99d06b8a3 tempest-ProjectReaderTests-1706512272 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:31:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ae1c793b-0dc9-407f-927b-0aa99d06b8a3 tempest-ProjectReaderTests-1706512272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.969s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ae1c793b-0dc9-407f-927b-0aa99d06b8a3 tempest-ProjectReaderTests-1706512272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71565a7f-0f2b-4dc0-a1fd-32a42a0b6072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4f66560-6f93-4a1b-b78f-9861745b88c1', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ae1c793b-0dc9-407f-927b-0aa99d06b8a3 tempest-ProjectReaderTests-1706512272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa7b47f-7b83-44aa-8a92-04c274eb5de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:50 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-ae1c793b-0dc9-407f-927b-0aa99d06b8a3 tempest-ProjectReaderTests-1706512272 None] Volume volume-c4f66560-6f93-4a1b-b78f-9861745b88c1 (c4f66560-6f93-4a1b-b78f-9861745b88c1): created successfully Sep 03 11:31:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ae1c793b-0dc9-407f-927b-0aa99d06b8a3 tempest-ProjectReaderTests-1706512272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fa7b47f-7b83-44aa-8a92-04c274eb5de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:50 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ae1c793b-0dc9-407f-927b-0aa99d06b8a3 tempest-ProjectReaderTests-1706512272 None] Flow 'volume_create_manager' (b84c298c-674b-4aec-96ca-cf0e03b9dc90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:50 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-ae1c793b-0dc9-407f-927b-0aa99d06b8a3 tempest-ProjectReaderTests-1706512272 None] Created volume successfully. Sep 03 11:31:50 devstack sudo[105991]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4b52f5b-3d69-48b7-9519-2f066d3a86cf_3_j698de" returned: 1 in 0.425s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e4b52f5b-3d69-48b7-9519-2f066d3a86cf_3_j698de' failed. Not Retrying. {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:31:50 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d740a5e-1ef2-4869-baa3-91373eb6ed5f]: (4, 'raw') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b52f5b-3d69-48b7-9519-2f066d3a86cf_57kl6y77devstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:50 devstack sudo[105995]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b167021b-3903-422a-9118-ca476809d508 tempest-CreateVolumesFromImageTest-2002239375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-fdba6f2b-30ff-41f3-a41d-60be6677a399" returned: 0 in 0.335s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:50 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b167021b-3903-422a-9118-ca476809d508 tempest-CreateVolumesFromImageTest-2002239375 None] Lock "cinder-quobyte-fdba6f2b-30ff-41f3-a41d-60be6677a399" released by "delete_volume" :: held 0.850s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:50 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-b167021b-3903-422a-9118-ca476809d508 tempest-CreateVolumesFromImageTest-2002239375 None] Created reservations ['389db0c1-b424-470d-b482-8140bc68e756', '25ad4587-6199-401d-9b70-ae8159be527c', 'e7144f81-0a12-465a-a984-599dd075830a', '213cc30e-1f07-4acd-b753-002907e1ab9b'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:31:50 devstack sudo[106002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b52f5b-3d69-48b7-9519-2f066d3a86cf_57kl6y77devstack@QuobyteHD Sep 03 11:31:50 devstack sudo[106002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b167021b-3903-422a-9118-ca476809d508 tempest-CreateVolumesFromImageTest-2002239375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b167021b-3903-422a-9118-ca476809d508 tempest-CreateVolumesFromImageTest-2002239375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:50 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-b167021b-3903-422a-9118-ca476809d508 tempest-CreateVolumesFromImageTest-2002239375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:50 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-b167021b-3903-422a-9118-ca476809d508 tempest-CreateVolumesFromImageTest-2002239375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b167021b-3903-422a-9118-ca476809d508 tempest-CreateVolumesFromImageTest-2002239375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b167021b-3903-422a-9118-ca476809d508 tempest-CreateVolumesFromImageTest-2002239375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:50 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:31:50 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:51 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-84a9fded-2d50-4c7b-bd73-6d813dad0779 tempest-CreateVolumesFromImageTest-2002239375 None] Acquiring lock "cinder-6db3dce9-657b-40af-b069-29e0e915b18b-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:51 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-84a9fded-2d50-4c7b-bd73-6d813dad0779 tempest-CreateVolumesFromImageTest-2002239375 None] Lock "cinder-6db3dce9-657b-40af-b069-29e0e915b18b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:51 devstack sudo[106002]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:51 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-84a9fded-2d50-4c7b-bd73-6d813dad0779 tempest-CreateVolumesFromImageTest-2002239375 None] Acquiring lock "cinder-quobyte-6db3dce9-657b-40af-b069-29e0e915b18b" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b52f5b-3d69-48b7-9519-2f066d3a86cf_57kl6y77devstack@QuobyteHD" returned: 0 in 0.431s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b52f5b-3d69-48b7-9519-2f066d3a86cf_57kl6y77devstack@QuobyteHD {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:51 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-84a9fded-2d50-4c7b-bd73-6d813dad0779 tempest-CreateVolumesFromImageTest-2002239375 None] Lock "cinder-quobyte-6db3dce9-657b-40af-b069-29e0e915b18b" acquired by "delete_volume" :: waited 0.038s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:51 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[e11889a3-35fe-40c7-9c56-ba40e9b6eb8e]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-84a9fded-2d50-4c7b-bd73-6d813dad0779 tempest-CreateVolumesFromImageTest-2002239375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6db3dce9-657b-40af-b069-29e0e915b18b {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:51 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b167021b-3903-422a-9118-ca476809d508 tempest-CreateVolumesFromImageTest-2002239375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.365s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:51 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-b167021b-3903-422a-9118-ca476809d508 tempest-CreateVolumesFromImageTest-2002239375 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:31:51 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-b167021b-3903-422a-9118-ca476809d508 tempest-CreateVolumesFromImageTest-2002239375 None] Deleted volume successfully. Sep 03 11:31:51 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b167021b-3903-422a-9118-ca476809d508 tempest-CreateVolumesFromImageTest-2002239375 None] Lock "cinder-fdba6f2b-30ff-41f3-a41d-60be6677a399-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:51 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-0cf0ce3f-b613-4c0a-a6f7-3ef62e3e75d9 tempest-ProjectReaderTests-1706512272 None] Acquiring lock "cinder-c4f66560-6f93-4a1b-b78f-9861745b88c1-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:51 devstack sudo[106008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b52f5b-3d69-48b7-9519-2f066d3a86cf_57kl6y77devstack@QuobyteHD Sep 03 11:31:51 devstack sudo[106008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:51 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-0cf0ce3f-b613-4c0a-a6f7-3ef62e3e75d9 tempest-ProjectReaderTests-1706512272 None] Lock "cinder-c4f66560-6f93-4a1b-b78f-9861745b88c1-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:51 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-0cf0ce3f-b613-4c0a-a6f7-3ef62e3e75d9 tempest-ProjectReaderTests-1706512272 None] Acquiring lock "cinder-quobyte-c4f66560-6f93-4a1b-b78f-9861745b88c1" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:51 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-0cf0ce3f-b613-4c0a-a6f7-3ef62e3e75d9 tempest-ProjectReaderTests-1706512272 None] Lock "cinder-quobyte-c4f66560-6f93-4a1b-b78f-9861745b88c1" acquired by "delete_volume" :: waited 0.023s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:51 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6db3dce9-657b-40af-b069-29e0e915b18b Sep 03 11:31:51 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:51 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c149d2-4716-421b-8330-515ce2a1c77c]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0cf0ce3f-b613-4c0a-a6f7-3ef62e3e75d9 tempest-ProjectReaderTests-1706512272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c4f66560-6f93-4a1b-b78f-9861745b88c1 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:51 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c4f66560-6f93-4a1b-b78f-9861745b88c1 Sep 03 11:31:51 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:51 devstack sudo[106008]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b52f5b-3d69-48b7-9519-2f066d3a86cf_57kl6y77devstack@QuobyteHD" returned: 1 in 0.465s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e4b52f5b-3d69-48b7-9519-2f066d3a86cf_57kl6y77devstack@QuobyteHD' failed. Not Retrying. {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:31:51 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] e4b52f5b-3d69-48b7-9519-2f066d3a86cf was raw, converting to qcow2 {{(pid=87038) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 11:31:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e4b52f5b-3d69-48b7-9519-2f066d3a86cf_57kl6y77devstack@QuobyteHD /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-84fcf367-0e7a-4bca-942b-7d9d44ac9f79 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:51 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e4b52f5b-3d69-48b7-9519-2f066d3a86cf_57kl6y77devstack@QuobyteHD /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-84fcf367-0e7a-4bca-942b-7d9d44ac9f79 Sep 03 11:31:51 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:51 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-84a9fded-2d50-4c7b-bd73-6d813dad0779 tempest-CreateVolumesFromImageTest-2002239375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6db3dce9-657b-40af-b069-29e0e915b18b" returned: 0 in 0.536s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-84a9fded-2d50-4c7b-bd73-6d813dad0779 tempest-CreateVolumesFromImageTest-2002239375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6db3dce9-657b-40af-b069-29e0e915b18b {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:51 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6db3dce9-657b-40af-b069-29e0e915b18b Sep 03 11:31:51 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:51 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0cf0ce3f-b613-4c0a-a6f7-3ef62e3e75d9 tempest-ProjectReaderTests-1706512272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c4f66560-6f93-4a1b-b78f-9861745b88c1" returned: 0 in 0.437s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0cf0ce3f-b613-4c0a-a6f7-3ef62e3e75d9 tempest-ProjectReaderTests-1706512272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c4f66560-6f93-4a1b-b78f-9861745b88c1 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:51 devstack sudo[106031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c4f66560-6f93-4a1b-b78f-9861745b88c1 Sep 03 11:31:51 devstack sudo[106031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:52 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-84a9fded-2d50-4c7b-bd73-6d813dad0779 tempest-CreateVolumesFromImageTest-2002239375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6db3dce9-657b-40af-b069-29e0e915b18b" returned: 0 in 0.316s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-84a9fded-2d50-4c7b-bd73-6d813dad0779 tempest-CreateVolumesFromImageTest-2002239375 None] Lock "cinder-quobyte-6db3dce9-657b-40af-b069-29e0e915b18b" released by "delete_volume" :: held 0.925s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:52 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e4b52f5b-3d69-48b7-9519-2f066d3a86cf_57kl6y77devstack@QuobyteHD /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-84fcf367-0e7a-4bca-942b-7d9d44ac9f79" returned: 0 in 0.499s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e4b52f5b-3d69-48b7-9519-2f066d3a86cf_57kl6y77devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-84fcf367-0e7a-4bca-942b-7d9d44ac9f79 {{(pid=87038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:31:52 devstack cinder-volume[87038]: INFO cinder.image.image_utils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Converted 0.00 MB image at 0.00 MB/s Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-84fcf367-0e7a-4bca-942b-7d9d44ac9f79 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:52 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-84fcf367-0e7a-4bca-942b-7d9d44ac9f79 1G Sep 03 11:31:52 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-84a9fded-2d50-4c7b-bd73-6d813dad0779 tempest-CreateVolumesFromImageTest-2002239375 None] Created reservations ['1fa4846e-03b0-40b7-ac43-ff53422bf61e', 'f42d42b1-1212-4a8f-99eb-ab91e6b4ba7f', '64f9dbca-09df-498a-aa86-3b7c094f05ba', '5c7e5b98-d287-4a3c-995f-156ed565f5e6'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:31:52 devstack sudo[106031]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0cf0ce3f-b613-4c0a-a6f7-3ef62e3e75d9 tempest-ProjectReaderTests-1706512272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c4f66560-6f93-4a1b-b78f-9861745b88c1" returned: 0 in 0.306s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-0cf0ce3f-b613-4c0a-a6f7-3ef62e3e75d9 tempest-ProjectReaderTests-1706512272 None] Lock "cinder-quobyte-c4f66560-6f93-4a1b-b78f-9861745b88c1" released by "delete_volume" :: held 0.818s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-84a9fded-2d50-4c7b-bd73-6d813dad0779 tempest-CreateVolumesFromImageTest-2002239375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-84a9fded-2d50-4c7b-bd73-6d813dad0779 tempest-CreateVolumesFromImageTest-2002239375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-84a9fded-2d50-4c7b-bd73-6d813dad0779 tempest-CreateVolumesFromImageTest-2002239375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-84a9fded-2d50-4c7b-bd73-6d813dad0779 tempest-CreateVolumesFromImageTest-2002239375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-84a9fded-2d50-4c7b-bd73-6d813dad0779 tempest-CreateVolumesFromImageTest-2002239375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-84a9fded-2d50-4c7b-bd73-6d813dad0779 tempest-CreateVolumesFromImageTest-2002239375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-0cf0ce3f-b613-4c0a-a6f7-3ef62e3e75d9 tempest-ProjectReaderTests-1706512272 None] Created reservations ['800d63a5-7d66-4282-94a6-4cf85641b9cb', 'dfc3a20d-3c9a-447a-939e-550f461ec242', 'd87414eb-fd3b-4f21-83a7-36a28c67d34d', '55b06c04-975b-4754-9d41-22789c3fe1c1'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:31:52 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:31:52 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0cf0ce3f-b613-4c0a-a6f7-3ef62e3e75d9 tempest-ProjectReaderTests-1706512272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0cf0ce3f-b613-4c0a-a6f7-3ef62e3e75d9 tempest-ProjectReaderTests-1706512272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0cf0ce3f-b613-4c0a-a6f7-3ef62e3e75d9 tempest-ProjectReaderTests-1706512272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-0cf0ce3f-b613-4c0a-a6f7-3ef62e3e75d9 tempest-ProjectReaderTests-1706512272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0cf0ce3f-b613-4c0a-a6f7-3ef62e3e75d9 tempest-ProjectReaderTests-1706512272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0cf0ce3f-b613-4c0a-a6f7-3ef62e3e75d9 tempest-ProjectReaderTests-1706512272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:52 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:31:52 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:52 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-84fcf367-0e7a-4bca-942b-7d9d44ac9f79 1G" returned: 0 in 0.441s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG cinder.volume.volume_utils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Downloaded image e4b52f5b-3d69-48b7-9519-2f066d3a86cf ((None, [{'url': 'file:///opt/stack/data/glance/images/e4b52f5b-3d69-48b7-9519-2f066d3a86cf', 'metadata': {}}])) to volume 84fcf367-0e7a-4bca-942b-7d9d44ac9f79 successfully. {{(pid=87038) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Temporary image e4b52f5b-3d69-48b7-9519-2f066d3a86cf for user f0ff1e3319ad4b2eb01a8b39b5b22862 is deleted. {{(pid=87038) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG cinder.volume.volume_utils [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Marking volume 84fcf367-0e7a-4bca-942b-7d9d44ac9f79 as bootable. {{(pid=87038) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Copying metadata from image e4b52f5b-3d69-48b7-9519-2f066d3a86cf to 84fcf367-0e7a-4bca-942b-7d9d44ac9f79. {{(pid=87038) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Creating volume glance metadata for volume 84fcf367-0e7a-4bca-942b-7d9d44ac9f79 backed by image e4b52f5b-3d69-48b7-9519-2f066d3a86cf with: {'image_id': 'e4b52f5b-3d69-48b7-9519-2f066d3a86cf', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '6768403b2b7d475521ba623387d7c5d8', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87038) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 11:31:52 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-84a9fded-2d50-4c7b-bd73-6d813dad0779 tempest-CreateVolumesFromImageTest-2002239375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.347s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-84a9fded-2d50-4c7b-bd73-6d813dad0779 tempest-CreateVolumesFromImageTest-2002239375 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:31:52 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-84a9fded-2d50-4c7b-bd73-6d813dad0779 tempest-CreateVolumesFromImageTest-2002239375 None] Deleted volume successfully. Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-84a9fded-2d50-4c7b-bd73-6d813dad0779 tempest-CreateVolumesFromImageTest-2002239375 None] Lock "cinder-6db3dce9-657b-40af-b069-29e0e915b18b-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (823a34df-ff93-4753-89a3-a7bc4aead31b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84fcf367-0e7a-4bca-942b-7d9d44ac9f79', 'volume_size': 1, 'image_id': 'e4b52f5b-3d69-48b7-9519-2f066d3a86cf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e4b52f5b-3d69-48b7-9519-2f066d3a86cf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6768403b2b7d475521ba623387d7c5d8', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c9fddfe1f73e47838e45eb249d934913', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '37da4928afbd20e1e2b17aa44e67dff5c3c3445d391d4b8fe530ba9bfd4d261e373033ee8f0fdfd515b705e7e34c8e9c607b5b0d0a4e586a54e2fee82f50f375', 'id': 'e4b52f5b-3d69-48b7-9519-2f066d3a86cf', 'created_at': datetime.datetime(2026, 9, 3, 9, 31, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 31, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e4b52f5b-3d69-48b7-9519-2f066d3a86cf/file', 'properties': {}}, 'image_service': }' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21882bce-3b9c-48c4-8827-0243bd2a6379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:52 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Volume volume-84fcf367-0e7a-4bca-942b-7d9d44ac9f79 (84fcf367-0e7a-4bca-942b-7d9d44ac9f79): created successfully Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21882bce-3b9c-48c4-8827-0243bd2a6379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Flow 'volume_create_manager' (5a174fb4-d9c3-4906-aa52-83772798c164) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:52 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-7afb2c23-12f5-4828-92ce-998bcadf125c tempest-VolumeImageDependencyTests-2125893655 None] Created volume successfully. Sep 03 11:31:52 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0cf0ce3f-b613-4c0a-a6f7-3ef62e3e75d9 tempest-ProjectReaderTests-1706512272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.355s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-0cf0ce3f-b613-4c0a-a6f7-3ef62e3e75d9 tempest-ProjectReaderTests-1706512272 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:31:52 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-0cf0ce3f-b613-4c0a-a6f7-3ef62e3e75d9 tempest-ProjectReaderTests-1706512272 None] Deleted volume successfully. Sep 03 11:31:52 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-0cf0ce3f-b613-4c0a-a6f7-3ef62e3e75d9 tempest-ProjectReaderTests-1706512272 None] Lock "cinder-c4f66560-6f93-4a1b-b78f-9861745b88c1-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:53 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-57d9c2cb-52c9-4ebf-9178-a37a2689ed09 tempest-CreateVolumesFromImageTest-2002239375 None] Acquiring lock "cinder-5ce63040-9fea-4d68-a6cd-bd50344c4706-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:53 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-57d9c2cb-52c9-4ebf-9178-a37a2689ed09 tempest-CreateVolumesFromImageTest-2002239375 None] Lock "cinder-5ce63040-9fea-4d68-a6cd-bd50344c4706-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:53 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-57d9c2cb-52c9-4ebf-9178-a37a2689ed09 tempest-CreateVolumesFromImageTest-2002239375 None] Acquiring lock "cinder-quobyte-5ce63040-9fea-4d68-a6cd-bd50344c4706" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:53 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-57d9c2cb-52c9-4ebf-9178-a37a2689ed09 tempest-CreateVolumesFromImageTest-2002239375 None] Lock "cinder-quobyte-5ce63040-9fea-4d68-a6cd-bd50344c4706" acquired by "delete_volume" :: waited 0.018s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:53 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[de4d9eaf-1ca7-47a3-9065-e91a735f7222]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-57d9c2cb-52c9-4ebf-9178-a37a2689ed09 tempest-CreateVolumesFromImageTest-2002239375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5ce63040-9fea-4d68-a6cd-bd50344c4706 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:53 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5ce63040-9fea-4d68-a6cd-bd50344c4706 Sep 03 11:31:53 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:53 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-57d9c2cb-52c9-4ebf-9178-a37a2689ed09 tempest-CreateVolumesFromImageTest-2002239375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5ce63040-9fea-4d68-a6cd-bd50344c4706" returned: 0 in 0.396s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-57d9c2cb-52c9-4ebf-9178-a37a2689ed09 tempest-CreateVolumesFromImageTest-2002239375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5ce63040-9fea-4d68-a6cd-bd50344c4706 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:53 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5ce63040-9fea-4d68-a6cd-bd50344c4706 Sep 03 11:31:53 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:54 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fc3ea9c3-5df6-4b0b-825d-27f9f151e268 tempest-VolumeImageDependencyTests-2125893655 None] Acquiring lock "cinder-84fcf367-0e7a-4bca-942b-7d9d44ac9f79-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:54 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fc3ea9c3-5df6-4b0b-825d-27f9f151e268 tempest-VolumeImageDependencyTests-2125893655 None] Lock "cinder-84fcf367-0e7a-4bca-942b-7d9d44ac9f79-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:54 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fc3ea9c3-5df6-4b0b-825d-27f9f151e268 tempest-VolumeImageDependencyTests-2125893655 None] Acquiring lock "cinder-quobyte-84fcf367-0e7a-4bca-942b-7d9d44ac9f79" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:54 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-57d9c2cb-52c9-4ebf-9178-a37a2689ed09 tempest-CreateVolumesFromImageTest-2002239375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5ce63040-9fea-4d68-a6cd-bd50344c4706" returned: 0 in 0.277s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:54 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fc3ea9c3-5df6-4b0b-825d-27f9f151e268 tempest-VolumeImageDependencyTests-2125893655 None] Lock "cinder-quobyte-84fcf367-0e7a-4bca-942b-7d9d44ac9f79" acquired by "delete_volume" :: waited 0.032s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:54 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-57d9c2cb-52c9-4ebf-9178-a37a2689ed09 tempest-CreateVolumesFromImageTest-2002239375 None] Lock "cinder-quobyte-5ce63040-9fea-4d68-a6cd-bd50344c4706" released by "delete_volume" :: held 0.752s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:54 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7a3cef-3bb2-4bb1-a307-d2b9f7cae084]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fc3ea9c3-5df6-4b0b-825d-27f9f151e268 tempest-VolumeImageDependencyTests-2125893655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-84fcf367-0e7a-4bca-942b-7d9d44ac9f79 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:54 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-57d9c2cb-52c9-4ebf-9178-a37a2689ed09 tempest-CreateVolumesFromImageTest-2002239375 None] Created reservations ['17305dbf-60e0-4e73-aa76-0afb927674de', '1241ce84-7534-412e-b20d-f2db9f960a36', '0a15fe0f-ce42-4f5b-ab67-8539bbd8d00f', '510fb5d0-bde8-4723-b81d-08e0e4529b74'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:31:54 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-84fcf367-0e7a-4bca-942b-7d9d44ac9f79 Sep 03 11:31:54 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-57d9c2cb-52c9-4ebf-9178-a37a2689ed09 tempest-CreateVolumesFromImageTest-2002239375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-57d9c2cb-52c9-4ebf-9178-a37a2689ed09 tempest-CreateVolumesFromImageTest-2002239375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:54 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-57d9c2cb-52c9-4ebf-9178-a37a2689ed09 tempest-CreateVolumesFromImageTest-2002239375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:54 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-57d9c2cb-52c9-4ebf-9178-a37a2689ed09 tempest-CreateVolumesFromImageTest-2002239375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-57d9c2cb-52c9-4ebf-9178-a37a2689ed09 tempest-CreateVolumesFromImageTest-2002239375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-57d9c2cb-52c9-4ebf-9178-a37a2689ed09 tempest-CreateVolumesFromImageTest-2002239375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:54 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:31:54 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:54 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5cdd7f2a-d176-4dda-845a-8d07acc070ce tempest-CreateVolumesFromImageTest-2002239375 None] Acquiring lock "cinder-5883ef09-0775-4b73-888f-2e708db8c4a1-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:54 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5cdd7f2a-d176-4dda-845a-8d07acc070ce tempest-CreateVolumesFromImageTest-2002239375 None] Lock "cinder-5883ef09-0775-4b73-888f-2e708db8c4a1-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:54 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5cdd7f2a-d176-4dda-845a-8d07acc070ce tempest-CreateVolumesFromImageTest-2002239375 None] Acquiring lock "cinder-quobyte-5883ef09-0775-4b73-888f-2e708db8c4a1" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:54 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5cdd7f2a-d176-4dda-845a-8d07acc070ce tempest-CreateVolumesFromImageTest-2002239375 None] Lock "cinder-quobyte-5883ef09-0775-4b73-888f-2e708db8c4a1" acquired by "delete_volume" :: waited 0.029s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:54 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b13df96-ac3f-44ee-8927-00c6d37bfd4d]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5cdd7f2a-d176-4dda-845a-8d07acc070ce tempest-CreateVolumesFromImageTest-2002239375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5883ef09-0775-4b73-888f-2e708db8c4a1 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:54 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fc3ea9c3-5df6-4b0b-825d-27f9f151e268 tempest-VolumeImageDependencyTests-2125893655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-84fcf367-0e7a-4bca-942b-7d9d44ac9f79" returned: 0 in 0.676s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fc3ea9c3-5df6-4b0b-825d-27f9f151e268 tempest-VolumeImageDependencyTests-2125893655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-84fcf367-0e7a-4bca-942b-7d9d44ac9f79 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:54 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-57d9c2cb-52c9-4ebf-9178-a37a2689ed09 tempest-CreateVolumesFromImageTest-2002239375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.508s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:54 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-57d9c2cb-52c9-4ebf-9178-a37a2689ed09 tempest-CreateVolumesFromImageTest-2002239375 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:31:54 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-57d9c2cb-52c9-4ebf-9178-a37a2689ed09 tempest-CreateVolumesFromImageTest-2002239375 None] Deleted volume successfully. Sep 03 11:31:54 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-57d9c2cb-52c9-4ebf-9178-a37a2689ed09 tempest-CreateVolumesFromImageTest-2002239375 None] Lock "cinder-5ce63040-9fea-4d68-a6cd-bd50344c4706-delete_volume" released by "delete_volume" :: held 1.560s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:54 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-84fcf367-0e7a-4bca-942b-7d9d44ac9f79 Sep 03 11:31:54 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:55 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5883ef09-0775-4b73-888f-2e708db8c4a1 Sep 03 11:31:55 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:55 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fc3ea9c3-5df6-4b0b-825d-27f9f151e268 tempest-VolumeImageDependencyTests-2125893655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-84fcf367-0e7a-4bca-942b-7d9d44ac9f79" returned: 0 in 0.429s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:55 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fc3ea9c3-5df6-4b0b-825d-27f9f151e268 tempest-VolumeImageDependencyTests-2125893655 None] Lock "cinder-quobyte-84fcf367-0e7a-4bca-942b-7d9d44ac9f79" released by "delete_volume" :: held 1.170s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:55 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-fc3ea9c3-5df6-4b0b-825d-27f9f151e268 tempest-VolumeImageDependencyTests-2125893655 None] Created reservations ['7c7e8e55-1799-4675-bcea-32a7f947057a', 'ea45b964-823a-4032-9761-0bc92f8de642', 'c2e6c772-075d-4b5a-a1aa-9b90f734f7c3', 'fd604abd-7c12-41c6-8f96-aca1f350732b'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:31:55 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5cdd7f2a-d176-4dda-845a-8d07acc070ce tempest-CreateVolumesFromImageTest-2002239375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5883ef09-0775-4b73-888f-2e708db8c4a1" returned: 0 in 0.588s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5cdd7f2a-d176-4dda-845a-8d07acc070ce tempest-CreateVolumesFromImageTest-2002239375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5883ef09-0775-4b73-888f-2e708db8c4a1 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:55 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5883ef09-0775-4b73-888f-2e708db8c4a1 Sep 03 11:31:55 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-fc3ea9c3-5df6-4b0b-825d-27f9f151e268 tempest-VolumeImageDependencyTests-2125893655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-fc3ea9c3-5df6-4b0b-825d-27f9f151e268 tempest-VolumeImageDependencyTests-2125893655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:55 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-fc3ea9c3-5df6-4b0b-825d-27f9f151e268 tempest-VolumeImageDependencyTests-2125893655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:55 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-fc3ea9c3-5df6-4b0b-825d-27f9f151e268 tempest-VolumeImageDependencyTests-2125893655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-fc3ea9c3-5df6-4b0b-825d-27f9f151e268 tempest-VolumeImageDependencyTests-2125893655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fc3ea9c3-5df6-4b0b-825d-27f9f151e268 tempest-VolumeImageDependencyTests-2125893655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:55 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:31:55 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:55 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5cdd7f2a-d176-4dda-845a-8d07acc070ce tempest-CreateVolumesFromImageTest-2002239375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-5883ef09-0775-4b73-888f-2e708db8c4a1" returned: 0 in 0.355s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:55 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5cdd7f2a-d176-4dda-845a-8d07acc070ce tempest-CreateVolumesFromImageTest-2002239375 None] Lock "cinder-quobyte-5883ef09-0775-4b73-888f-2e708db8c4a1" released by "delete_volume" :: held 1.009s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:55 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fc3ea9c3-5df6-4b0b-825d-27f9f151e268 tempest-VolumeImageDependencyTests-2125893655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.295s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:55 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-fc3ea9c3-5df6-4b0b-825d-27f9f151e268 tempest-VolumeImageDependencyTests-2125893655 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:31:55 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-fc3ea9c3-5df6-4b0b-825d-27f9f151e268 tempest-VolumeImageDependencyTests-2125893655 None] Deleted volume successfully. Sep 03 11:31:55 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fc3ea9c3-5df6-4b0b-825d-27f9f151e268 tempest-VolumeImageDependencyTests-2125893655 None] Lock "cinder-84fcf367-0e7a-4bca-942b-7d9d44ac9f79-delete_volume" released by "delete_volume" :: held 1.804s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:55 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-5cdd7f2a-d176-4dda-845a-8d07acc070ce tempest-CreateVolumesFromImageTest-2002239375 None] Created reservations ['317d3418-a016-4c1e-b9d7-5c482b6a6e81', 'efcd77df-5f20-4afc-b584-8ada8650f875', '2f13c9a5-c052-4f02-8551-b4ff84df4ce0', '9f712d74-363f-4248-a34b-6785a3760225'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:31:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5cdd7f2a-d176-4dda-845a-8d07acc070ce tempest-CreateVolumesFromImageTest-2002239375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5cdd7f2a-d176-4dda-845a-8d07acc070ce tempest-CreateVolumesFromImageTest-2002239375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:55 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5cdd7f2a-d176-4dda-845a-8d07acc070ce tempest-CreateVolumesFromImageTest-2002239375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:55 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-5cdd7f2a-d176-4dda-845a-8d07acc070ce tempest-CreateVolumesFromImageTest-2002239375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5cdd7f2a-d176-4dda-845a-8d07acc070ce tempest-CreateVolumesFromImageTest-2002239375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5cdd7f2a-d176-4dda-845a-8d07acc070ce tempest-CreateVolumesFromImageTest-2002239375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:56 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:31:56 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:56 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5cdd7f2a-d176-4dda-845a-8d07acc070ce tempest-CreateVolumesFromImageTest-2002239375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.277s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:56 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-5cdd7f2a-d176-4dda-845a-8d07acc070ce tempest-CreateVolumesFromImageTest-2002239375 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:31:56 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-5cdd7f2a-d176-4dda-845a-8d07acc070ce tempest-CreateVolumesFromImageTest-2002239375 None] Deleted volume successfully. Sep 03 11:31:56 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5cdd7f2a-d176-4dda-845a-8d07acc070ce tempest-CreateVolumesFromImageTest-2002239375 None] Lock "cinder-5883ef09-0775-4b73-888f-2e708db8c4a1-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:57 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e7ed2c70-5dd2-4586-9cac-7dcb4ccf3586 tempest-CreateVolumesFromImageTest-2002239375 None] Acquiring lock "cinder-8914e7d5-d958-4138-a8e5-7af6cb81ddbc-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:57 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e7ed2c70-5dd2-4586-9cac-7dcb4ccf3586 tempest-CreateVolumesFromImageTest-2002239375 None] Lock "cinder-8914e7d5-d958-4138-a8e5-7af6cb81ddbc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:57 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e7ed2c70-5dd2-4586-9cac-7dcb4ccf3586 tempest-CreateVolumesFromImageTest-2002239375 None] Acquiring lock "cinder-quobyte-8914e7d5-d958-4138-a8e5-7af6cb81ddbc" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:31:57 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e7ed2c70-5dd2-4586-9cac-7dcb4ccf3586 tempest-CreateVolumesFromImageTest-2002239375 None] Lock "cinder-quobyte-8914e7d5-d958-4138-a8e5-7af6cb81ddbc" acquired by "delete_volume" :: waited 0.030s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:31:57 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[2888771a-e8e4-4903-bb08-5e5c5866cbac]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:31:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e7ed2c70-5dd2-4586-9cac-7dcb4ccf3586 tempest-CreateVolumesFromImageTest-2002239375 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8914e7d5-d958-4138-a8e5-7af6cb81ddbc {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:57 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8914e7d5-d958-4138-a8e5-7af6cb81ddbc Sep 03 11:31:57 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e7ed2c70-5dd2-4586-9cac-7dcb4ccf3586 tempest-CreateVolumesFromImageTest-2002239375 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8914e7d5-d958-4138-a8e5-7af6cb81ddbc" returned: 0 in 0.551s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e7ed2c70-5dd2-4586-9cac-7dcb4ccf3586 tempest-CreateVolumesFromImageTest-2002239375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8914e7d5-d958-4138-a8e5-7af6cb81ddbc {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:57 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:57 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8914e7d5-d958-4138-a8e5-7af6cb81ddbc Sep 03 11:31:57 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:58 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e7ed2c70-5dd2-4586-9cac-7dcb4ccf3586 tempest-CreateVolumesFromImageTest-2002239375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8914e7d5-d958-4138-a8e5-7af6cb81ddbc" returned: 0 in 0.494s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:58 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e7ed2c70-5dd2-4586-9cac-7dcb4ccf3586 tempest-CreateVolumesFromImageTest-2002239375 None] Lock "cinder-quobyte-8914e7d5-d958-4138-a8e5-7af6cb81ddbc" released by "delete_volume" :: held 1.119s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:58 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-e7ed2c70-5dd2-4586-9cac-7dcb4ccf3586 tempest-CreateVolumesFromImageTest-2002239375 None] Created reservations ['b112f57d-ad3b-4096-8c2f-8bdbc60a60b9', 'de6ed74e-f1bc-4ea6-925b-920d0544b471', '00d36967-30bd-451c-83b3-cddff608e334', '9ae84454-680b-4248-8c91-50db4bf10285'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:31:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e7ed2c70-5dd2-4586-9cac-7dcb4ccf3586 tempest-CreateVolumesFromImageTest-2002239375 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e7ed2c70-5dd2-4586-9cac-7dcb4ccf3586 tempest-CreateVolumesFromImageTest-2002239375 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:58 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e7ed2c70-5dd2-4586-9cac-7dcb4ccf3586 tempest-CreateVolumesFromImageTest-2002239375 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:58 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e7ed2c70-5dd2-4586-9cac-7dcb4ccf3586 tempest-CreateVolumesFromImageTest-2002239375 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e7ed2c70-5dd2-4586-9cac-7dcb4ccf3586 tempest-CreateVolumesFromImageTest-2002239375 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e7ed2c70-5dd2-4586-9cac-7dcb4ccf3586 tempest-CreateVolumesFromImageTest-2002239375 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:58 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:31:58 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:58 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e7ed2c70-5dd2-4586-9cac-7dcb4ccf3586 tempest-CreateVolumesFromImageTest-2002239375 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.356s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:58 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-e7ed2c70-5dd2-4586-9cac-7dcb4ccf3586 tempest-CreateVolumesFromImageTest-2002239375 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:31:58 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-e7ed2c70-5dd2-4586-9cac-7dcb4ccf3586 tempest-CreateVolumesFromImageTest-2002239375 None] Deleted volume successfully. Sep 03 11:31:58 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-e7ed2c70-5dd2-4586-9cac-7dcb4ccf3586 tempest-CreateVolumesFromImageTest-2002239375 None] Lock "cinder-8914e7d5-d958-4138-a8e5-7af6cb81ddbc-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:31:58 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-9545f46f-b129-4d50-8bb1-4759d4a03cb3 tempest-ProjectReaderTests-1112694435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:31:59 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9545f46f-b129-4d50-8bb1-4759d4a03cb3 tempest-ProjectReaderTests-1112694435 None] Flow 'volume_create_manager' (c4c79ca0-a9ab-4d36-a057-9792fe29049e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:31:59 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9545f46f-b129-4d50-8bb1-4759d4a03cb3 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af4f195b-a132-4bc7-bbad-14424b780375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:59 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9545f46f-b129-4d50-8bb1-4759d4a03cb3 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af4f195b-a132-4bc7-bbad-14424b780375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-359286458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dcd4de0122b4179a023a1174825fdff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:59Z,use_quota=True,user_id='2c8f8d82e5ea4c34a765336d2de00340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:59 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9545f46f-b129-4d50-8bb1-4759d4a03cb3 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c867e0-f520-4b87-a673-628e2c987998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:59 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9545f46f-b129-4d50-8bb1-4759d4a03cb3 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49c867e0-f520-4b87-a673-628e2c987998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:59 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9545f46f-b129-4d50-8bb1-4759d4a03cb3 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc1686a5-a633-41c9-ae50-a17fd15575dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:59 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9545f46f-b129-4d50-8bb1-4759d4a03cb3 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc1686a5-a633-41c9-ae50-a17fd15575dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7', 'volume_name': 'volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:59 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9545f46f-b129-4d50-8bb1-4759d4a03cb3 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c71b5775-2093-4c4f-9726-c5fbc9aa48ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:59 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9545f46f-b129-4d50-8bb1-4759d4a03cb3 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c71b5775-2093-4c4f-9726-c5fbc9aa48ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:31:59 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9545f46f-b129-4d50-8bb1-4759d4a03cb3 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (295fbff9-0b2f-4fb7-ac90-f22efb8908ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:31:59 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-9545f46f-b129-4d50-8bb1-4759d4a03cb3 tempest-ProjectReaderTests-1112694435 None] Volume ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7', 'volume_size': 1} Sep 03 11:31:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9545f46f-b129-4d50-8bb1-4759d4a03cb3 tempest-ProjectReaderTests-1112694435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9545f46f-b129-4d50-8bb1-4759d4a03cb3 tempest-ProjectReaderTests-1112694435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:59 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-9545f46f-b129-4d50-8bb1-4759d4a03cb3 tempest-ProjectReaderTests-1112694435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-359286458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dcd4de0122b4179a023a1174825fdff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:31:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:31:59Z,use_quota=True,user_id='2c8f8d82e5ea4c34a765336d2de00340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:31:59 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-9545f46f-b129-4d50-8bb1-4759d4a03cb3 tempest-ProjectReaderTests-1112694435 None] Creating volume ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:31:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9545f46f-b129-4d50-8bb1-4759d4a03cb3 tempest-ProjectReaderTests-1112694435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:31:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9545f46f-b129-4d50-8bb1-4759d4a03cb3 tempest-ProjectReaderTests-1112694435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:31:59 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-9545f46f-b129-4d50-8bb1-4759d4a03cb3 tempest-ProjectReaderTests-1112694435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:31:59 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-9545f46f-b129-4d50-8bb1-4759d4a03cb3 tempest-ProjectReaderTests-1112694435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:31:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9545f46f-b129-4d50-8bb1-4759d4a03cb3 tempest-ProjectReaderTests-1112694435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:31:59 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-9545f46f-b129-4d50-8bb1-4759d4a03cb3 tempest-ProjectReaderTests-1112694435 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:31:59 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-9545f46f-b129-4d50-8bb1-4759d4a03cb3 tempest-ProjectReaderTests-1112694435 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:31:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9545f46f-b129-4d50-8bb1-4759d4a03cb3 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:59 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7 1073741824 Sep 03 11:31:59 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:31:59 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Sep 03 11:31:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9545f46f-b129-4d50-8bb1-4759d4a03cb3 tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7 1073741824" returned: 0 in 0.576s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:31:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9545f46f-b129-4d50-8bb1-4759d4a03cb3 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:31:59 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7 Sep 03 11:31:59 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:00 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9545f46f-b129-4d50-8bb1-4759d4a03cb3 tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7" returned: 0 in 0.339s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:00 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-9545f46f-b129-4d50-8bb1-4759d4a03cb3 tempest-ProjectReaderTests-1112694435 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:32:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9545f46f-b129-4d50-8bb1-4759d4a03cb3 tempest-ProjectReaderTests-1112694435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:00 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9545f46f-b129-4d50-8bb1-4759d4a03cb3 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (295fbff9-0b2f-4fb7-ac90-f22efb8908ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:00 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9545f46f-b129-4d50-8bb1-4759d4a03cb3 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b597b92-ca0c-4e95-9a58-2e7fe031bf9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:00 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-9545f46f-b129-4d50-8bb1-4759d4a03cb3 tempest-ProjectReaderTests-1112694435 None] Volume volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7 (ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7): created successfully Sep 03 11:32:00 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9545f46f-b129-4d50-8bb1-4759d4a03cb3 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b597b92-ca0c-4e95-9a58-2e7fe031bf9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:00 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-9545f46f-b129-4d50-8bb1-4759d4a03cb3 tempest-ProjectReaderTests-1112694435 None] Flow 'volume_create_manager' (c4c79ca0-a9ab-4d36-a057-9792fe29049e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:32:00 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-9545f46f-b129-4d50-8bb1-4759d4a03cb3 tempest-ProjectReaderTests-1112694435 None] Created volume successfully. Sep 03 11:32:01 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3a19fd3d-44ca-4ba4-8476-cbeabc1cc430 tempest-ProjectReaderTests-1112694435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:01 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3a19fd3d-44ca-4ba4-8476-cbeabc1cc430 tempest-ProjectReaderTests-1112694435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:01 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-3a19fd3d-44ca-4ba4-8476-cbeabc1cc430 tempest-ProjectReaderTests-1112694435 None] Creating offline snapshot d756b66b-bb1a-4499-b3f1-13744830a285 of volume ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7 {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:32:01 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[73680699-bf92-47ff-a258-5ea140b290a8]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:01 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3a19fd3d-44ca-4ba4-8476-cbeabc1cc430 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:01 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7 Sep 03 11:32:01 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:01 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:01 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3a19fd3d-44ca-4ba4-8476-cbeabc1cc430 tempest-ProjectReaderTests-1112694435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7" returned: 0 in 0.462s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:01 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3a19fd3d-44ca-4ba4-8476-cbeabc1cc430 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7.d756b66b-bb1a-4499-b3f1-13744830a285 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:01 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7.d756b66b-bb1a-4499-b3f1-13744830a285 1G Sep 03 11:32:01 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:02 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3a19fd3d-44ca-4ba4-8476-cbeabc1cc430 tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7.d756b66b-bb1a-4499-b3f1-13744830a285 1G" returned: 0 in 0.554s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3a19fd3d-44ca-4ba4-8476-cbeabc1cc430 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7.d756b66b-bb1a-4499-b3f1-13744830a285 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:02 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7.d756b66b-bb1a-4499-b3f1-13744830a285 Sep 03 11:32:02 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:02 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3a19fd3d-44ca-4ba4-8476-cbeabc1cc430 tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7.d756b66b-bb1a-4499-b3f1-13744830a285" returned: 0 in 0.496s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:02 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-3a19fd3d-44ca-4ba4-8476-cbeabc1cc430 tempest-ProjectReaderTests-1112694435 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7.d756b66b-bb1a-4499-b3f1-13744830a285 is being set with open permissions: ugo+rw Sep 03 11:32:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3a19fd3d-44ca-4ba4-8476-cbeabc1cc430 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7.d756b66b-bb1a-4499-b3f1-13744830a285 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:02 devstack sudo[106122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7.d756b66b-bb1a-4499-b3f1-13744830a285 Sep 03 11:32:02 devstack sudo[106122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:03 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-73ffcd0e-81e4-45b8-be1c-6eef65960d4e tempest-VolumeDependencyTests-693697648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:32:03 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-73ffcd0e-81e4-45b8-be1c-6eef65960d4e tempest-VolumeDependencyTests-693697648 None] Flow 'volume_create_manager' (0e07b587-2b4f-4e60-95b3-452119ed2ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:32:03 devstack sudo[106122]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:03 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-73ffcd0e-81e4-45b8-be1c-6eef65960d4e tempest-VolumeDependencyTests-693697648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97296f80-79cf-43a9-8c12-36e83131d9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3a19fd3d-44ca-4ba4-8476-cbeabc1cc430 tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7.d756b66b-bb1a-4499-b3f1-13744830a285" returned: 0 in 0.304s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:03 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-73ffcd0e-81e4-45b8-be1c-6eef65960d4e tempest-VolumeDependencyTests-693697648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97296f80-79cf-43a9-8c12-36e83131d9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-402674717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=491f629e-688e-4be9-99c8-e85426a8d5c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a782bf81519a4f28996e46ae093159ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:32:03Z,use_quota=True,user_id='409f6fef4703421f8a6f404896ae5883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:03 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-73ffcd0e-81e4-45b8-be1c-6eef65960d4e tempest-VolumeDependencyTests-693697648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f099fa9-bcec-4ee8-91a4-77f565c85b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:03 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-73ffcd0e-81e4-45b8-be1c-6eef65960d4e tempest-VolumeDependencyTests-693697648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f099fa9-bcec-4ee8-91a4-77f565c85b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:03 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-73ffcd0e-81e4-45b8-be1c-6eef65960d4e tempest-VolumeDependencyTests-693697648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678684e9-434e-46ff-906c-8cb4a6f169a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:03 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-73ffcd0e-81e4-45b8-be1c-6eef65960d4e tempest-VolumeDependencyTests-693697648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (678684e9-434e-46ff-906c-8cb4a6f169a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '491f629e-688e-4be9-99c8-e85426a8d5c5', 'volume_name': 'volume-491f629e-688e-4be9-99c8-e85426a8d5c5', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:03 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-73ffcd0e-81e4-45b8-be1c-6eef65960d4e tempest-VolumeDependencyTests-693697648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10e497cd-ccc3-4f3d-a587-9a12df7494ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:03 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-73ffcd0e-81e4-45b8-be1c-6eef65960d4e tempest-VolumeDependencyTests-693697648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10e497cd-ccc3-4f3d-a587-9a12df7494ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:03 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-73ffcd0e-81e4-45b8-be1c-6eef65960d4e tempest-VolumeDependencyTests-693697648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6dd2c35-dc10-40e1-a020-b28d35edde9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:03 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-73ffcd0e-81e4-45b8-be1c-6eef65960d4e tempest-VolumeDependencyTests-693697648 None] Volume 491f629e-688e-4be9-99c8-e85426a8d5c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-491f629e-688e-4be9-99c8-e85426a8d5c5', 'volume_size': 1} Sep 03 11:32:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-73ffcd0e-81e4-45b8-be1c-6eef65960d4e tempest-VolumeDependencyTests-693697648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3a19fd3d-44ca-4ba4-8476-cbeabc1cc430 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:03 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7.info Sep 03 11:32:03 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:03 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3a19fd3d-44ca-4ba4-8476-cbeabc1cc430 tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7.info" returned: 0 in 0.324s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:03 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-3a19fd3d-44ca-4ba4-8476-cbeabc1cc430 tempest-ProjectReaderTests-1112694435 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7.info is being set with open permissions: ugo+rw Sep 03 11:32:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3a19fd3d-44ca-4ba4-8476-cbeabc1cc430 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:03 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7.info Sep 03 11:32:03 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:03 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-3a19fd3d-44ca-4ba4-8476-cbeabc1cc430 tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7.info" returned: 0 in 0.265s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-3a19fd3d-44ca-4ba4-8476-cbeabc1cc430 tempest-ProjectReaderTests-1112694435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.557s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-73ffcd0e-81e4-45b8-be1c-6eef65960d4e tempest-VolumeDependencyTests-693697648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.632s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:03 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-73ffcd0e-81e4-45b8-be1c-6eef65960d4e tempest-VolumeDependencyTests-693697648 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-402674717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=491f629e-688e-4be9-99c8-e85426a8d5c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a782bf81519a4f28996e46ae093159ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:32:03Z,use_quota=True,user_id='409f6fef4703421f8a6f404896ae5883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:32:03 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-73ffcd0e-81e4-45b8-be1c-6eef65960d4e tempest-VolumeDependencyTests-693697648 None] Creating volume 491f629e-688e-4be9-99c8-e85426a8d5c5 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:32:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-73ffcd0e-81e4-45b8-be1c-6eef65960d4e tempest-VolumeDependencyTests-693697648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-73ffcd0e-81e4-45b8-be1c-6eef65960d4e tempest-VolumeDependencyTests-693697648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:03 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-73ffcd0e-81e4-45b8-be1c-6eef65960d4e tempest-VolumeDependencyTests-693697648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:32:03 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-73ffcd0e-81e4-45b8-be1c-6eef65960d4e tempest-VolumeDependencyTests-693697648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:32:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-73ffcd0e-81e4-45b8-be1c-6eef65960d4e tempest-VolumeDependencyTests-693697648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:03 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-73ffcd0e-81e4-45b8-be1c-6eef65960d4e tempest-VolumeDependencyTests-693697648 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:32:03 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-73ffcd0e-81e4-45b8-be1c-6eef65960d4e tempest-VolumeDependencyTests-693697648 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:32:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-73ffcd0e-81e4-45b8-be1c-6eef65960d4e tempest-VolumeDependencyTests-693697648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:03 devstack sudo[106132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5 1073741824 Sep 03 11:32:03 devstack sudo[106132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:03 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-3a19fd3d-44ca-4ba4-8476-cbeabc1cc430 tempest-ProjectReaderTests-1112694435 None] Create snapshot completed successfully Sep 03 11:32:04 devstack sudo[106132]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-73ffcd0e-81e4-45b8-be1c-6eef65960d4e tempest-VolumeDependencyTests-693697648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5 1073741824" returned: 0 in 0.650s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-73ffcd0e-81e4-45b8-be1c-6eef65960d4e tempest-VolumeDependencyTests-693697648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:04 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5 Sep 03 11:32:04 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:04 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-aa400252-b404-450c-b1e7-dcb58c52eb07 tempest-ProjectReaderTests-1112694435 None] Acquiring lock "cinder-d756b66b-bb1a-4499-b3f1-13744830a285-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:04 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-aa400252-b404-450c-b1e7-dcb58c52eb07 tempest-ProjectReaderTests-1112694435 None] Lock "cinder-d756b66b-bb1a-4499-b3f1-13744830a285-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:04 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-aa400252-b404-450c-b1e7-dcb58c52eb07 tempest-ProjectReaderTests-1112694435 None] Acquiring lock "cinder-quobyte-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:05 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-aa400252-b404-450c-b1e7-dcb58c52eb07 tempest-ProjectReaderTests-1112694435 None] Lock "cinder-quobyte-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:05 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-aa400252-b404-450c-b1e7-dcb58c52eb07 tempest-ProjectReaderTests-1112694435 None] Acquiring lock "cinder-quobyte-d756b66b-bb1a-4499-b3f1-13744830a285" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:05 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-73ffcd0e-81e4-45b8-be1c-6eef65960d4e tempest-VolumeDependencyTests-693697648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5" returned: 0 in 0.413s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:05 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-73ffcd0e-81e4-45b8-be1c-6eef65960d4e tempest-VolumeDependencyTests-693697648 None] <== create_volume: return (1127ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:32:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-73ffcd0e-81e4-45b8-be1c-6eef65960d4e tempest-VolumeDependencyTests-693697648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.130s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:05 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-aa400252-b404-450c-b1e7-dcb58c52eb07 tempest-ProjectReaderTests-1112694435 None] Lock "cinder-quobyte-d756b66b-bb1a-4499-b3f1-13744830a285" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:05 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-aa400252-b404-450c-b1e7-dcb58c52eb07 tempest-ProjectReaderTests-1112694435 None] Deleting offline snapshot d756b66b-bb1a-4499-b3f1-13744830a285 of volume ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:32:05 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-aa400252-b404-450c-b1e7-dcb58c52eb07 tempest-ProjectReaderTests-1112694435 None] snapshot_file for this snap is: volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7.d756b66b-bb1a-4499-b3f1-13744830a285 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:32:05 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-73ffcd0e-81e4-45b8-be1c-6eef65960d4e tempest-VolumeDependencyTests-693697648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6dd2c35-dc10-40e1-a020-b28d35edde9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-491f629e-688e-4be9-99c8-e85426a8d5c5', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:05 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-73ffcd0e-81e4-45b8-be1c-6eef65960d4e tempest-VolumeDependencyTests-693697648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a5e75f8-465d-4fa6-99e2-1f05aca589ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:05 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[03454e53-996f-4cfe-adc5-482eb2d752df]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-aa400252-b404-450c-b1e7-dcb58c52eb07 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7.d756b66b-bb1a-4499-b3f1-13744830a285 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:05 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-73ffcd0e-81e4-45b8-be1c-6eef65960d4e tempest-VolumeDependencyTests-693697648 None] Volume volume-491f629e-688e-4be9-99c8-e85426a8d5c5 (491f629e-688e-4be9-99c8-e85426a8d5c5): created successfully Sep 03 11:32:05 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-73ffcd0e-81e4-45b8-be1c-6eef65960d4e tempest-VolumeDependencyTests-693697648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a5e75f8-465d-4fa6-99e2-1f05aca589ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:05 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-73ffcd0e-81e4-45b8-be1c-6eef65960d4e tempest-VolumeDependencyTests-693697648 None] Flow 'volume_create_manager' (0e07b587-2b4f-4e60-95b3-452119ed2ae3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:32:05 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-73ffcd0e-81e4-45b8-be1c-6eef65960d4e tempest-VolumeDependencyTests-693697648 None] Created volume successfully. Sep 03 11:32:05 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7.d756b66b-bb1a-4499-b3f1-13744830a285 Sep 03 11:32:05 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:05 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-aa400252-b404-450c-b1e7-dcb58c52eb07 tempest-ProjectReaderTests-1112694435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7.d756b66b-bb1a-4499-b3f1-13744830a285" returned: 0 in 0.473s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:05 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-aa400252-b404-450c-b1e7-dcb58c52eb07 tempest-ProjectReaderTests-1112694435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:32:05 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c4e8bd4-5e8c-47df-a850-543f006ab4be]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-aa400252-b404-450c-b1e7-dcb58c52eb07 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:05 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7 Sep 03 11:32:05 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:06 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-aa400252-b404-450c-b1e7-dcb58c52eb07 tempest-ProjectReaderTests-1112694435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7" returned: 0 in 0.453s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-aa400252-b404-450c-b1e7-dcb58c52eb07 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7.d756b66b-bb1a-4499-b3f1-13744830a285 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:06 devstack sudo[106154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7.d756b66b-bb1a-4499-b3f1-13744830a285 Sep 03 11:32:06 devstack sudo[106154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b0bc9009-0599-47cd-a63a-983e38316e5e tempest-VolumeDependencyTests-693697648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b0bc9009-0599-47cd-a63a-983e38316e5e tempest-VolumeDependencyTests-693697648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:06 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-b0bc9009-0599-47cd-a63a-983e38316e5e tempest-VolumeDependencyTests-693697648 None] Creating offline snapshot 41b36384-cab1-41a5-81b2-126ac62a337e of volume 491f629e-688e-4be9-99c8-e85426a8d5c5 {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:32:06 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21a559e-c40f-4dea-a63d-4e6837d5e516]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b0bc9009-0599-47cd-a63a-983e38316e5e tempest-VolumeDependencyTests-693697648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:06 devstack sudo[106154]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-aa400252-b404-450c-b1e7-dcb58c52eb07 tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7.d756b66b-bb1a-4499-b3f1-13744830a285" returned: 0 in 0.675s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-aa400252-b404-450c-b1e7-dcb58c52eb07 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7.d756b66b-bb1a-4499-b3f1-13744830a285 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:06 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7.d756b66b-bb1a-4499-b3f1-13744830a285 Sep 03 11:32:06 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:06 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5 Sep 03 11:32:06 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:07 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-aa400252-b404-450c-b1e7-dcb58c52eb07 tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7.d756b66b-bb1a-4499-b3f1-13744830a285" returned: 0 in 0.368s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:07 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-aa400252-b404-450c-b1e7-dcb58c52eb07 tempest-ProjectReaderTests-1112694435 None] Lock "cinder-quobyte-d756b66b-bb1a-4499-b3f1-13744830a285" released by "_delete_snapshot" :: held 2.163s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:07 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-aa400252-b404-450c-b1e7-dcb58c52eb07 tempest-ProjectReaderTests-1112694435 None] Lock "cinder-quobyte-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7" released by "delete_snapshot" :: held 2.217s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:07 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b0bc9009-0599-47cd-a63a-983e38316e5e tempest-VolumeDependencyTests-693697648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5" returned: 0 in 0.705s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b0bc9009-0599-47cd-a63a-983e38316e5e tempest-VolumeDependencyTests-693697648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5.41b36384-cab1-41a5-81b2-126ac62a337e 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:07 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-aa400252-b404-450c-b1e7-dcb58c52eb07 tempest-ProjectReaderTests-1112694435 None] Created reservations ['8b356ba4-6128-4272-986f-67681cfcacfc', '113ff05b-aa6d-470d-8f9f-aa2d5c6b5898', '2c2def30-5064-456a-b7dc-335ecaeabd1e', '0be853d3-2aca-477b-8b15-499db4c8d3e0'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:32:07 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5.41b36384-cab1-41a5-81b2-126ac62a337e 1G Sep 03 11:32:07 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:07 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-aa400252-b404-450c-b1e7-dcb58c52eb07 tempest-ProjectReaderTests-1112694435 None] Delete snapshot completed successfully. Sep 03 11:32:07 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-aa400252-b404-450c-b1e7-dcb58c52eb07 tempest-ProjectReaderTests-1112694435 None] Lock "cinder-d756b66b-bb1a-4499-b3f1-13744830a285-delete_snapshot" released by "delete_snapshot" :: held 2.561s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:08 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b0bc9009-0599-47cd-a63a-983e38316e5e tempest-VolumeDependencyTests-693697648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5.41b36384-cab1-41a5-81b2-126ac62a337e 1G" returned: 0 in 0.602s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b0bc9009-0599-47cd-a63a-983e38316e5e tempest-VolumeDependencyTests-693697648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-491f629e-688e-4be9-99c8-e85426a8d5c5 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5.41b36384-cab1-41a5-81b2-126ac62a337e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:08 devstack sudo[106174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-491f629e-688e-4be9-99c8-e85426a8d5c5 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5.41b36384-cab1-41a5-81b2-126ac62a337e Sep 03 11:32:08 devstack sudo[106174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-35c0c5b7-0b12-4aff-86e4-ca69662a1256 tempest-ProjectReaderTests-1112694435 None] Acquiring lock "cinder-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-35c0c5b7-0b12-4aff-86e4-ca69662a1256 tempest-ProjectReaderTests-1112694435 None] Lock "cinder-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-35c0c5b7-0b12-4aff-86e4-ca69662a1256 tempest-ProjectReaderTests-1112694435 None] Acquiring lock "cinder-quobyte-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:08 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-35c0c5b7-0b12-4aff-86e4-ca69662a1256 tempest-ProjectReaderTests-1112694435 None] Lock "cinder-quobyte-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7" acquired by "delete_volume" :: waited 0.032s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:08 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[221098aa-6b8c-452c-afa1-6ff5f7fcd85f]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-35c0c5b7-0b12-4aff-86e4-ca69662a1256 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:08 devstack sudo[106174]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b0bc9009-0599-47cd-a63a-983e38316e5e tempest-VolumeDependencyTests-693697648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-491f629e-688e-4be9-99c8-e85426a8d5c5 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5.41b36384-cab1-41a5-81b2-126ac62a337e" returned: 0 in 0.506s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:08 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-b0bc9009-0599-47cd-a63a-983e38316e5e tempest-VolumeDependencyTests-693697648 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5.41b36384-cab1-41a5-81b2-126ac62a337e is being set with open permissions: ugo+rw Sep 03 11:32:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b0bc9009-0599-47cd-a63a-983e38316e5e tempest-VolumeDependencyTests-693697648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5.41b36384-cab1-41a5-81b2-126ac62a337e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:08 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5.41b36384-cab1-41a5-81b2-126ac62a337e Sep 03 11:32:08 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:08 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7 Sep 03 11:32:08 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:08 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b0bc9009-0599-47cd-a63a-983e38316e5e tempest-VolumeDependencyTests-693697648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5.41b36384-cab1-41a5-81b2-126ac62a337e" returned: 0 in 0.337s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:08 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-35c0c5b7-0b12-4aff-86e4-ca69662a1256 tempest-ProjectReaderTests-1112694435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7" returned: 0 in 0.450s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-35c0c5b7-0b12-4aff-86e4-ca69662a1256 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:08 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7 Sep 03 11:32:08 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b0bc9009-0599-47cd-a63a-983e38316e5e tempest-VolumeDependencyTests-693697648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:08 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5.info Sep 03 11:32:08 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:09 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-35c0c5b7-0b12-4aff-86e4-ca69662a1256 tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7" returned: 0 in 0.367s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-35c0c5b7-0b12-4aff-86e4-ca69662a1256 tempest-ProjectReaderTests-1112694435 None] Lock "cinder-quobyte-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7" released by "delete_volume" :: held 0.905s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-263de714-0e72-4b09-9fe3-b0ad165b4bbe tempest-ProjectMemberTests-1830166883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-263de714-0e72-4b09-9fe3-b0ad165b4bbe tempest-ProjectMemberTests-1830166883 None] Flow 'volume_create_manager' (1f813709-8022-4191-85f6-70f579c9706f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:32:09 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-263de714-0e72-4b09-9fe3-b0ad165b4bbe tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ab37b3d-0c72-40dc-b2ed-9449c1661714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b0bc9009-0599-47cd-a63a-983e38316e5e tempest-VolumeDependencyTests-693697648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5.info" returned: 0 in 0.398s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:09 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-b0bc9009-0599-47cd-a63a-983e38316e5e tempest-VolumeDependencyTests-693697648 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5.info is being set with open permissions: ugo+rw Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b0bc9009-0599-47cd-a63a-983e38316e5e tempest-VolumeDependencyTests-693697648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-263de714-0e72-4b09-9fe3-b0ad165b4bbe tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ab37b3d-0c72-40dc-b2ed-9449c1661714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-696649597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b57c45b3-3438-4212-b119-981a67c79dfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e9ee545cbb4eb99d3a310cf4efc844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:32:09Z,use_quota=True,user_id='badece1d173b4e51add55b4a7c961a4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-263de714-0e72-4b09-9fe3-b0ad165b4bbe tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60e9f940-ff63-4203-b55b-fa47d0369762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-263de714-0e72-4b09-9fe3-b0ad165b4bbe tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60e9f940-ff63-4203-b55b-fa47d0369762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:09 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5.info Sep 03 11:32:09 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-263de714-0e72-4b09-9fe3-b0ad165b4bbe tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b6991af-0ee9-4588-a97e-302e1b419262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-263de714-0e72-4b09-9fe3-b0ad165b4bbe tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b6991af-0ee9-4588-a97e-302e1b419262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b57c45b3-3438-4212-b119-981a67c79dfb', 'volume_name': 'volume-b57c45b3-3438-4212-b119-981a67c79dfb', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-263de714-0e72-4b09-9fe3-b0ad165b4bbe tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ae5ec7a-e110-46a0-aabd-b3d3f14ffeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-263de714-0e72-4b09-9fe3-b0ad165b4bbe tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ae5ec7a-e110-46a0-aabd-b3d3f14ffeb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-263de714-0e72-4b09-9fe3-b0ad165b4bbe tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f1fc63b-58fb-4145-bc43-296a28e22f64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:09 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-263de714-0e72-4b09-9fe3-b0ad165b4bbe tempest-ProjectMemberTests-1830166883 None] Volume b57c45b3-3438-4212-b119-981a67c79dfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b57c45b3-3438-4212-b119-981a67c79dfb', 'volume_size': 1} Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-263de714-0e72-4b09-9fe3-b0ad165b4bbe tempest-ProjectMemberTests-1830166883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-35c0c5b7-0b12-4aff-86e4-ca69662a1256 tempest-ProjectReaderTests-1112694435 None] Created reservations ['a11971d0-148b-4639-8c20-905c64713de0', 'd40e9408-b74f-442d-abca-414c6d868b5a', '91fc61de-9b22-463a-8615-05873da6b1f1', '9e947b9e-2fdb-4f29-9334-3e7698627b64'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-35c0c5b7-0b12-4aff-86e4-ca69662a1256 tempest-ProjectReaderTests-1112694435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-35c0c5b7-0b12-4aff-86e4-ca69662a1256 tempest-ProjectReaderTests-1112694435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-35c0c5b7-0b12-4aff-86e4-ca69662a1256 tempest-ProjectReaderTests-1112694435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-35c0c5b7-0b12-4aff-86e4-ca69662a1256 tempest-ProjectReaderTests-1112694435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-35c0c5b7-0b12-4aff-86e4-ca69662a1256 tempest-ProjectReaderTests-1112694435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-35c0c5b7-0b12-4aff-86e4-ca69662a1256 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:09 devstack sudo[106198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:32:09 devstack sudo[106198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:09 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b0bc9009-0599-47cd-a63a-983e38316e5e tempest-VolumeDependencyTests-693697648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5.info" returned: 0 in 0.317s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b0bc9009-0599-47cd-a63a-983e38316e5e tempest-VolumeDependencyTests-693697648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.017s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-263de714-0e72-4b09-9fe3-b0ad165b4bbe tempest-ProjectMemberTests-1830166883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.264s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-263de714-0e72-4b09-9fe3-b0ad165b4bbe tempest-ProjectMemberTests-1830166883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:32:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-696649597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b57c45b3-3438-4212-b119-981a67c79dfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e9ee545cbb4eb99d3a310cf4efc844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:32:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:32:09Z,use_quota=True,user_id='badece1d173b4e51add55b4a7c961a4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-263de714-0e72-4b09-9fe3-b0ad165b4bbe tempest-ProjectMemberTests-1830166883 None] Creating volume b57c45b3-3438-4212-b119-981a67c79dfb {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-263de714-0e72-4b09-9fe3-b0ad165b4bbe tempest-ProjectMemberTests-1830166883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-263de714-0e72-4b09-9fe3-b0ad165b4bbe tempest-ProjectMemberTests-1830166883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-263de714-0e72-4b09-9fe3-b0ad165b4bbe tempest-ProjectMemberTests-1830166883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-263de714-0e72-4b09-9fe3-b0ad165b4bbe tempest-ProjectMemberTests-1830166883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-263de714-0e72-4b09-9fe3-b0ad165b4bbe tempest-ProjectMemberTests-1830166883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-263de714-0e72-4b09-9fe3-b0ad165b4bbe tempest-ProjectMemberTests-1830166883 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:32:09 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-263de714-0e72-4b09-9fe3-b0ad165b4bbe tempest-ProjectMemberTests-1830166883 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-263de714-0e72-4b09-9fe3-b0ad165b4bbe tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:09 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb 1073741824 Sep 03 11:32:09 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:09 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-b0bc9009-0599-47cd-a63a-983e38316e5e tempest-VolumeDependencyTests-693697648 None] Create snapshot completed successfully Sep 03 11:32:09 devstack sudo[106198]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-35c0c5b7-0b12-4aff-86e4-ca69662a1256 tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.292s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-35c0c5b7-0b12-4aff-86e4-ca69662a1256 tempest-ProjectReaderTests-1112694435 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:32:09 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-35c0c5b7-0b12-4aff-86e4-ca69662a1256 tempest-ProjectReaderTests-1112694435 None] Deleted volume successfully. Sep 03 11:32:09 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-35c0c5b7-0b12-4aff-86e4-ca69662a1256 tempest-ProjectReaderTests-1112694435 None] Lock "cinder-ab2f7bae-2faa-4ff9-b9b7-ef9a473486b7-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:10 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-263de714-0e72-4b09-9fe3-b0ad165b4bbe tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb 1073741824" returned: 0 in 0.511s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-263de714-0e72-4b09-9fe3-b0ad165b4bbe tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:10 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb Sep 03 11:32:10 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:10 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-263de714-0e72-4b09-9fe3-b0ad165b4bbe tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb" returned: 0 in 0.268s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:10 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-263de714-0e72-4b09-9fe3-b0ad165b4bbe tempest-ProjectMemberTests-1830166883 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:32:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-263de714-0e72-4b09-9fe3-b0ad165b4bbe tempest-ProjectMemberTests-1830166883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.827s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:10 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-263de714-0e72-4b09-9fe3-b0ad165b4bbe tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f1fc63b-58fb-4145-bc43-296a28e22f64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b57c45b3-3438-4212-b119-981a67c79dfb', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:10 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-263de714-0e72-4b09-9fe3-b0ad165b4bbe tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c047215-e192-4caa-b136-10e910451af4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:10 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-263de714-0e72-4b09-9fe3-b0ad165b4bbe tempest-ProjectMemberTests-1830166883 None] Volume volume-b57c45b3-3438-4212-b119-981a67c79dfb (b57c45b3-3438-4212-b119-981a67c79dfb): created successfully Sep 03 11:32:10 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-263de714-0e72-4b09-9fe3-b0ad165b4bbe tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c047215-e192-4caa-b136-10e910451af4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:10 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-263de714-0e72-4b09-9fe3-b0ad165b4bbe tempest-ProjectMemberTests-1830166883 None] Flow 'volume_create_manager' (1f813709-8022-4191-85f6-70f579c9706f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:32:10 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-263de714-0e72-4b09-9fe3-b0ad165b4bbe tempest-ProjectMemberTests-1830166883 None] Created volume successfully. Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-7343eda8-bc1b-4961-ae59-92be3d689fa5 tempest-ProjectReaderTests-1112694435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7343eda8-bc1b-4961-ae59-92be3d689fa5 tempest-ProjectReaderTests-1112694435 None] Flow 'volume_create_manager' (b4dc0845-5932-48e8-b469-f29f4f383e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7343eda8-bc1b-4961-ae59-92be3d689fa5 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f0e0e65-a0ff-4805-a8cd-2d3a9b1613a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7343eda8-bc1b-4961-ae59-92be3d689fa5 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f0e0e65-a0ff-4805-a8cd-2d3a9b1613a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-810855664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dcd4de0122b4179a023a1174825fdff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:32:11Z,use_quota=True,user_id='2c8f8d82e5ea4c34a765336d2de00340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7343eda8-bc1b-4961-ae59-92be3d689fa5 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdd762e8-0ea1-464a-90d9-8c2ca4d6afba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7343eda8-bc1b-4961-ae59-92be3d689fa5 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdd762e8-0ea1-464a-90d9-8c2ca4d6afba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7343eda8-bc1b-4961-ae59-92be3d689fa5 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99b496dc-9bb7-49c6-9748-d20acbc21db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7343eda8-bc1b-4961-ae59-92be3d689fa5 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99b496dc-9bb7-49c6-9748-d20acbc21db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23', 'volume_name': 'volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7343eda8-bc1b-4961-ae59-92be3d689fa5 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (999bc3e4-3b29-4364-8969-9d917fb6128e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7343eda8-bc1b-4961-ae59-92be3d689fa5 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (999bc3e4-3b29-4364-8969-9d917fb6128e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7343eda8-bc1b-4961-ae59-92be3d689fa5 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eb105bc-5060-48b2-9e73-3fba9a62593a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:11 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-7343eda8-bc1b-4961-ae59-92be3d689fa5 tempest-ProjectReaderTests-1112694435 None] Volume e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23', 'volume_size': 1} Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7343eda8-bc1b-4961-ae59-92be3d689fa5 tempest-ProjectReaderTests-1112694435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7343eda8-bc1b-4961-ae59-92be3d689fa5 tempest-ProjectReaderTests-1112694435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7343eda8-bc1b-4961-ae59-92be3d689fa5 tempest-ProjectReaderTests-1112694435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-810855664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dcd4de0122b4179a023a1174825fdff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:32:11Z,use_quota=True,user_id='2c8f8d82e5ea4c34a765336d2de00340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-7343eda8-bc1b-4961-ae59-92be3d689fa5 tempest-ProjectReaderTests-1112694435 None] Creating volume e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7343eda8-bc1b-4961-ae59-92be3d689fa5 tempest-ProjectReaderTests-1112694435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7343eda8-bc1b-4961-ae59-92be3d689fa5 tempest-ProjectReaderTests-1112694435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7343eda8-bc1b-4961-ae59-92be3d689fa5 tempest-ProjectReaderTests-1112694435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7343eda8-bc1b-4961-ae59-92be3d689fa5 tempest-ProjectReaderTests-1112694435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7343eda8-bc1b-4961-ae59-92be3d689fa5 tempest-ProjectReaderTests-1112694435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7343eda8-bc1b-4961-ae59-92be3d689fa5 tempest-ProjectReaderTests-1112694435 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:32:11 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-7343eda8-bc1b-4961-ae59-92be3d689fa5 tempest-ProjectReaderTests-1112694435 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7343eda8-bc1b-4961-ae59-92be3d689fa5 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:11 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23 1073741824 Sep 03 11:32:11 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Flow 'volume_create_manager' (26c55bc1-db4d-4166-84f1-db5e96fdba35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15bce78b-b0d4-4955-b279-fa87f752fbc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15bce78b-b0d4-4955-b279-fa87f752fbc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:32:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-776256799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46fcb641-ff20-487e-bcca-a7e5a395a3fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a782bf81519a4f28996e46ae093159ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:32:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=41b36384-cab1-41a5-81b2-126ac62a337e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:32:11Z,use_quota=True,user_id='409f6fef4703421f8a6f404896ae5883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0738e6cb-29e5-4d6e-ab7c-debfa56b6c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0738e6cb-29e5-4d6e-ab7c-debfa56b6c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c739e1f-f7cd-4c61-916b-e8e83bb639e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c739e1f-f7cd-4c61-916b-e8e83bb639e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '46fcb641-ff20-487e-bcca-a7e5a395a3fe', 'volume_name': 'volume-46fcb641-ff20-487e-bcca-a7e5a395a3fe', 'volume_size': 1, 'snapshot_id': '41b36384-cab1-41a5-81b2-126ac62a337e'}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cfabcb5-ae89-4c19-8d95-e84a33f75a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cfabcb5-ae89-4c19-8d95-e84a33f75a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b2daf7-4041-4e98-994d-0e4290fa3d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:11 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Volume 46fcb641-ff20-487e-bcca-a7e5a395a3fe: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-46fcb641-ff20-487e-bcca-a7e5a395a3fe', 'volume_size': 1, 'snapshot_id': '41b36384-cab1-41a5-81b2-126ac62a337e'} Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:11 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7343eda8-bc1b-4961-ae59-92be3d689fa5 tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23 1073741824" returned: 0 in 0.610s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7343eda8-bc1b-4961-ae59-92be3d689fa5 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:11 devstack sudo[106217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23 Sep 03 11:32:11 devstack sudo[106217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-c296a532-7292-4dc7-8acd-d0beb1b8f7d1 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:12 devstack sudo[106217]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7343eda8-bc1b-4961-ae59-92be3d689fa5 tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23" returned: 0 in 0.252s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7343eda8-bc1b-4961-ae59-92be3d689fa5 tempest-ProjectReaderTests-1112694435 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:32:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7343eda8-bc1b-4961-ae59-92be3d689fa5 tempest-ProjectReaderTests-1112694435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.409s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:12 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Acquiring lock "cinder-quobyte-41b36384-cab1-41a5-81b2-126ac62a337e-46fcb641-ff20-487e-bcca-a7e5a395a3fe" by "_create_volume_from_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7343eda8-bc1b-4961-ae59-92be3d689fa5 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9eb105bc-5060-48b2-9e73-3fba9a62593a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7343eda8-bc1b-4961-ae59-92be3d689fa5 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02f2e330-688b-46c8-b3dc-984b9375d4ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:12 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Lock "cinder-quobyte-41b36384-cab1-41a5-81b2-126ac62a337e-46fcb641-ff20-487e-bcca-a7e5a395a3fe" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Creating volume 46fcb641-ff20-487e-bcca-a7e5a395a3fe from snapshot 41b36384-cab1-41a5-81b2-126ac62a337e {{(pid=87038) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 11:32:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:32:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:32:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:32:12 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Acquiring lock "cinder-quobyte-46fcb641-ff20-487e-bcca-a7e5a395a3fe" by "_copy_volume_from_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:12 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-7343eda8-bc1b-4961-ae59-92be3d689fa5 tempest-ProjectReaderTests-1112694435 None] Volume volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23 (e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23): created successfully Sep 03 11:32:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7343eda8-bc1b-4961-ae59-92be3d689fa5 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02f2e330-688b-46c8-b3dc-984b9375d4ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:12 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-7343eda8-bc1b-4961-ae59-92be3d689fa5 tempest-ProjectReaderTests-1112694435 None] Flow 'volume_create_manager' (b4dc0845-5932-48e8-b469-f29f4f383e6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:32:12 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Lock "cinder-quobyte-46fcb641-ff20-487e-bcca-a7e5a395a3fe" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] snapshot: 41b36384-cab1-41a5-81b2-126ac62a337e, volume: 46fcb641-ff20-487e-bcca-a7e5a395a3fe, {{(pid=87038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 11:32:12 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-7343eda8-bc1b-4961-ae59-92be3d689fa5 tempest-ProjectReaderTests-1112694435 None] Created volume successfully. Sep 03 11:32:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:32:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:32:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:12 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b79233-44b7-4307-9fdf-9e25a64302f4]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5.41b36384-cab1-41a5-81b2-126ac62a337e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:12 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5.41b36384-cab1-41a5-81b2-126ac62a337e Sep 03 11:32:12 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:12 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5.41b36384-cab1-41a5-81b2-126ac62a337e" returned: 0 in 0.392s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-491f629e-688e-4be9-99c8-e85426a8d5c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:32:12 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3b6ba6-3034-4c2c-bd36-9659a8a283a9]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:12 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5 Sep 03 11:32:12 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:12 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5" returned: 0 in 0.380s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5 {{(pid=87038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 11:32:12 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Creating direct copy from snapshot {{(pid=87038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 11:32:12 devstack cinder-volume[87038]: DEBUG cinder.utils [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Path /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46fcb641-ff20-487e-bcca-a7e5a395a3fe not found in is_blk_device check {{(pid=87038) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 11:32:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46fcb641-ff20-487e-bcca-a7e5a395a3fe {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:13 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46fcb641-ff20-487e-bcca-a7e5a395a3fe Sep 03 11:32:13 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0f070e58-076e-4e19-b5ea-7a48bcf203cc tempest-ProjectReaderTests-1112694435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:17 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:32:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:32:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:32:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:18 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:18 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:32:18 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46fcb641-ff20-487e-bcca-a7e5a395a3fe" returned: 0 in 5.047s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:18 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Image conversion details: src /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5, size 1024.00 MB, duration 5.05 sec, destination /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46fcb641-ff20-487e-bcca-a7e5a395a3fe {{(pid=87038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:32:18 devstack cinder-volume[87038]: INFO cinder.image.image_utils [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Converted 1024.00 MB image at 202.85 MB/s Sep 03 11:32:18 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46fcb641-ff20-487e-bcca-a7e5a395a3fe is being set with open permissions: ugo+rw Sep 03 11:32:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46fcb641-ff20-487e-bcca-a7e5a395a3fe {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:18 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46fcb641-ff20-487e-bcca-a7e5a395a3fe Sep 03 11:32:18 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:18 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.270s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:18 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:32:18 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:32:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread count: 28 {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:32:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread info: [<_MainThread(MainThread, started 139554943000704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:32:18 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46fcb641-ff20-487e-bcca-a7e5a395a3fe" returned: 0 in 0.266s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:18 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Lock "cinder-quobyte-46fcb641-ff20-487e-bcca-a7e5a395a3fe" released by "_copy_volume_from_snapshot" :: held 6.170s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:18 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=196,cinder:UPDATE=312,cinder:INSERT=77,cinder:DELETE=34 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:32:18 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=240,cinder:UPDATE=290,cinder:DELETE=21,cinder:INSERT=81 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:32:18 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Lock "cinder-quobyte-41b36384-cab1-41a5-81b2-126ac62a337e-46fcb641-ff20-487e-bcca-a7e5a395a3fe" released by "_create_volume_from_snapshot" :: held 6.261s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.294s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-c296a532-7292-4dc7-8acd-d0beb1b8f7d1 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.511s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:18 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-c296a532-7292-4dc7-8acd-d0beb1b8f7d1 tempest-ProjectMemberTests-1830166883 None] Creating offline snapshot cf9e7bec-89ff-43e3-a7e4-8fdbc78deceb of volume b57c45b3-3438-4212-b119-981a67c79dfb {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:32:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5b2daf7-4041-4e98-994d-0e4290fa3d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46fcb641-ff20-487e-bcca-a7e5a395a3fe', 'volume_size': 1, 'snapshot_id': '41b36384-cab1-41a5-81b2-126ac62a337e'}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dec28231-aeb3-46c5-ba4f-bb02c73174e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:18 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c64e55-1b4e-478e-98ae-9b53c728f0ac]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c296a532-7292-4dc7-8acd-d0beb1b8f7d1 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:18 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Volume volume-46fcb641-ff20-487e-bcca-a7e5a395a3fe (46fcb641-ff20-487e-bcca-a7e5a395a3fe): created successfully Sep 03 11:32:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dec28231-aeb3-46c5-ba4f-bb02c73174e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Flow 'volume_create_manager' (26c55bc1-db4d-4166-84f1-db5e96fdba35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:32:18 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-00461759-0cc9-4d50-b672-b502a7851cd5 tempest-VolumeDependencyTests-693697648 None] Created volume successfully. Sep 03 11:32:18 devstack sudo[106251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb Sep 03 11:32:18 devstack sudo[106251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:18 devstack sudo[106251]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c296a532-7292-4dc7-8acd-d0beb1b8f7d1 tempest-ProjectMemberTests-1830166883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb" returned: 0 in 0.419s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c296a532-7292-4dc7-8acd-d0beb1b8f7d1 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb.cf9e7bec-89ff-43e3-a7e4-8fdbc78deceb 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:18 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb.cf9e7bec-89ff-43e3-a7e4-8fdbc78deceb 1G Sep 03 11:32:18 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:19 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-7fee634b-f79a-4673-a4e6-d32a2b691785 tempest-VolumeDependencyTests-693697648 None] Acquiring lock "cinder-41b36384-cab1-41a5-81b2-126ac62a337e-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:19 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-7fee634b-f79a-4673-a4e6-d32a2b691785 tempest-VolumeDependencyTests-693697648 None] Lock "cinder-41b36384-cab1-41a5-81b2-126ac62a337e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:19 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-7fee634b-f79a-4673-a4e6-d32a2b691785 tempest-VolumeDependencyTests-693697648 None] Acquiring lock "cinder-quobyte-491f629e-688e-4be9-99c8-e85426a8d5c5" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:19 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-7fee634b-f79a-4673-a4e6-d32a2b691785 tempest-VolumeDependencyTests-693697648 None] Lock "cinder-quobyte-491f629e-688e-4be9-99c8-e85426a8d5c5" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:19 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-7fee634b-f79a-4673-a4e6-d32a2b691785 tempest-VolumeDependencyTests-693697648 None] Acquiring lock "cinder-quobyte-41b36384-cab1-41a5-81b2-126ac62a337e" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:19 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-7fee634b-f79a-4673-a4e6-d32a2b691785 tempest-VolumeDependencyTests-693697648 None] Lock "cinder-quobyte-41b36384-cab1-41a5-81b2-126ac62a337e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:19 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-7fee634b-f79a-4673-a4e6-d32a2b691785 tempest-VolumeDependencyTests-693697648 None] Deleting offline snapshot 41b36384-cab1-41a5-81b2-126ac62a337e of volume 491f629e-688e-4be9-99c8-e85426a8d5c5 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:32:19 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-7fee634b-f79a-4673-a4e6-d32a2b691785 tempest-VolumeDependencyTests-693697648 None] snapshot_file for this snap is: volume-491f629e-688e-4be9-99c8-e85426a8d5c5.41b36384-cab1-41a5-81b2-126ac62a337e {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:32:19 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[2613797c-f7de-460e-8538-f8f91638cb38]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7fee634b-f79a-4673-a4e6-d32a2b691785 tempest-VolumeDependencyTests-693697648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5.41b36384-cab1-41a5-81b2-126ac62a337e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:19 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c296a532-7292-4dc7-8acd-d0beb1b8f7d1 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb.cf9e7bec-89ff-43e3-a7e4-8fdbc78deceb 1G" returned: 0 in 0.505s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c296a532-7292-4dc7-8acd-d0beb1b8f7d1 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b57c45b3-3438-4212-b119-981a67c79dfb -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb.cf9e7bec-89ff-43e3-a7e4-8fdbc78deceb {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:19 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b57c45b3-3438-4212-b119-981a67c79dfb -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb.cf9e7bec-89ff-43e3-a7e4-8fdbc78deceb Sep 03 11:32:19 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:19 devstack sudo[106262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5.41b36384-cab1-41a5-81b2-126ac62a337e Sep 03 11:32:19 devstack sudo[106262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:19 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c296a532-7292-4dc7-8acd-d0beb1b8f7d1 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b57c45b3-3438-4212-b119-981a67c79dfb -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb.cf9e7bec-89ff-43e3-a7e4-8fdbc78deceb" returned: 0 in 0.302s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:19 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-c296a532-7292-4dc7-8acd-d0beb1b8f7d1 tempest-ProjectMemberTests-1830166883 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb.cf9e7bec-89ff-43e3-a7e4-8fdbc78deceb is being set with open permissions: ugo+rw Sep 03 11:32:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c296a532-7292-4dc7-8acd-d0beb1b8f7d1 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb.cf9e7bec-89ff-43e3-a7e4-8fdbc78deceb {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:19 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb.cf9e7bec-89ff-43e3-a7e4-8fdbc78deceb Sep 03 11:32:19 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:19 devstack sudo[106262]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7fee634b-f79a-4673-a4e6-d32a2b691785 tempest-VolumeDependencyTests-693697648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5.41b36384-cab1-41a5-81b2-126ac62a337e" returned: 0 in 0.407s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:19 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-7fee634b-f79a-4673-a4e6-d32a2b691785 tempest-VolumeDependencyTests-693697648 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-491f629e-688e-4be9-99c8-e85426a8d5c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:32:19 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4441ed-8e4c-44fc-a5e0-f925663a42e8]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7fee634b-f79a-4673-a4e6-d32a2b691785 tempest-VolumeDependencyTests-693697648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:19 devstack sudo[106275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5 Sep 03 11:32:19 devstack sudo[106275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:19 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c296a532-7292-4dc7-8acd-d0beb1b8f7d1 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb.cf9e7bec-89ff-43e3-a7e4-8fdbc78deceb" returned: 0 in 0.259s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c296a532-7292-4dc7-8acd-d0beb1b8f7d1 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:19 devstack sudo[106278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb.info Sep 03 11:32:19 devstack sudo[106278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:20 devstack sudo[106278]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c296a532-7292-4dc7-8acd-d0beb1b8f7d1 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb.info" returned: 0 in 0.288s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:20 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-c296a532-7292-4dc7-8acd-d0beb1b8f7d1 tempest-ProjectMemberTests-1830166883 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb.info is being set with open permissions: ugo+rw Sep 03 11:32:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c296a532-7292-4dc7-8acd-d0beb1b8f7d1 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:20 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb.info Sep 03 11:32:20 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:20 devstack sudo[106275]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7fee634b-f79a-4673-a4e6-d32a2b691785 tempest-VolumeDependencyTests-693697648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5" returned: 0 in 0.571s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7fee634b-f79a-4673-a4e6-d32a2b691785 tempest-VolumeDependencyTests-693697648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5.41b36384-cab1-41a5-81b2-126ac62a337e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:20 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5.41b36384-cab1-41a5-81b2-126ac62a337e Sep 03 11:32:20 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:20 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c296a532-7292-4dc7-8acd-d0beb1b8f7d1 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb.info" returned: 0 in 0.274s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-c296a532-7292-4dc7-8acd-d0beb1b8f7d1 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.168s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0f070e58-076e-4e19-b5ea-7a48bcf203cc tempest-ProjectReaderTests-1112694435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.246s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-0f070e58-076e-4e19-b5ea-7a48bcf203cc tempest-ProjectReaderTests-1112694435 None] Creating offline snapshot 0e5ef694-dba3-41c1-9706-e0b024542329 of volume e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23 {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:32:20 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-c296a532-7292-4dc7-8acd-d0beb1b8f7d1 tempest-ProjectMemberTests-1830166883 None] Create snapshot completed successfully Sep 03 11:32:20 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff301307-d289-4081-b1fd-90dab0ee2d86]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0f070e58-076e-4e19-b5ea-7a48bcf203cc tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:20 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7fee634b-f79a-4673-a4e6-d32a2b691785 tempest-VolumeDependencyTests-693697648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5.41b36384-cab1-41a5-81b2-126ac62a337e" returned: 0 in 0.402s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7fee634b-f79a-4673-a4e6-d32a2b691785 tempest-VolumeDependencyTests-693697648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5.41b36384-cab1-41a5-81b2-126ac62a337e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:20 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5.41b36384-cab1-41a5-81b2-126ac62a337e Sep 03 11:32:20 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:20 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23 Sep 03 11:32:20 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:20 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7fee634b-f79a-4673-a4e6-d32a2b691785 tempest-VolumeDependencyTests-693697648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5.41b36384-cab1-41a5-81b2-126ac62a337e" returned: 0 in 0.283s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:20 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0f070e58-076e-4e19-b5ea-7a48bcf203cc tempest-ProjectReaderTests-1112694435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23" returned: 0 in 0.445s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0f070e58-076e-4e19-b5ea-7a48bcf203cc tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23.0e5ef694-dba3-41c1-9706-e0b024542329 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:21 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-7fee634b-f79a-4673-a4e6-d32a2b691785 tempest-VolumeDependencyTests-693697648 None] Lock "cinder-quobyte-41b36384-cab1-41a5-81b2-126ac62a337e" released by "_delete_snapshot" :: held 1.806s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:21 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-7fee634b-f79a-4673-a4e6-d32a2b691785 tempest-VolumeDependencyTests-693697648 None] Lock "cinder-quobyte-491f629e-688e-4be9-99c8-e85426a8d5c5" released by "delete_snapshot" :: held 1.835s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:21 devstack sudo[106302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23.0e5ef694-dba3-41c1-9706-e0b024542329 1G Sep 03 11:32:21 devstack sudo[106302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:21 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-7fee634b-f79a-4673-a4e6-d32a2b691785 tempest-VolumeDependencyTests-693697648 None] Created reservations ['0d8f9e48-1998-4805-8650-e177560f9eab', 'bc7b77ce-a48a-4d56-9215-26cbd89745f8', 'edacca94-ac2c-4ce2-b30f-73ece577e739', '9bf19d83-87d2-4030-9c77-9afb60e84a3b'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:32:21 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-7fee634b-f79a-4673-a4e6-d32a2b691785 tempest-VolumeDependencyTests-693697648 None] Delete snapshot completed successfully. Sep 03 11:32:21 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-7fee634b-f79a-4673-a4e6-d32a2b691785 tempest-VolumeDependencyTests-693697648 None] Lock "cinder-41b36384-cab1-41a5-81b2-126ac62a337e-delete_snapshot" released by "delete_snapshot" :: held 1.982s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:21 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-10b3bc50-9fde-460a-8b6b-602b6adf95c1 tempest-VolumeDependencyTests-693697648 None] Acquiring lock "cinder-491f629e-688e-4be9-99c8-e85426a8d5c5-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:21 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-10b3bc50-9fde-460a-8b6b-602b6adf95c1 tempest-VolumeDependencyTests-693697648 None] Lock "cinder-491f629e-688e-4be9-99c8-e85426a8d5c5-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:21 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-cc886c17-c0a6-4390-ae0b-305dc2205c56 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-cf9e7bec-89ff-43e3-a7e4-8fdbc78deceb-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:21 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-cc886c17-c0a6-4390-ae0b-305dc2205c56 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-cf9e7bec-89ff-43e3-a7e4-8fdbc78deceb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:21 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-cc886c17-c0a6-4390-ae0b-305dc2205c56 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-quobyte-b57c45b3-3438-4212-b119-981a67c79dfb" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:21 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-cc886c17-c0a6-4390-ae0b-305dc2205c56 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-b57c45b3-3438-4212-b119-981a67c79dfb" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:21 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-cc886c17-c0a6-4390-ae0b-305dc2205c56 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-quobyte-cf9e7bec-89ff-43e3-a7e4-8fdbc78deceb" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:21 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-10b3bc50-9fde-460a-8b6b-602b6adf95c1 tempest-VolumeDependencyTests-693697648 None] Acquiring lock "cinder-quobyte-491f629e-688e-4be9-99c8-e85426a8d5c5" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:21 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-cc886c17-c0a6-4390-ae0b-305dc2205c56 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-cf9e7bec-89ff-43e3-a7e4-8fdbc78deceb" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:21 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-cc886c17-c0a6-4390-ae0b-305dc2205c56 tempest-ProjectMemberTests-1830166883 None] Deleting offline snapshot cf9e7bec-89ff-43e3-a7e4-8fdbc78deceb of volume b57c45b3-3438-4212-b119-981a67c79dfb {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:32:21 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-cc886c17-c0a6-4390-ae0b-305dc2205c56 tempest-ProjectMemberTests-1830166883 None] snapshot_file for this snap is: volume-b57c45b3-3438-4212-b119-981a67c79dfb.cf9e7bec-89ff-43e3-a7e4-8fdbc78deceb {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:32:21 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-10b3bc50-9fde-460a-8b6b-602b6adf95c1 tempest-VolumeDependencyTests-693697648 None] Lock "cinder-quobyte-491f629e-688e-4be9-99c8-e85426a8d5c5" acquired by "delete_volume" :: waited 0.058s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:21 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64e60c5-f560-41d1-b0dc-adaba4f6c274]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cc886c17-c0a6-4390-ae0b-305dc2205c56 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb.cf9e7bec-89ff-43e3-a7e4-8fdbc78deceb {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:21 devstack sudo[106302]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0f070e58-076e-4e19-b5ea-7a48bcf203cc tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23.0e5ef694-dba3-41c1-9706-e0b024542329 1G" returned: 0 in 0.617s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0f070e58-076e-4e19-b5ea-7a48bcf203cc tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23.0e5ef694-dba3-41c1-9706-e0b024542329 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:21 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[529060e0-7fa8-476c-8b69-e3ac5d545bcf]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-10b3bc50-9fde-460a-8b6b-602b6adf95c1 tempest-VolumeDependencyTests-693697648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:21 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23.0e5ef694-dba3-41c1-9706-e0b024542329 Sep 03 11:32:21 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:21 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb.cf9e7bec-89ff-43e3-a7e4-8fdbc78deceb Sep 03 11:32:21 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:21 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5 Sep 03 11:32:21 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:22 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:22 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0f070e58-076e-4e19-b5ea-7a48bcf203cc tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23.0e5ef694-dba3-41c1-9706-e0b024542329" returned: 0 in 0.440s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:22 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-0f070e58-076e-4e19-b5ea-7a48bcf203cc tempest-ProjectReaderTests-1112694435 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23.0e5ef694-dba3-41c1-9706-e0b024542329 is being set with open permissions: ugo+rw Sep 03 11:32:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0f070e58-076e-4e19-b5ea-7a48bcf203cc tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23.0e5ef694-dba3-41c1-9706-e0b024542329 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-10b3bc50-9fde-460a-8b6b-602b6adf95c1 tempest-VolumeDependencyTests-693697648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5" returned: 0 in 0.435s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-10b3bc50-9fde-460a-8b6b-602b6adf95c1 tempest-VolumeDependencyTests-693697648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:22 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23.0e5ef694-dba3-41c1-9706-e0b024542329 Sep 03 11:32:22 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:22 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5 Sep 03 11:32:22 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:22 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cc886c17-c0a6-4390-ae0b-305dc2205c56 tempest-ProjectMemberTests-1830166883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb.cf9e7bec-89ff-43e3-a7e4-8fdbc78deceb" returned: 0 in 0.546s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:22 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-cc886c17-c0a6-4390-ae0b-305dc2205c56 tempest-ProjectMemberTests-1830166883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b57c45b3-3438-4212-b119-981a67c79dfb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:32:22 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[0001b5e0-9292-49ea-a52b-8a8a755be175]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cc886c17-c0a6-4390-ae0b-305dc2205c56 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:22 devstack sudo[106364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb Sep 03 11:32:22 devstack sudo[106364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:22 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-10b3bc50-9fde-460a-8b6b-602b6adf95c1 tempest-VolumeDependencyTests-693697648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-491f629e-688e-4be9-99c8-e85426a8d5c5" returned: 0 in 0.292s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:22 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0f070e58-076e-4e19-b5ea-7a48bcf203cc tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23.0e5ef694-dba3-41c1-9706-e0b024542329" returned: 0 in 0.346s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:22 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-10b3bc50-9fde-460a-8b6b-602b6adf95c1 tempest-VolumeDependencyTests-693697648 None] Lock "cinder-quobyte-491f629e-688e-4be9-99c8-e85426a8d5c5" released by "delete_volume" :: held 0.875s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0f070e58-076e-4e19-b5ea-7a48bcf203cc tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:22 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23.info Sep 03 11:32:22 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:22 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-10b3bc50-9fde-460a-8b6b-602b6adf95c1 tempest-VolumeDependencyTests-693697648 None] Created reservations ['6d6e37f9-cd1f-44d0-a2e5-c75a304cdd1a', '8343f5b2-eb2f-401b-b35f-b75371d101ff', '96caa8e4-2a58-461a-82fe-0bb42f10562d', 'db36fffa-e247-4f50-bbd4-aa831ec4b5f7'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:32:22 devstack sudo[106364]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cc886c17-c0a6-4390-ae0b-305dc2205c56 tempest-ProjectMemberTests-1830166883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb" returned: 0 in 0.490s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cc886c17-c0a6-4390-ae0b-305dc2205c56 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb.cf9e7bec-89ff-43e3-a7e4-8fdbc78deceb {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:22 devstack sudo[106374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb.cf9e7bec-89ff-43e3-a7e4-8fdbc78deceb Sep 03 11:32:22 devstack sudo[106374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-10b3bc50-9fde-460a-8b6b-602b6adf95c1 tempest-VolumeDependencyTests-693697648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-10b3bc50-9fde-460a-8b6b-602b6adf95c1 tempest-VolumeDependencyTests-693697648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:22 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-10b3bc50-9fde-460a-8b6b-602b6adf95c1 tempest-VolumeDependencyTests-693697648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:32:22 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-10b3bc50-9fde-460a-8b6b-602b6adf95c1 tempest-VolumeDependencyTests-693697648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:32:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-10b3bc50-9fde-460a-8b6b-602b6adf95c1 tempest-VolumeDependencyTests-693697648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-10b3bc50-9fde-460a-8b6b-602b6adf95c1 tempest-VolumeDependencyTests-693697648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:22 devstack sudo[106376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:32:22 devstack sudo[106376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:22 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0f070e58-076e-4e19-b5ea-7a48bcf203cc tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23.info" returned: 0 in 0.408s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:22 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-0f070e58-076e-4e19-b5ea-7a48bcf203cc tempest-ProjectReaderTests-1112694435 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23.info is being set with open permissions: ugo+rw Sep 03 11:32:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0f070e58-076e-4e19-b5ea-7a48bcf203cc tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:22 devstack sudo[106380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23.info Sep 03 11:32:22 devstack sudo[106380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:23 devstack sudo[106376]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-10b3bc50-9fde-460a-8b6b-602b6adf95c1 tempest-VolumeDependencyTests-693697648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.325s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:23 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-10b3bc50-9fde-460a-8b6b-602b6adf95c1 tempest-VolumeDependencyTests-693697648 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:32:23 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-10b3bc50-9fde-460a-8b6b-602b6adf95c1 tempest-VolumeDependencyTests-693697648 None] Deleted volume successfully. Sep 03 11:32:23 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-10b3bc50-9fde-460a-8b6b-602b6adf95c1 tempest-VolumeDependencyTests-693697648 None] Lock "cinder-491f629e-688e-4be9-99c8-e85426a8d5c5-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:23 devstack sudo[106374]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cc886c17-c0a6-4390-ae0b-305dc2205c56 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb.cf9e7bec-89ff-43e3-a7e4-8fdbc78deceb" returned: 0 in 0.488s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cc886c17-c0a6-4390-ae0b-305dc2205c56 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb.cf9e7bec-89ff-43e3-a7e4-8fdbc78deceb {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:23 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb.cf9e7bec-89ff-43e3-a7e4-8fdbc78deceb Sep 03 11:32:23 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:23 devstack sudo[106380]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-0f070e58-076e-4e19-b5ea-7a48bcf203cc tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23.info" returned: 0 in 0.328s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-0f070e58-076e-4e19-b5ea-7a48bcf203cc tempest-ProjectReaderTests-1112694435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.795s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:23 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-0f070e58-076e-4e19-b5ea-7a48bcf203cc tempest-ProjectReaderTests-1112694435 None] Create snapshot completed successfully Sep 03 11:32:23 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cc886c17-c0a6-4390-ae0b-305dc2205c56 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb.cf9e7bec-89ff-43e3-a7e4-8fdbc78deceb" returned: 0 in 0.314s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:23 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-cc886c17-c0a6-4390-ae0b-305dc2205c56 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-cf9e7bec-89ff-43e3-a7e4-8fdbc78deceb" released by "_delete_snapshot" :: held 2.018s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:23 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-cc886c17-c0a6-4390-ae0b-305dc2205c56 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-b57c45b3-3438-4212-b119-981a67c79dfb" released by "delete_snapshot" :: held 2.062s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:23 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-cc886c17-c0a6-4390-ae0b-305dc2205c56 tempest-ProjectMemberTests-1830166883 None] Created reservations ['bdcf151b-678c-417e-92f4-147795c85352', '178ca445-4fbd-4ed9-be8a-4a785a41f5fc', '88d9c94d-2e37-4954-a04d-61dde8fdbc92', '0a0e2ebf-b6e2-48be-a5c8-44f3bf8581f5'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:32:23 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-cc886c17-c0a6-4390-ae0b-305dc2205c56 tempest-ProjectMemberTests-1830166883 None] Delete snapshot completed successfully. Sep 03 11:32:23 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-cc886c17-c0a6-4390-ae0b-305dc2205c56 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-cf9e7bec-89ff-43e3-a7e4-8fdbc78deceb-delete_snapshot" released by "delete_snapshot" :: held 2.261s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:23 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8e8600df-eb68-44c0-83dd-599605fbce2a tempest-VolumeDependencyTests-693697648 None] Acquiring lock "cinder-46fcb641-ff20-487e-bcca-a7e5a395a3fe-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:23 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8e8600df-eb68-44c0-83dd-599605fbce2a tempest-VolumeDependencyTests-693697648 None] Lock "cinder-46fcb641-ff20-487e-bcca-a7e5a395a3fe-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:23 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8e8600df-eb68-44c0-83dd-599605fbce2a tempest-VolumeDependencyTests-693697648 None] Acquiring lock "cinder-quobyte-46fcb641-ff20-487e-bcca-a7e5a395a3fe" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:23 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8e8600df-eb68-44c0-83dd-599605fbce2a tempest-VolumeDependencyTests-693697648 None] Lock "cinder-quobyte-46fcb641-ff20-487e-bcca-a7e5a395a3fe" acquired by "delete_volume" :: waited 0.015s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:23 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d796776-db1f-4d47-aa2e-a908a0198203]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8e8600df-eb68-44c0-83dd-599605fbce2a tempest-VolumeDependencyTests-693697648 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46fcb641-ff20-487e-bcca-a7e5a395a3fe {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:23 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-39c04c20-fe95-4617-b42e-2f19e9d32b75 tempest-ProjectReaderTests-1112694435 None] Acquiring lock "cinder-0e5ef694-dba3-41c1-9706-e0b024542329-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:23 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-39c04c20-fe95-4617-b42e-2f19e9d32b75 tempest-ProjectReaderTests-1112694435 None] Lock "cinder-0e5ef694-dba3-41c1-9706-e0b024542329-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:23 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-39c04c20-fe95-4617-b42e-2f19e9d32b75 tempest-ProjectReaderTests-1112694435 None] Acquiring lock "cinder-quobyte-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:23 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-97ecf3f6-2f5b-4bd0-a372-90e7c6727bb7 tempest-SnapshotDependencyTests-3664945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:32:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-97ecf3f6-2f5b-4bd0-a372-90e7c6727bb7 tempest-SnapshotDependencyTests-3664945 None] Flow 'volume_create_manager' (9547212f-c1d2-4b03-9003-8a271a61ab9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:32:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-97ecf3f6-2f5b-4bd0-a372-90e7c6727bb7 tempest-SnapshotDependencyTests-3664945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b49e2ccf-12e1-4b64-9687-2946c382fd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-97ecf3f6-2f5b-4bd0-a372-90e7c6727bb7 tempest-SnapshotDependencyTests-3664945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b49e2ccf-12e1-4b64-9687-2946c382fd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-516771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cfd7cd8-1a14-4a19-a815-f19222c54be9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47bb573456d146139915b2b06f88e2ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:32:24Z,use_quota=True,user_id='92a459b3b7134321a8056f701a267cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-97ecf3f6-2f5b-4bd0-a372-90e7c6727bb7 tempest-SnapshotDependencyTests-3664945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (027de030-bf57-4460-85da-253032b961a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-97ecf3f6-2f5b-4bd0-a372-90e7c6727bb7 tempest-SnapshotDependencyTests-3664945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (027de030-bf57-4460-85da-253032b961a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-97ecf3f6-2f5b-4bd0-a372-90e7c6727bb7 tempest-SnapshotDependencyTests-3664945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32e332fd-d5c4-441a-a3aa-423ed47a0778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-97ecf3f6-2f5b-4bd0-a372-90e7c6727bb7 tempest-SnapshotDependencyTests-3664945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32e332fd-d5c4-441a-a3aa-423ed47a0778) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cfd7cd8-1a14-4a19-a815-f19222c54be9', 'volume_name': 'volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:24 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46fcb641-ff20-487e-bcca-a7e5a395a3fe Sep 03 11:32:24 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-97ecf3f6-2f5b-4bd0-a372-90e7c6727bb7 tempest-SnapshotDependencyTests-3664945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96864a4d-22e3-4ca5-b272-31ede707e28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-97ecf3f6-2f5b-4bd0-a372-90e7c6727bb7 tempest-SnapshotDependencyTests-3664945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96864a4d-22e3-4ca5-b272-31ede707e28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-97ecf3f6-2f5b-4bd0-a372-90e7c6727bb7 tempest-SnapshotDependencyTests-3664945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e12d07-a24b-4f56-a664-f66a2d07ab9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:24 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-97ecf3f6-2f5b-4bd0-a372-90e7c6727bb7 tempest-SnapshotDependencyTests-3664945 None] Volume 4cfd7cd8-1a14-4a19-a815-f19222c54be9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9', 'volume_size': 1} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-97ecf3f6-2f5b-4bd0-a372-90e7c6727bb7 tempest-SnapshotDependencyTests-3664945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-97ecf3f6-2f5b-4bd0-a372-90e7c6727bb7 tempest-SnapshotDependencyTests-3664945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-97ecf3f6-2f5b-4bd0-a372-90e7c6727bb7 tempest-SnapshotDependencyTests-3664945 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:32:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-516771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cfd7cd8-1a14-4a19-a815-f19222c54be9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47bb573456d146139915b2b06f88e2ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:32:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:32:24Z,use_quota=True,user_id='92a459b3b7134321a8056f701a267cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-97ecf3f6-2f5b-4bd0-a372-90e7c6727bb7 tempest-SnapshotDependencyTests-3664945 None] Creating volume 4cfd7cd8-1a14-4a19-a815-f19222c54be9 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-97ecf3f6-2f5b-4bd0-a372-90e7c6727bb7 tempest-SnapshotDependencyTests-3664945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-97ecf3f6-2f5b-4bd0-a372-90e7c6727bb7 tempest-SnapshotDependencyTests-3664945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-97ecf3f6-2f5b-4bd0-a372-90e7c6727bb7 tempest-SnapshotDependencyTests-3664945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-97ecf3f6-2f5b-4bd0-a372-90e7c6727bb7 tempest-SnapshotDependencyTests-3664945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-97ecf3f6-2f5b-4bd0-a372-90e7c6727bb7 tempest-SnapshotDependencyTests-3664945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-97ecf3f6-2f5b-4bd0-a372-90e7c6727bb7 tempest-SnapshotDependencyTests-3664945 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:32:24 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-97ecf3f6-2f5b-4bd0-a372-90e7c6727bb7 tempest-SnapshotDependencyTests-3664945 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-97ecf3f6-2f5b-4bd0-a372-90e7c6727bb7 tempest-SnapshotDependencyTests-3664945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-39c04c20-fe95-4617-b42e-2f19e9d32b75 tempest-ProjectReaderTests-1112694435 None] Lock "cinder-quobyte-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23" acquired by "delete_snapshot" :: waited 0.108s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-39c04c20-fe95-4617-b42e-2f19e9d32b75 tempest-ProjectReaderTests-1112694435 None] Acquiring lock "cinder-quobyte-0e5ef694-dba3-41c1-9706-e0b024542329" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:24 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9 1073741824 Sep 03 11:32:24 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-39c04c20-fe95-4617-b42e-2f19e9d32b75 tempest-ProjectReaderTests-1112694435 None] Lock "cinder-quobyte-0e5ef694-dba3-41c1-9706-e0b024542329" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-39c04c20-fe95-4617-b42e-2f19e9d32b75 tempest-ProjectReaderTests-1112694435 None] Deleting offline snapshot 0e5ef694-dba3-41c1-9706-e0b024542329 of volume e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-39c04c20-fe95-4617-b42e-2f19e9d32b75 tempest-ProjectReaderTests-1112694435 None] snapshot_file for this snap is: volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23.0e5ef694-dba3-41c1-9706-e0b024542329 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a7e61d-d063-4622-9700-57a4e7dc0098]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-39c04c20-fe95-4617-b42e-2f19e9d32b75 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23.0e5ef694-dba3-41c1-9706-e0b024542329 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:24 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23.0e5ef694-dba3-41c1-9706-e0b024542329 Sep 03 11:32:24 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:24 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8e8600df-eb68-44c0-83dd-599605fbce2a tempest-VolumeDependencyTests-693697648 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46fcb641-ff20-487e-bcca-a7e5a395a3fe" returned: 0 in 0.395s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8e8600df-eb68-44c0-83dd-599605fbce2a tempest-VolumeDependencyTests-693697648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46fcb641-ff20-487e-bcca-a7e5a395a3fe {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:24 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46fcb641-ff20-487e-bcca-a7e5a395a3fe Sep 03 11:32:24 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:24 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-97ecf3f6-2f5b-4bd0-a372-90e7c6727bb7 tempest-SnapshotDependencyTests-3664945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9 1073741824" returned: 0 in 0.456s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:24 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-39c04c20-fe95-4617-b42e-2f19e9d32b75 tempest-ProjectReaderTests-1112694435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23.0e5ef694-dba3-41c1-9706-e0b024542329" returned: 0 in 0.400s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-39c04c20-fe95-4617-b42e-2f19e9d32b75 tempest-ProjectReaderTests-1112694435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbff2ead-3ea3-4e43-bd52-44c62e704b8b]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-39c04c20-fe95-4617-b42e-2f19e9d32b75 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:24 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8e8600df-eb68-44c0-83dd-599605fbce2a tempest-VolumeDependencyTests-693697648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46fcb641-ff20-487e-bcca-a7e5a395a3fe" returned: 0 in 0.298s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-97ecf3f6-2f5b-4bd0-a372-90e7c6727bb7 tempest-SnapshotDependencyTests-3664945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8e8600df-eb68-44c0-83dd-599605fbce2a tempest-VolumeDependencyTests-693697648 None] Lock "cinder-quobyte-46fcb641-ff20-487e-bcca-a7e5a395a3fe" released by "delete_volume" :: held 0.756s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:24 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9 Sep 03 11:32:24 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-8e8600df-eb68-44c0-83dd-599605fbce2a tempest-VolumeDependencyTests-693697648 None] Created reservations ['5d28b301-ed29-485a-a54b-adde5111272e', 'dc5c1659-09a8-4a48-abf1-60da39dd9edf', '8b9488a2-3798-4eac-b6c0-85c8bf336004', '00453b7a-2a4d-4596-98ee-67a4f4b862a9'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:32:24 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23 Sep 03 11:32:24 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2cef90f0-f0cc-46d5-b936-b2d42eb390fc tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-b57c45b3-3438-4212-b119-981a67c79dfb-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2cef90f0-f0cc-46d5-b936-b2d42eb390fc tempest-ProjectMemberTests-1830166883 None] Lock "cinder-b57c45b3-3438-4212-b119-981a67c79dfb-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-8e8600df-eb68-44c0-83dd-599605fbce2a tempest-VolumeDependencyTests-693697648 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-8e8600df-eb68-44c0-83dd-599605fbce2a tempest-VolumeDependencyTests-693697648 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-8e8600df-eb68-44c0-83dd-599605fbce2a tempest-VolumeDependencyTests-693697648 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-8e8600df-eb68-44c0-83dd-599605fbce2a tempest-VolumeDependencyTests-693697648 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-8e8600df-eb68-44c0-83dd-599605fbce2a tempest-VolumeDependencyTests-693697648 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8e8600df-eb68-44c0-83dd-599605fbce2a tempest-VolumeDependencyTests-693697648 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2cef90f0-f0cc-46d5-b936-b2d42eb390fc tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-quobyte-b57c45b3-3438-4212-b119-981a67c79dfb" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:24 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:32:24 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2cef90f0-f0cc-46d5-b936-b2d42eb390fc tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-b57c45b3-3438-4212-b119-981a67c79dfb" acquired by "delete_volume" :: waited 0.019s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[f635a26c-c6f8-483d-b214-07c72b49e3c2]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2cef90f0-f0cc-46d5-b936-b2d42eb390fc tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:24 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-97ecf3f6-2f5b-4bd0-a372-90e7c6727bb7 tempest-SnapshotDependencyTests-3664945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9" returned: 0 in 0.336s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-97ecf3f6-2f5b-4bd0-a372-90e7c6727bb7 tempest-SnapshotDependencyTests-3664945 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-97ecf3f6-2f5b-4bd0-a372-90e7c6727bb7 tempest-SnapshotDependencyTests-3664945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-97ecf3f6-2f5b-4bd0-a372-90e7c6727bb7 tempest-SnapshotDependencyTests-3664945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e12d07-a24b-4f56-a664-f66a2d07ab9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-97ecf3f6-2f5b-4bd0-a372-90e7c6727bb7 tempest-SnapshotDependencyTests-3664945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf05f47-f9c9-437e-94fe-95a0878618c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:24 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-97ecf3f6-2f5b-4bd0-a372-90e7c6727bb7 tempest-SnapshotDependencyTests-3664945 None] Volume volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9 (4cfd7cd8-1a14-4a19-a815-f19222c54be9): created successfully Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-97ecf3f6-2f5b-4bd0-a372-90e7c6727bb7 tempest-SnapshotDependencyTests-3664945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cf05f47-f9c9-437e-94fe-95a0878618c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:24 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-97ecf3f6-2f5b-4bd0-a372-90e7c6727bb7 tempest-SnapshotDependencyTests-3664945 None] Flow 'volume_create_manager' (9547212f-c1d2-4b03-9003-8a271a61ab9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:32:25 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-39c04c20-fe95-4617-b42e-2f19e9d32b75 tempest-ProjectReaderTests-1112694435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23" returned: 0 in 0.441s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-39c04c20-fe95-4617-b42e-2f19e9d32b75 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23.0e5ef694-dba3-41c1-9706-e0b024542329 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:25 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-97ecf3f6-2f5b-4bd0-a372-90e7c6727bb7 tempest-SnapshotDependencyTests-3664945 None] Created volume successfully. Sep 03 11:32:25 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb Sep 03 11:32:25 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:25 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23.0e5ef694-dba3-41c1-9706-e0b024542329 Sep 03 11:32:25 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:25 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-8e8600df-eb68-44c0-83dd-599605fbce2a tempest-VolumeDependencyTests-693697648 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.353s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:25 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-8e8600df-eb68-44c0-83dd-599605fbce2a tempest-VolumeDependencyTests-693697648 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:32:25 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-8e8600df-eb68-44c0-83dd-599605fbce2a tempest-VolumeDependencyTests-693697648 None] Deleted volume successfully. Sep 03 11:32:25 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-8e8600df-eb68-44c0-83dd-599605fbce2a tempest-VolumeDependencyTests-693697648 None] Lock "cinder-46fcb641-ff20-487e-bcca-a7e5a395a3fe-delete_volume" released by "delete_volume" :: held 1.403s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:25 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2cef90f0-f0cc-46d5-b936-b2d42eb390fc tempest-ProjectMemberTests-1830166883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb" returned: 0 in 0.417s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2cef90f0-f0cc-46d5-b936-b2d42eb390fc tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:25 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb Sep 03 11:32:25 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:25 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-39c04c20-fe95-4617-b42e-2f19e9d32b75 tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23.0e5ef694-dba3-41c1-9706-e0b024542329" returned: 0 in 0.410s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-39c04c20-fe95-4617-b42e-2f19e9d32b75 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23.0e5ef694-dba3-41c1-9706-e0b024542329 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:25 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23.0e5ef694-dba3-41c1-9706-e0b024542329 Sep 03 11:32:25 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:25 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2cef90f0-f0cc-46d5-b936-b2d42eb390fc tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-b57c45b3-3438-4212-b119-981a67c79dfb" returned: 0 in 0.294s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:25 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2cef90f0-f0cc-46d5-b936-b2d42eb390fc tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-b57c45b3-3438-4212-b119-981a67c79dfb" released by "delete_volume" :: held 0.826s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:25 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-39c04c20-fe95-4617-b42e-2f19e9d32b75 tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23.0e5ef694-dba3-41c1-9706-e0b024542329" returned: 0 in 0.288s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:25 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-2cef90f0-f0cc-46d5-b936-b2d42eb390fc tempest-ProjectMemberTests-1830166883 None] Created reservations ['4be968b8-5bc7-44d8-b654-84a7f4236f93', 'cc61224b-dc1c-49c4-97aa-89a58a3cfd3a', 'e596ac6b-9d16-4598-a973-1d7f97924d43', 'df73cb27-18a2-4df9-97ea-a8e396a241de'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:32:25 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-39c04c20-fe95-4617-b42e-2f19e9d32b75 tempest-ProjectReaderTests-1112694435 None] Lock "cinder-quobyte-0e5ef694-dba3-41c1-9706-e0b024542329" released by "_delete_snapshot" :: held 1.674s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:25 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-39c04c20-fe95-4617-b42e-2f19e9d32b75 tempest-ProjectReaderTests-1112694435 None] Lock "cinder-quobyte-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23" released by "delete_snapshot" :: held 1.702s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2cef90f0-f0cc-46d5-b936-b2d42eb390fc tempest-ProjectMemberTests-1830166883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2cef90f0-f0cc-46d5-b936-b2d42eb390fc tempest-ProjectMemberTests-1830166883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:25 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2cef90f0-f0cc-46d5-b936-b2d42eb390fc tempest-ProjectMemberTests-1830166883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:32:25 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-2cef90f0-f0cc-46d5-b936-b2d42eb390fc tempest-ProjectMemberTests-1830166883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:32:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-2cef90f0-f0cc-46d5-b936-b2d42eb390fc tempest-ProjectMemberTests-1830166883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2cef90f0-f0cc-46d5-b936-b2d42eb390fc tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:25 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:32:25 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:25 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-39c04c20-fe95-4617-b42e-2f19e9d32b75 tempest-ProjectReaderTests-1112694435 None] Created reservations ['e3653613-8428-4588-9173-d8e7a563c73e', 'a73685b0-3567-40da-998a-0f2c16b0c064', 'ba3658de-72a5-43a1-9f6f-aa5fb7981dd6', 'b9d06c89-cd5d-4cf2-bdbf-7aeb9afc03eb'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:32:26 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-39c04c20-fe95-4617-b42e-2f19e9d32b75 tempest-ProjectReaderTests-1112694435 None] Delete snapshot completed successfully. Sep 03 11:32:26 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-39c04c20-fe95-4617-b42e-2f19e9d32b75 tempest-ProjectReaderTests-1112694435 None] Lock "cinder-0e5ef694-dba3-41c1-9706-e0b024542329-delete_snapshot" released by "delete_snapshot" :: held 2.105s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:26 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-2cef90f0-f0cc-46d5-b936-b2d42eb390fc tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.395s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:26 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-2cef90f0-f0cc-46d5-b936-b2d42eb390fc tempest-ProjectMemberTests-1830166883 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:32:26 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-2cef90f0-f0cc-46d5-b936-b2d42eb390fc tempest-ProjectMemberTests-1830166883 None] Deleted volume successfully. Sep 03 11:32:26 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-2cef90f0-f0cc-46d5-b936-b2d42eb390fc tempest-ProjectMemberTests-1830166883 None] Lock "cinder-b57c45b3-3438-4212-b119-981a67c79dfb-delete_volume" released by "delete_volume" :: held 1.573s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:26 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-53263412-f590-4917-8856-dbcb02c28752 tempest-ProjectReaderTests-1112694435 None] Acquiring lock "cinder-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:26 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-53263412-f590-4917-8856-dbcb02c28752 tempest-ProjectReaderTests-1112694435 None] Lock "cinder-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:26 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-53263412-f590-4917-8856-dbcb02c28752 tempest-ProjectReaderTests-1112694435 None] Acquiring lock "cinder-quobyte-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:26 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-53263412-f590-4917-8856-dbcb02c28752 tempest-ProjectReaderTests-1112694435 None] Lock "cinder-quobyte-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23" acquired by "delete_volume" :: waited 0.038s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:26 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[292377f6-3db3-4dad-af6d-da2332accc1b]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-53263412-f590-4917-8856-dbcb02c28752 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-414655ec-bd6e-4c32-8671-19afdb73ef5e tempest-SnapshotDependencyTests-3664945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-414655ec-bd6e-4c32-8671-19afdb73ef5e tempest-SnapshotDependencyTests-3664945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:26 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec9b794a-10e2-4de4-ab76-b5f565cad4f1 tempest-ProjectMemberTests-1830166883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:32:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ec9b794a-10e2-4de4-ab76-b5f565cad4f1 tempest-ProjectMemberTests-1830166883 None] Flow 'volume_create_manager' (c36ba697-621c-4df9-9ea1-3837c61da9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:32:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ec9b794a-10e2-4de4-ab76-b5f565cad4f1 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2f749ef-7c5c-4ec7-ad3b-db127f622480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:26 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-414655ec-bd6e-4c32-8671-19afdb73ef5e tempest-SnapshotDependencyTests-3664945 None] Creating offline snapshot 859b30d5-2e55-4b4f-b542-4382186537e9 of volume 4cfd7cd8-1a14-4a19-a815-f19222c54be9 {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:32:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ec9b794a-10e2-4de4-ab76-b5f565cad4f1 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2f749ef-7c5c-4ec7-ad3b-db127f622480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-226340723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ab4bbd-e13f-4b87-b357-c331e55ea355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e9ee545cbb4eb99d3a310cf4efc844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:32:27Z,use_quota=True,user_id='badece1d173b4e51add55b4a7c961a4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ec9b794a-10e2-4de4-ab76-b5f565cad4f1 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c43771f4-eb8e-4136-af34-b952247337ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:26 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23 Sep 03 11:32:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ec9b794a-10e2-4de4-ab76-b5f565cad4f1 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c43771f4-eb8e-4136-af34-b952247337ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:26 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ec9b794a-10e2-4de4-ab76-b5f565cad4f1 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a42c1fae-8e23-4b44-a92c-f62d27db88c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ec9b794a-10e2-4de4-ab76-b5f565cad4f1 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a42c1fae-8e23-4b44-a92c-f62d27db88c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48ab4bbd-e13f-4b87-b357-c331e55ea355', 'volume_name': 'volume-48ab4bbd-e13f-4b87-b357-c331e55ea355', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ec9b794a-10e2-4de4-ab76-b5f565cad4f1 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8757b55-a25f-4e98-bce4-57e103b08c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ec9b794a-10e2-4de4-ab76-b5f565cad4f1 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8757b55-a25f-4e98-bce4-57e103b08c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:26 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ec9b794a-10e2-4de4-ab76-b5f565cad4f1 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20b65640-3ee1-46cb-ba60-fe84a30ebf0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:26 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-ec9b794a-10e2-4de4-ab76-b5f565cad4f1 tempest-ProjectMemberTests-1830166883 None] Volume 48ab4bbd-e13f-4b87-b357-c331e55ea355: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48ab4bbd-e13f-4b87-b357-c331e55ea355', 'volume_size': 1} Sep 03 11:32:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ec9b794a-10e2-4de4-ab76-b5f565cad4f1 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:26 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[c46567d9-6377-4a0d-b778-c77a67638e6e]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-414655ec-bd6e-4c32-8671-19afdb73ef5e tempest-SnapshotDependencyTests-3664945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:26 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9 Sep 03 11:32:26 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:27 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-53263412-f590-4917-8856-dbcb02c28752 tempest-ProjectReaderTests-1112694435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23" returned: 0 in 0.398s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-53263412-f590-4917-8856-dbcb02c28752 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:27 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23 Sep 03 11:32:27 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:27 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-414655ec-bd6e-4c32-8671-19afdb73ef5e tempest-SnapshotDependencyTests-3664945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9" returned: 0 in 0.395s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-414655ec-bd6e-4c32-8671-19afdb73ef5e tempest-SnapshotDependencyTests-3664945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9.859b30d5-2e55-4b4f-b542-4382186537e9 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:27 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9.859b30d5-2e55-4b4f-b542-4382186537e9 1G Sep 03 11:32:27 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:27 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-53263412-f590-4917-8856-dbcb02c28752 tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23" returned: 0 in 0.274s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:27 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-53263412-f590-4917-8856-dbcb02c28752 tempest-ProjectReaderTests-1112694435 None] Lock "cinder-quobyte-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23" released by "delete_volume" :: held 0.783s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:27 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-53263412-f590-4917-8856-dbcb02c28752 tempest-ProjectReaderTests-1112694435 None] Created reservations ['748eeeb1-fc46-43f6-a4cc-8438391c30c2', '4036e34f-2024-4faa-b55e-8169daa947ae', '3e573fc0-8fbd-4e45-bc4a-144a8c44fda3', '75622a9c-687e-464f-9e10-f194d3de8a01'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:32:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-53263412-f590-4917-8856-dbcb02c28752 tempest-ProjectReaderTests-1112694435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-53263412-f590-4917-8856-dbcb02c28752 tempest-ProjectReaderTests-1112694435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-53263412-f590-4917-8856-dbcb02c28752 tempest-ProjectReaderTests-1112694435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:32:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-53263412-f590-4917-8856-dbcb02c28752 tempest-ProjectReaderTests-1112694435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:32:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-53263412-f590-4917-8856-dbcb02c28752 tempest-ProjectReaderTests-1112694435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-53263412-f590-4917-8856-dbcb02c28752 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:27 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:32:27 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:27 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-414655ec-bd6e-4c32-8671-19afdb73ef5e tempest-SnapshotDependencyTests-3664945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9.859b30d5-2e55-4b4f-b542-4382186537e9 1G" returned: 0 in 0.480s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-414655ec-bd6e-4c32-8671-19afdb73ef5e tempest-SnapshotDependencyTests-3664945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9.859b30d5-2e55-4b4f-b542-4382186537e9 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:27 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9.859b30d5-2e55-4b4f-b542-4382186537e9 Sep 03 11:32:27 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:27 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-53263412-f590-4917-8856-dbcb02c28752 tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.300s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:27 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-53263412-f590-4917-8856-dbcb02c28752 tempest-ProjectReaderTests-1112694435 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:32:27 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-53263412-f590-4917-8856-dbcb02c28752 tempest-ProjectReaderTests-1112694435 None] Deleted volume successfully. Sep 03 11:32:27 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-53263412-f590-4917-8856-dbcb02c28752 tempest-ProjectReaderTests-1112694435 None] Lock "cinder-e503ed30-ed4c-4b90-b5fa-8bdd22f0bb23-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:28 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-414655ec-bd6e-4c32-8671-19afdb73ef5e tempest-SnapshotDependencyTests-3664945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9.859b30d5-2e55-4b4f-b542-4382186537e9" returned: 0 in 0.368s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:28 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-414655ec-bd6e-4c32-8671-19afdb73ef5e tempest-SnapshotDependencyTests-3664945 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9.859b30d5-2e55-4b4f-b542-4382186537e9 is being set with open permissions: ugo+rw Sep 03 11:32:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-414655ec-bd6e-4c32-8671-19afdb73ef5e tempest-SnapshotDependencyTests-3664945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9.859b30d5-2e55-4b4f-b542-4382186537e9 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:28 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9.859b30d5-2e55-4b4f-b542-4382186537e9 Sep 03 11:32:28 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:28 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bdaa153-da05-4cac-b8df-e75d72039aea tempest-ProjectReaderTests-1112694435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:32:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6bdaa153-da05-4cac-b8df-e75d72039aea tempest-ProjectReaderTests-1112694435 None] Flow 'volume_create_manager' (4d78f91e-a529-49e9-8933-bf7cd50e4584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:32:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6bdaa153-da05-4cac-b8df-e75d72039aea tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f98b46ad-9f61-4735-a990-94b84d159a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6bdaa153-da05-4cac-b8df-e75d72039aea tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f98b46ad-9f61-4735-a990-94b84d159a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-948666723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0d4d31a-4adf-4b7a-821b-e99096eccced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dcd4de0122b4179a023a1174825fdff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:32:28Z,use_quota=True,user_id='2c8f8d82e5ea4c34a765336d2de00340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6bdaa153-da05-4cac-b8df-e75d72039aea tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ce376d-a282-4d63-9ca6-7e8fc4f7865a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6bdaa153-da05-4cac-b8df-e75d72039aea tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0ce376d-a282-4d63-9ca6-7e8fc4f7865a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6bdaa153-da05-4cac-b8df-e75d72039aea tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2033275-900e-4508-9e60-5068915550b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6bdaa153-da05-4cac-b8df-e75d72039aea tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2033275-900e-4508-9e60-5068915550b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0d4d31a-4adf-4b7a-821b-e99096eccced', 'volume_name': 'volume-c0d4d31a-4adf-4b7a-821b-e99096eccced', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6bdaa153-da05-4cac-b8df-e75d72039aea tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c54fae65-a548-49e9-965c-63d497cbdc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6bdaa153-da05-4cac-b8df-e75d72039aea tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c54fae65-a548-49e9-965c-63d497cbdc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6bdaa153-da05-4cac-b8df-e75d72039aea tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (081f042e-73be-4051-8fe7-7747a3e239a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:28 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-6bdaa153-da05-4cac-b8df-e75d72039aea tempest-ProjectReaderTests-1112694435 None] Volume c0d4d31a-4adf-4b7a-821b-e99096eccced: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0d4d31a-4adf-4b7a-821b-e99096eccced', 'volume_size': 1} Sep 03 11:32:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6bdaa153-da05-4cac-b8df-e75d72039aea tempest-ProjectReaderTests-1112694435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:28 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-414655ec-bd6e-4c32-8671-19afdb73ef5e tempest-SnapshotDependencyTests-3664945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9.859b30d5-2e55-4b4f-b542-4382186537e9" returned: 0 in 0.283s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-414655ec-bd6e-4c32-8671-19afdb73ef5e tempest-SnapshotDependencyTests-3664945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:28 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9.info Sep 03 11:32:28 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:28 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-414655ec-bd6e-4c32-8671-19afdb73ef5e tempest-SnapshotDependencyTests-3664945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9.info" returned: 0 in 0.263s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:28 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-414655ec-bd6e-4c32-8671-19afdb73ef5e tempest-SnapshotDependencyTests-3664945 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9.info is being set with open permissions: ugo+rw Sep 03 11:32:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-414655ec-bd6e-4c32-8671-19afdb73ef5e tempest-SnapshotDependencyTests-3664945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:28 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9.info Sep 03 11:32:28 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ccc07755-3621-4add-aaaf-7c52c0cd114a tempest-ProjectAdminTests-245969032 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.8491134643555, 'free_capacity_gb': 1773.8491134643555, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87038) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 03 11:32:28 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-414655ec-bd6e-4c32-8671-19afdb73ef5e tempest-SnapshotDependencyTests-3664945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9.info" returned: 0 in 0.264s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-414655ec-bd6e-4c32-8671-19afdb73ef5e tempest-SnapshotDependencyTests-3664945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.209s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ec9b794a-10e2-4de4-ab76-b5f565cad4f1 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.115s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:28 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ec9b794a-10e2-4de4-ab76-b5f565cad4f1 tempest-ProjectMemberTests-1830166883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:32:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-226340723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ab4bbd-e13f-4b87-b357-c331e55ea355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e9ee545cbb4eb99d3a310cf4efc844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:32:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:32:27Z,use_quota=True,user_id='badece1d173b4e51add55b4a7c961a4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:32:28 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-ec9b794a-10e2-4de4-ab76-b5f565cad4f1 tempest-ProjectMemberTests-1830166883 None] Creating volume 48ab4bbd-e13f-4b87-b357-c331e55ea355 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:32:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ec9b794a-10e2-4de4-ab76-b5f565cad4f1 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ec9b794a-10e2-4de4-ab76-b5f565cad4f1 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:28 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ec9b794a-10e2-4de4-ab76-b5f565cad4f1 tempest-ProjectMemberTests-1830166883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:32:28 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ec9b794a-10e2-4de4-ab76-b5f565cad4f1 tempest-ProjectMemberTests-1830166883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:32:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ec9b794a-10e2-4de4-ab76-b5f565cad4f1 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:28 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ec9b794a-10e2-4de4-ab76-b5f565cad4f1 tempest-ProjectMemberTests-1830166883 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:32:28 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-ec9b794a-10e2-4de4-ab76-b5f565cad4f1 tempest-ProjectMemberTests-1830166883 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:32:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ec9b794a-10e2-4de4-ab76-b5f565cad4f1 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:28 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355 1073741824 Sep 03 11:32:28 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:28 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-414655ec-bd6e-4c32-8671-19afdb73ef5e tempest-SnapshotDependencyTests-3664945 None] Create snapshot completed successfully Sep 03 11:32:29 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ec9b794a-10e2-4de4-ab76-b5f565cad4f1 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355 1073741824" returned: 0 in 0.446s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ec9b794a-10e2-4de4-ab76-b5f565cad4f1 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:29 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355 Sep 03 11:32:29 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:29 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ec9b794a-10e2-4de4-ab76-b5f565cad4f1 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355" returned: 0 in 0.256s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:29 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ec9b794a-10e2-4de4-ab76-b5f565cad4f1 tempest-ProjectMemberTests-1830166883 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:32:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ec9b794a-10e2-4de4-ab76-b5f565cad4f1 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.747s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6bdaa153-da05-4cac-b8df-e75d72039aea tempest-ProjectReaderTests-1112694435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.407s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:29 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6bdaa153-da05-4cac-b8df-e75d72039aea tempest-ProjectReaderTests-1112694435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:32:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-948666723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0d4d31a-4adf-4b7a-821b-e99096eccced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dcd4de0122b4179a023a1174825fdff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:32:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:32:28Z,use_quota=True,user_id='2c8f8d82e5ea4c34a765336d2de00340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:32:29 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-6bdaa153-da05-4cac-b8df-e75d72039aea tempest-ProjectReaderTests-1112694435 None] Creating volume c0d4d31a-4adf-4b7a-821b-e99096eccced {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:32:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6bdaa153-da05-4cac-b8df-e75d72039aea tempest-ProjectReaderTests-1112694435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6bdaa153-da05-4cac-b8df-e75d72039aea tempest-ProjectReaderTests-1112694435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:29 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6bdaa153-da05-4cac-b8df-e75d72039aea tempest-ProjectReaderTests-1112694435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:32:29 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6bdaa153-da05-4cac-b8df-e75d72039aea tempest-ProjectReaderTests-1112694435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:32:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6bdaa153-da05-4cac-b8df-e75d72039aea tempest-ProjectReaderTests-1112694435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:29 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6bdaa153-da05-4cac-b8df-e75d72039aea tempest-ProjectReaderTests-1112694435 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:32:29 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-6bdaa153-da05-4cac-b8df-e75d72039aea tempest-ProjectReaderTests-1112694435 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:32:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6bdaa153-da05-4cac-b8df-e75d72039aea tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:29 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced 1073741824 Sep 03 11:32:29 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ec9b794a-10e2-4de4-ab76-b5f565cad4f1 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20b65640-3ee1-46cb-ba60-fe84a30ebf0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48ab4bbd-e13f-4b87-b357-c331e55ea355', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ec9b794a-10e2-4de4-ab76-b5f565cad4f1 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee0e3cb-5ab6-4a89-bcb5-bb1c9d3c5248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:29 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-ec9b794a-10e2-4de4-ab76-b5f565cad4f1 tempest-ProjectMemberTests-1830166883 None] Volume volume-48ab4bbd-e13f-4b87-b357-c331e55ea355 (48ab4bbd-e13f-4b87-b357-c331e55ea355): created successfully Sep 03 11:32:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ec9b794a-10e2-4de4-ab76-b5f565cad4f1 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dee0e3cb-5ab6-4a89-bcb5-bb1c9d3c5248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ec9b794a-10e2-4de4-ab76-b5f565cad4f1 tempest-ProjectMemberTests-1830166883 None] Flow 'volume_create_manager' (c36ba697-621c-4df9-9ea1-3837c61da9bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:32:29 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-ec9b794a-10e2-4de4-ab76-b5f565cad4f1 tempest-ProjectMemberTests-1830166883 None] Created volume successfully. Sep 03 11:32:30 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6bdaa153-da05-4cac-b8df-e75d72039aea tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced 1073741824" returned: 0 in 0.609s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6bdaa153-da05-4cac-b8df-e75d72039aea tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:30 devstack sudo[106493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced Sep 03 11:32:30 devstack sudo[106493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Flow 'volume_create_manager' (7336a0e8-88b0-4f85-b5eb-9bbbf98e6eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319b4b21-7eb6-48a9-9d3f-5f524371cb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (319b4b21-7eb6-48a9-9d3f-5f524371cb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:32:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=658be396-d1ae-40ff-bb2e-43881abb6a27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47bb573456d146139915b2b06f88e2ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:32:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=859b30d5-2e55-4b4f-b542-4382186537e9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:32:30Z,use_quota=True,user_id='92a459b3b7134321a8056f701a267cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5bf5dc3-cbce-4a64-88a4-11618d8401e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5bf5dc3-cbce-4a64-88a4-11618d8401e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc9efe7c-7737-4124-8d8e-6fd0c39b4caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc9efe7c-7737-4124-8d8e-6fd0c39b4caa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '658be396-d1ae-40ff-bb2e-43881abb6a27', 'volume_name': 'volume-658be396-d1ae-40ff-bb2e-43881abb6a27', 'volume_size': 1, 'snapshot_id': '859b30d5-2e55-4b4f-b542-4382186537e9'}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7631aaa7-063c-4dee-96c4-d02383a120d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7631aaa7-063c-4dee-96c4-d02383a120d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (192ef9fa-0a2d-4cf4-9420-3c539ec2a9b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:30 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Volume 658be396-d1ae-40ff-bb2e-43881abb6a27: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-658be396-d1ae-40ff-bb2e-43881abb6a27', 'volume_size': 1, 'snapshot_id': '859b30d5-2e55-4b4f-b542-4382186537e9'} Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:30 devstack sudo[106493]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-6bdaa153-da05-4cac-b8df-e75d72039aea tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced" returned: 0 in 0.270s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-6bdaa153-da05-4cac-b8df-e75d72039aea tempest-ProjectReaderTests-1112694435 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-6bdaa153-da05-4cac-b8df-e75d72039aea tempest-ProjectReaderTests-1112694435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.059s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Acquiring lock "cinder-quobyte-859b30d5-2e55-4b4f-b542-4382186537e9-658be396-d1ae-40ff-bb2e-43881abb6a27" by "_create_volume_from_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6bdaa153-da05-4cac-b8df-e75d72039aea tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (081f042e-73be-4051-8fe7-7747a3e239a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0d4d31a-4adf-4b7a-821b-e99096eccced', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6bdaa153-da05-4cac-b8df-e75d72039aea tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1655215-040f-4d27-a928-60a765c66983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Lock "cinder-quobyte-859b30d5-2e55-4b4f-b542-4382186537e9-658be396-d1ae-40ff-bb2e-43881abb6a27" acquired by "_create_volume_from_snapshot" :: waited 0.033s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Creating volume 658be396-d1ae-40ff-bb2e-43881abb6a27 from snapshot 859b30d5-2e55-4b4f-b542-4382186537e9 {{(pid=87038) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Acquiring lock "cinder-quobyte-658be396-d1ae-40ff-bb2e-43881abb6a27" by "_copy_volume_from_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Lock "cinder-quobyte-658be396-d1ae-40ff-bb2e-43881abb6a27" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] snapshot: 859b30d5-2e55-4b4f-b542-4382186537e9, volume: 658be396-d1ae-40ff-bb2e-43881abb6a27, {{(pid=87038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 11:32:30 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-6bdaa153-da05-4cac-b8df-e75d72039aea tempest-ProjectReaderTests-1112694435 None] Volume volume-c0d4d31a-4adf-4b7a-821b-e99096eccced (c0d4d31a-4adf-4b7a-821b-e99096eccced): created successfully Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6bdaa153-da05-4cac-b8df-e75d72039aea tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1655215-040f-4d27-a928-60a765c66983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-6bdaa153-da05-4cac-b8df-e75d72039aea tempest-ProjectReaderTests-1112694435 None] Flow 'volume_create_manager' (4d78f91e-a529-49e9-8933-bf7cd50e4584) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:30 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-6bdaa153-da05-4cac-b8df-e75d72039aea tempest-ProjectReaderTests-1112694435 None] Created volume successfully. Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[238a3cd6-9324-4416-a4b2-1870fc4a8b43]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9.859b30d5-2e55-4b4f-b542-4382186537e9 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:30 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9.859b30d5-2e55-4b4f-b542-4382186537e9 Sep 03 11:32:30 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-eceb6111-6470-4f52-8fc7-bcfada7fe357 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:31 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9.859b30d5-2e55-4b4f-b542-4382186537e9" returned: 0 in 0.407s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:32:31 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad91cca-a711-4b2e-9d83-248775a38227]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:31 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9 Sep 03 11:32:31 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b1717961-c062-40c6-8ca7-5f41c940cc2d tempest-ProjectReaderTests-1112694435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:31 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9" returned: 0 in 0.428s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] will copy from snapshot at /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9 {{(pid=87038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 11:32:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Creating direct copy from snapshot {{(pid=87038) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 11:32:31 devstack cinder-volume[87038]: DEBUG cinder.utils [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Path /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-658be396-d1ae-40ff-bb2e-43881abb6a27 not found in is_blk_device check {{(pid=87038) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 11:32:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-658be396-d1ae-40ff-bb2e-43881abb6a27 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:31 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-658be396-d1ae-40ff-bb2e-43881abb6a27 Sep 03 11:32:31 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:36 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-658be396-d1ae-40ff-bb2e-43881abb6a27" returned: 0 in 4.655s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:36 devstack cinder-volume[87038]: DEBUG cinder.image.image_utils [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Image conversion details: src /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9, size 1024.00 MB, duration 4.66 sec, destination /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-658be396-d1ae-40ff-bb2e-43881abb6a27 {{(pid=87038) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:32:36 devstack cinder-volume[87038]: INFO cinder.image.image_utils [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Converted 1024.00 MB image at 219.93 MB/s Sep 03 11:32:36 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-658be396-d1ae-40ff-bb2e-43881abb6a27 is being set with open permissions: ugo+rw Sep 03 11:32:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-658be396-d1ae-40ff-bb2e-43881abb6a27 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:36 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-658be396-d1ae-40ff-bb2e-43881abb6a27 Sep 03 11:32:36 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:36 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-658be396-d1ae-40ff-bb2e-43881abb6a27" returned: 0 in 0.262s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Lock "cinder-quobyte-658be396-d1ae-40ff-bb2e-43881abb6a27" released by "_copy_volume_from_snapshot" :: held 5.878s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Lock "cinder-quobyte-859b30d5-2e55-4b4f-b542-4382186537e9-658be396-d1ae-40ff-bb2e-43881abb6a27" released by "_create_volume_from_snapshot" :: held 5.955s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.990s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-eceb6111-6470-4f52-8fc7-bcfada7fe357 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.563s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:36 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-eceb6111-6470-4f52-8fc7-bcfada7fe357 tempest-ProjectMemberTests-1830166883 None] Creating offline snapshot ff3a5b77-a481-4ed7-940e-a9442cb13e6f of volume 48ab4bbd-e13f-4b87-b357-c331e55ea355 {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:32:36 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (192ef9fa-0a2d-4cf4-9420-3c539ec2a9b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-658be396-d1ae-40ff-bb2e-43881abb6a27', 'volume_size': 1, 'snapshot_id': '859b30d5-2e55-4b4f-b542-4382186537e9'}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:36 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8fbe529-1079-4714-8352-97f3328b1b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:36 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c7c13a-3324-44d4-82e3-e32800aa2d21]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-eceb6111-6470-4f52-8fc7-bcfada7fe357 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:36 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Volume volume-658be396-d1ae-40ff-bb2e-43881abb6a27 (658be396-d1ae-40ff-bb2e-43881abb6a27): created successfully Sep 03 11:32:36 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8fbe529-1079-4714-8352-97f3328b1b11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:36 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Flow 'volume_create_manager' (7336a0e8-88b0-4f85-b5eb-9bbbf98e6eef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:32:36 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-d13d7b25-4790-482a-8576-0208996e89a4 tempest-SnapshotDependencyTests-3664945 None] Created volume successfully. Sep 03 11:32:36 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355 Sep 03 11:32:36 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:36 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-eceb6111-6470-4f52-8fc7-bcfada7fe357 tempest-ProjectMemberTests-1830166883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355" returned: 0 in 0.360s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-eceb6111-6470-4f52-8fc7-bcfada7fe357 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355.ff3a5b77-a481-4ed7-940e-a9442cb13e6f 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:37 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355.ff3a5b77-a481-4ed7-940e-a9442cb13e6f 1G Sep 03 11:32:37 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:37 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-cd6e913d-e7c2-4a90-b67b-257d5f965b80 tempest-SnapshotDependencyTests-3664945 None] Acquiring lock "cinder-859b30d5-2e55-4b4f-b542-4382186537e9-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:37 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-cd6e913d-e7c2-4a90-b67b-257d5f965b80 tempest-SnapshotDependencyTests-3664945 None] Lock "cinder-859b30d5-2e55-4b4f-b542-4382186537e9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:37 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-cd6e913d-e7c2-4a90-b67b-257d5f965b80 tempest-SnapshotDependencyTests-3664945 None] Acquiring lock "cinder-quobyte-4cfd7cd8-1a14-4a19-a815-f19222c54be9" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:37 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-cd6e913d-e7c2-4a90-b67b-257d5f965b80 tempest-SnapshotDependencyTests-3664945 None] Lock "cinder-quobyte-4cfd7cd8-1a14-4a19-a815-f19222c54be9" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:37 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-cd6e913d-e7c2-4a90-b67b-257d5f965b80 tempest-SnapshotDependencyTests-3664945 None] Acquiring lock "cinder-quobyte-859b30d5-2e55-4b4f-b542-4382186537e9" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:37 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-cd6e913d-e7c2-4a90-b67b-257d5f965b80 tempest-SnapshotDependencyTests-3664945 None] Lock "cinder-quobyte-859b30d5-2e55-4b4f-b542-4382186537e9" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:37 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-cd6e913d-e7c2-4a90-b67b-257d5f965b80 tempest-SnapshotDependencyTests-3664945 None] Deleting offline snapshot 859b30d5-2e55-4b4f-b542-4382186537e9 of volume 4cfd7cd8-1a14-4a19-a815-f19222c54be9 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:32:37 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-cd6e913d-e7c2-4a90-b67b-257d5f965b80 tempest-SnapshotDependencyTests-3664945 None] snapshot_file for this snap is: volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9.859b30d5-2e55-4b4f-b542-4382186537e9 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:32:37 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a91c3b-f3a7-4d83-ba42-26cdd27d32c4]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cd6e913d-e7c2-4a90-b67b-257d5f965b80 tempest-SnapshotDependencyTests-3664945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9.859b30d5-2e55-4b4f-b542-4382186537e9 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:37 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9.859b30d5-2e55-4b4f-b542-4382186537e9 Sep 03 11:32:37 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:37 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-eceb6111-6470-4f52-8fc7-bcfada7fe357 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355.ff3a5b77-a481-4ed7-940e-a9442cb13e6f 1G" returned: 0 in 0.440s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-eceb6111-6470-4f52-8fc7-bcfada7fe357 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48ab4bbd-e13f-4b87-b357-c331e55ea355 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355.ff3a5b77-a481-4ed7-940e-a9442cb13e6f {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:37 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48ab4bbd-e13f-4b87-b357-c331e55ea355 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355.ff3a5b77-a481-4ed7-940e-a9442cb13e6f Sep 03 11:32:37 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:37 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cd6e913d-e7c2-4a90-b67b-257d5f965b80 tempest-SnapshotDependencyTests-3664945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9.859b30d5-2e55-4b4f-b542-4382186537e9" returned: 0 in 0.393s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:37 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-cd6e913d-e7c2-4a90-b67b-257d5f965b80 tempest-SnapshotDependencyTests-3664945 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:32:37 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[d385ec45-008a-4b9f-bc33-173586cfb3ee]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cd6e913d-e7c2-4a90-b67b-257d5f965b80 tempest-SnapshotDependencyTests-3664945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:37 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:37 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9 Sep 03 11:32:37 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-eceb6111-6470-4f52-8fc7-bcfada7fe357 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48ab4bbd-e13f-4b87-b357-c331e55ea355 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355.ff3a5b77-a481-4ed7-940e-a9442cb13e6f" returned: 0 in 0.346s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:37 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-eceb6111-6470-4f52-8fc7-bcfada7fe357 tempest-ProjectMemberTests-1830166883 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355.ff3a5b77-a481-4ed7-940e-a9442cb13e6f is being set with open permissions: ugo+rw Sep 03 11:32:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-eceb6111-6470-4f52-8fc7-bcfada7fe357 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355.ff3a5b77-a481-4ed7-940e-a9442cb13e6f {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:37 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355.ff3a5b77-a481-4ed7-940e-a9442cb13e6f Sep 03 11:32:37 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:38 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-eceb6111-6470-4f52-8fc7-bcfada7fe357 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355.ff3a5b77-a481-4ed7-940e-a9442cb13e6f" returned: 0 in 0.244s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-eceb6111-6470-4f52-8fc7-bcfada7fe357 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:38 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355.info Sep 03 11:32:38 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:38 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cd6e913d-e7c2-4a90-b67b-257d5f965b80 tempest-SnapshotDependencyTests-3664945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9" returned: 0 in 0.584s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cd6e913d-e7c2-4a90-b67b-257d5f965b80 tempest-SnapshotDependencyTests-3664945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9.859b30d5-2e55-4b4f-b542-4382186537e9 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:38 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9.859b30d5-2e55-4b4f-b542-4382186537e9 Sep 03 11:32:38 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:38 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-eceb6111-6470-4f52-8fc7-bcfada7fe357 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355.info" returned: 0 in 0.269s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:38 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-eceb6111-6470-4f52-8fc7-bcfada7fe357 tempest-ProjectMemberTests-1830166883 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355.info is being set with open permissions: ugo+rw Sep 03 11:32:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-eceb6111-6470-4f52-8fc7-bcfada7fe357 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:38 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355.info Sep 03 11:32:38 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:38 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cd6e913d-e7c2-4a90-b67b-257d5f965b80 tempest-SnapshotDependencyTests-3664945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9.859b30d5-2e55-4b4f-b542-4382186537e9" returned: 0 in 0.385s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cd6e913d-e7c2-4a90-b67b-257d5f965b80 tempest-SnapshotDependencyTests-3664945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9.859b30d5-2e55-4b4f-b542-4382186537e9 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:38 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-eceb6111-6470-4f52-8fc7-bcfada7fe357 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355.info" returned: 0 in 0.298s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:38 devstack sudo[106572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9.859b30d5-2e55-4b4f-b542-4382186537e9 Sep 03 11:32:38 devstack sudo[106572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-eceb6111-6470-4f52-8fc7-bcfada7fe357 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.065s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b1717961-c062-40c6-8ca7-5f41c940cc2d tempest-ProjectReaderTests-1112694435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.060s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:38 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-b1717961-c062-40c6-8ca7-5f41c940cc2d tempest-ProjectReaderTests-1112694435 None] Creating offline snapshot 444e9201-2ba6-475f-b502-07500956fcb8 of volume c0d4d31a-4adf-4b7a-821b-e99096eccced {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:32:38 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-eceb6111-6470-4f52-8fc7-bcfada7fe357 tempest-ProjectMemberTests-1830166883 None] Create snapshot completed successfully Sep 03 11:32:38 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90002d8-7969-4afa-838f-e8821dac55ae]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b1717961-c062-40c6-8ca7-5f41c940cc2d tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:38 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced Sep 03 11:32:38 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:38 devstack sudo[106572]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:38 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-cd6e913d-e7c2-4a90-b67b-257d5f965b80 tempest-SnapshotDependencyTests-3664945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9.859b30d5-2e55-4b4f-b542-4382186537e9" returned: 0 in 0.301s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:38 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-cd6e913d-e7c2-4a90-b67b-257d5f965b80 tempest-SnapshotDependencyTests-3664945 None] Lock "cinder-quobyte-859b30d5-2e55-4b4f-b542-4382186537e9" released by "_delete_snapshot" :: held 1.771s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:38 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-cd6e913d-e7c2-4a90-b67b-257d5f965b80 tempest-SnapshotDependencyTests-3664945 None] Lock "cinder-quobyte-4cfd7cd8-1a14-4a19-a815-f19222c54be9" released by "delete_snapshot" :: held 1.796s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:39 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-cd6e913d-e7c2-4a90-b67b-257d5f965b80 tempest-SnapshotDependencyTests-3664945 None] Created reservations ['0ee1451d-510b-4c72-94cd-ca80f7bcff7b', '834328ea-f4e4-4112-b93c-c9e12628cd54', '0dde0c94-a770-4dfa-b71a-f564229708fa', '3f7201a4-5684-4ca6-83df-687ba99e49fc'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:32:39 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-cd6e913d-e7c2-4a90-b67b-257d5f965b80 tempest-SnapshotDependencyTests-3664945 None] Delete snapshot completed successfully. Sep 03 11:32:39 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-cd6e913d-e7c2-4a90-b67b-257d5f965b80 tempest-SnapshotDependencyTests-3664945 None] Lock "cinder-859b30d5-2e55-4b4f-b542-4382186537e9-delete_snapshot" released by "delete_snapshot" :: held 1.947s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:39 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b1717961-c062-40c6-8ca7-5f41c940cc2d tempest-ProjectReaderTests-1112694435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced" returned: 0 in 0.430s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b1717961-c062-40c6-8ca7-5f41c940cc2d tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced.444e9201-2ba6-475f-b502-07500956fcb8 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:39 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced.444e9201-2ba6-475f-b502-07500956fcb8 1G Sep 03 11:32:39 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:39 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d096bac0-0c05-4f15-bf87-3bf47ab2b162 tempest-SnapshotDependencyTests-3664945 None] Acquiring lock "cinder-4cfd7cd8-1a14-4a19-a815-f19222c54be9-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:39 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d096bac0-0c05-4f15-bf87-3bf47ab2b162 tempest-SnapshotDependencyTests-3664945 None] Lock "cinder-4cfd7cd8-1a14-4a19-a815-f19222c54be9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:39 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d096bac0-0c05-4f15-bf87-3bf47ab2b162 tempest-SnapshotDependencyTests-3664945 None] Acquiring lock "cinder-quobyte-4cfd7cd8-1a14-4a19-a815-f19222c54be9" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:39 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d096bac0-0c05-4f15-bf87-3bf47ab2b162 tempest-SnapshotDependencyTests-3664945 None] Lock "cinder-quobyte-4cfd7cd8-1a14-4a19-a815-f19222c54be9" acquired by "delete_volume" :: waited 0.022s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:39 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[49403241-aae5-469e-878c-2af49e8f18f5]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d096bac0-0c05-4f15-bf87-3bf47ab2b162 tempest-SnapshotDependencyTests-3664945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:39 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a38f6ea2-4921-4511-81e1-432078e76645 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-ff3a5b77-a481-4ed7-940e-a9442cb13e6f-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:39 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a38f6ea2-4921-4511-81e1-432078e76645 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-ff3a5b77-a481-4ed7-940e-a9442cb13e6f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:39 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a38f6ea2-4921-4511-81e1-432078e76645 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-quobyte-48ab4bbd-e13f-4b87-b357-c331e55ea355" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:39 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a38f6ea2-4921-4511-81e1-432078e76645 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-48ab4bbd-e13f-4b87-b357-c331e55ea355" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:39 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a38f6ea2-4921-4511-81e1-432078e76645 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-quobyte-ff3a5b77-a481-4ed7-940e-a9442cb13e6f" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:39 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a38f6ea2-4921-4511-81e1-432078e76645 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-ff3a5b77-a481-4ed7-940e-a9442cb13e6f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-a38f6ea2-4921-4511-81e1-432078e76645 tempest-ProjectMemberTests-1830166883 None] Deleting offline snapshot ff3a5b77-a481-4ed7-940e-a9442cb13e6f of volume 48ab4bbd-e13f-4b87-b357-c331e55ea355 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:32:39 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-a38f6ea2-4921-4511-81e1-432078e76645 tempest-ProjectMemberTests-1830166883 None] snapshot_file for this snap is: volume-48ab4bbd-e13f-4b87-b357-c331e55ea355.ff3a5b77-a481-4ed7-940e-a9442cb13e6f {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:32:39 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9 Sep 03 11:32:39 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:39 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae91436-c497-40fc-93fe-ca8d95f81616]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a38f6ea2-4921-4511-81e1-432078e76645 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355.ff3a5b77-a481-4ed7-940e-a9442cb13e6f {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:39 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b1717961-c062-40c6-8ca7-5f41c940cc2d tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced.444e9201-2ba6-475f-b502-07500956fcb8 1G" returned: 0 in 0.536s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b1717961-c062-40c6-8ca7-5f41c940cc2d tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0d4d31a-4adf-4b7a-821b-e99096eccced -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced.444e9201-2ba6-475f-b502-07500956fcb8 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:39 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0d4d31a-4adf-4b7a-821b-e99096eccced -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced.444e9201-2ba6-475f-b502-07500956fcb8 Sep 03 11:32:39 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:39 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355.ff3a5b77-a481-4ed7-940e-a9442cb13e6f Sep 03 11:32:39 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:39 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d096bac0-0c05-4f15-bf87-3bf47ab2b162 tempest-SnapshotDependencyTests-3664945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9" returned: 0 in 0.422s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:39 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d096bac0-0c05-4f15-bf87-3bf47ab2b162 tempest-SnapshotDependencyTests-3664945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:39 devstack sudo[106597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9 Sep 03 11:32:39 devstack sudo[106597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:40 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b1717961-c062-40c6-8ca7-5f41c940cc2d tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0d4d31a-4adf-4b7a-821b-e99096eccced -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced.444e9201-2ba6-475f-b502-07500956fcb8" returned: 0 in 0.339s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:40 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-b1717961-c062-40c6-8ca7-5f41c940cc2d tempest-ProjectReaderTests-1112694435 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced.444e9201-2ba6-475f-b502-07500956fcb8 is being set with open permissions: ugo+rw Sep 03 11:32:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b1717961-c062-40c6-8ca7-5f41c940cc2d tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced.444e9201-2ba6-475f-b502-07500956fcb8 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:40 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a38f6ea2-4921-4511-81e1-432078e76645 tempest-ProjectMemberTests-1830166883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355.ff3a5b77-a481-4ed7-940e-a9442cb13e6f" returned: 0 in 0.413s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:40 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-a38f6ea2-4921-4511-81e1-432078e76645 tempest-ProjectMemberTests-1830166883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48ab4bbd-e13f-4b87-b357-c331e55ea355(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:32:40 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced.444e9201-2ba6-475f-b502-07500956fcb8 Sep 03 11:32:40 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:40 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2cd95a-36dc-42bb-990c-3bb6a6c0b76c]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a38f6ea2-4921-4511-81e1-432078e76645 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:40 devstack sudo[106597]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d096bac0-0c05-4f15-bf87-3bf47ab2b162 tempest-SnapshotDependencyTests-3664945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-4cfd7cd8-1a14-4a19-a815-f19222c54be9" returned: 0 in 0.269s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:40 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d096bac0-0c05-4f15-bf87-3bf47ab2b162 tempest-SnapshotDependencyTests-3664945 None] Lock "cinder-quobyte-4cfd7cd8-1a14-4a19-a815-f19222c54be9" released by "delete_volume" :: held 0.756s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:40 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355 Sep 03 11:32:40 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:40 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-d096bac0-0c05-4f15-bf87-3bf47ab2b162 tempest-SnapshotDependencyTests-3664945 None] Created reservations ['5c3d9652-7310-4588-afa2-f31dc2e95eb6', 'ff6b2aea-f329-41b7-b529-3059571b2373', '8c980564-a414-483d-a7f7-abd0114e0380', '30f2a8d2-d377-4c08-91ed-02c76ad9ad6d'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:32:40 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b1717961-c062-40c6-8ca7-5f41c940cc2d tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced.444e9201-2ba6-475f-b502-07500956fcb8" returned: 0 in 0.275s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d096bac0-0c05-4f15-bf87-3bf47ab2b162 tempest-SnapshotDependencyTests-3664945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d096bac0-0c05-4f15-bf87-3bf47ab2b162 tempest-SnapshotDependencyTests-3664945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:40 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d096bac0-0c05-4f15-bf87-3bf47ab2b162 tempest-SnapshotDependencyTests-3664945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:32:40 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d096bac0-0c05-4f15-bf87-3bf47ab2b162 tempest-SnapshotDependencyTests-3664945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:32:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d096bac0-0c05-4f15-bf87-3bf47ab2b162 tempest-SnapshotDependencyTests-3664945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d096bac0-0c05-4f15-bf87-3bf47ab2b162 tempest-SnapshotDependencyTests-3664945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b1717961-c062-40c6-8ca7-5f41c940cc2d tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:40 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:32:40 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:40 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced.info Sep 03 11:32:40 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:40 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a38f6ea2-4921-4511-81e1-432078e76645 tempest-ProjectMemberTests-1830166883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355" returned: 0 in 0.407s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a38f6ea2-4921-4511-81e1-432078e76645 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355.ff3a5b77-a481-4ed7-940e-a9442cb13e6f {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:40 devstack sudo[106617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355.ff3a5b77-a481-4ed7-940e-a9442cb13e6f Sep 03 11:32:40 devstack sudo[106617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:40 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d4f91710-1156-4598-93ce-6fe5d893ab3b tempest-SnapshotDependencyTests-3664945 None] Acquiring lock "cinder-658be396-d1ae-40ff-bb2e-43881abb6a27-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:40 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d4f91710-1156-4598-93ce-6fe5d893ab3b tempest-SnapshotDependencyTests-3664945 None] Lock "cinder-658be396-d1ae-40ff-bb2e-43881abb6a27-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:40 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d4f91710-1156-4598-93ce-6fe5d893ab3b tempest-SnapshotDependencyTests-3664945 None] Acquiring lock "cinder-quobyte-658be396-d1ae-40ff-bb2e-43881abb6a27" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:40 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:40 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d4f91710-1156-4598-93ce-6fe5d893ab3b tempest-SnapshotDependencyTests-3664945 None] Lock "cinder-quobyte-658be396-d1ae-40ff-bb2e-43881abb6a27" acquired by "delete_volume" :: waited 0.022s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d096bac0-0c05-4f15-bf87-3bf47ab2b162 tempest-SnapshotDependencyTests-3664945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.337s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:40 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-d096bac0-0c05-4f15-bf87-3bf47ab2b162 tempest-SnapshotDependencyTests-3664945 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:32:40 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:40 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-d096bac0-0c05-4f15-bf87-3bf47ab2b162 tempest-SnapshotDependencyTests-3664945 None] Deleted volume successfully. Sep 03 11:32:40 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[274655e6-5bc3-4088-aec1-77bcd6ddcd6d]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d4f91710-1156-4598-93ce-6fe5d893ab3b tempest-SnapshotDependencyTests-3664945 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-658be396-d1ae-40ff-bb2e-43881abb6a27 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b1717961-c062-40c6-8ca7-5f41c940cc2d tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced.info" returned: 0 in 0.348s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:40 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-b1717961-c062-40c6-8ca7-5f41c940cc2d tempest-ProjectReaderTests-1112694435 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced.info is being set with open permissions: ugo+rw Sep 03 11:32:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b1717961-c062-40c6-8ca7-5f41c940cc2d tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:40 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d096bac0-0c05-4f15-bf87-3bf47ab2b162 tempest-SnapshotDependencyTests-3664945 None] Lock "cinder-4cfd7cd8-1a14-4a19-a815-f19222c54be9-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:40 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced.info Sep 03 11:32:40 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:40 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-658be396-d1ae-40ff-bb2e-43881abb6a27 Sep 03 11:32:40 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:40 devstack sudo[106617]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a38f6ea2-4921-4511-81e1-432078e76645 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355.ff3a5b77-a481-4ed7-940e-a9442cb13e6f" returned: 0 in 0.412s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a38f6ea2-4921-4511-81e1-432078e76645 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355.ff3a5b77-a481-4ed7-940e-a9442cb13e6f {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:40 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355.ff3a5b77-a481-4ed7-940e-a9442cb13e6f Sep 03 11:32:40 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:40 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:40 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b1717961-c062-40c6-8ca7-5f41c940cc2d tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced.info" returned: 0 in 0.275s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b1717961-c062-40c6-8ca7-5f41c940cc2d tempest-ProjectReaderTests-1112694435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.336s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:41 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-b1717961-c062-40c6-8ca7-5f41c940cc2d tempest-ProjectReaderTests-1112694435 None] Create snapshot completed successfully Sep 03 11:32:41 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d4f91710-1156-4598-93ce-6fe5d893ab3b tempest-SnapshotDependencyTests-3664945 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-658be396-d1ae-40ff-bb2e-43881abb6a27" returned: 0 in 0.389s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d4f91710-1156-4598-93ce-6fe5d893ab3b tempest-SnapshotDependencyTests-3664945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-658be396-d1ae-40ff-bb2e-43881abb6a27 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:41 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-658be396-d1ae-40ff-bb2e-43881abb6a27 Sep 03 11:32:41 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:41 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a38f6ea2-4921-4511-81e1-432078e76645 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355.ff3a5b77-a481-4ed7-940e-a9442cb13e6f" returned: 0 in 0.274s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a38f6ea2-4921-4511-81e1-432078e76645 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-ff3a5b77-a481-4ed7-940e-a9442cb13e6f" released by "_delete_snapshot" :: held 1.634s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a38f6ea2-4921-4511-81e1-432078e76645 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-48ab4bbd-e13f-4b87-b357-c331e55ea355" released by "delete_snapshot" :: held 1.663s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4d87d4ed-04fd-4d21-8bc1-d9fc600527d5 tempest-ProjectReaderTests-1112694435 None] Acquiring lock "cinder-444e9201-2ba6-475f-b502-07500956fcb8-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4d87d4ed-04fd-4d21-8bc1-d9fc600527d5 tempest-ProjectReaderTests-1112694435 None] Lock "cinder-444e9201-2ba6-475f-b502-07500956fcb8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4d87d4ed-04fd-4d21-8bc1-d9fc600527d5 tempest-ProjectReaderTests-1112694435 None] Acquiring lock "cinder-quobyte-c0d4d31a-4adf-4b7a-821b-e99096eccced" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:41 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-a38f6ea2-4921-4511-81e1-432078e76645 tempest-ProjectMemberTests-1830166883 None] Created reservations ['894af9b7-9825-4e85-8ca8-d9f5277e69ef', 'd8aef53a-d8ed-41c4-8857-7a011fc9a9a0', '6a33d857-517f-41b2-86ff-ddac3fa69880', '62692fc6-aab1-4683-9ae7-f8ea89e96b38'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d4f91710-1156-4598-93ce-6fe5d893ab3b tempest-SnapshotDependencyTests-3664945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-658be396-d1ae-40ff-bb2e-43881abb6a27" returned: 0 in 0.263s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4d87d4ed-04fd-4d21-8bc1-d9fc600527d5 tempest-ProjectReaderTests-1112694435 None] Lock "cinder-quobyte-c0d4d31a-4adf-4b7a-821b-e99096eccced" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4d87d4ed-04fd-4d21-8bc1-d9fc600527d5 tempest-ProjectReaderTests-1112694435 None] Acquiring lock "cinder-quobyte-444e9201-2ba6-475f-b502-07500956fcb8" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d4f91710-1156-4598-93ce-6fe5d893ab3b tempest-SnapshotDependencyTests-3664945 None] Lock "cinder-quobyte-658be396-d1ae-40ff-bb2e-43881abb6a27" released by "delete_volume" :: held 0.702s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4d87d4ed-04fd-4d21-8bc1-d9fc600527d5 tempest-ProjectReaderTests-1112694435 None] Lock "cinder-quobyte-444e9201-2ba6-475f-b502-07500956fcb8" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-4d87d4ed-04fd-4d21-8bc1-d9fc600527d5 tempest-ProjectReaderTests-1112694435 None] Deleting offline snapshot 444e9201-2ba6-475f-b502-07500956fcb8 of volume c0d4d31a-4adf-4b7a-821b-e99096eccced {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-4d87d4ed-04fd-4d21-8bc1-d9fc600527d5 tempest-ProjectReaderTests-1112694435 None] snapshot_file for this snap is: volume-c0d4d31a-4adf-4b7a-821b-e99096eccced.444e9201-2ba6-475f-b502-07500956fcb8 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ea5f35-fae4-4c14-884c-f9df29aa2e86]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4d87d4ed-04fd-4d21-8bc1-d9fc600527d5 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced.444e9201-2ba6-475f-b502-07500956fcb8 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:41 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-a38f6ea2-4921-4511-81e1-432078e76645 tempest-ProjectMemberTests-1830166883 None] Delete snapshot completed successfully. Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a38f6ea2-4921-4511-81e1-432078e76645 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-ff3a5b77-a481-4ed7-940e-a9442cb13e6f-delete_snapshot" released by "delete_snapshot" :: held 1.915s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-d4f91710-1156-4598-93ce-6fe5d893ab3b tempest-SnapshotDependencyTests-3664945 None] Created reservations ['41d119fa-aab0-47a2-844e-f9a0046c2397', '716dec43-01cf-4762-9b51-8f37a63d6520', '861f7d63-c291-4bf1-af98-0389f6e2a61d', '913520d4-4262-4b16-9883-4c7c3929fce9'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:32:41 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced.444e9201-2ba6-475f-b502-07500956fcb8 Sep 03 11:32:41 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d4f91710-1156-4598-93ce-6fe5d893ab3b tempest-SnapshotDependencyTests-3664945 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d4f91710-1156-4598-93ce-6fe5d893ab3b tempest-SnapshotDependencyTests-3664945 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d4f91710-1156-4598-93ce-6fe5d893ab3b tempest-SnapshotDependencyTests-3664945 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d4f91710-1156-4598-93ce-6fe5d893ab3b tempest-SnapshotDependencyTests-3664945 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d4f91710-1156-4598-93ce-6fe5d893ab3b tempest-SnapshotDependencyTests-3664945 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d4f91710-1156-4598-93ce-6fe5d893ab3b tempest-SnapshotDependencyTests-3664945 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:41 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:32:41 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-70b41be2-8728-480d-a4b2-eaacf680108a tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-48ab4bbd-e13f-4b87-b357-c331e55ea355-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:41 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d4f91710-1156-4598-93ce-6fe5d893ab3b tempest-SnapshotDependencyTests-3664945 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.269s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-d4f91710-1156-4598-93ce-6fe5d893ab3b tempest-SnapshotDependencyTests-3664945 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-70b41be2-8728-480d-a4b2-eaacf680108a tempest-ProjectMemberTests-1830166883 None] Lock "cinder-48ab4bbd-e13f-4b87-b357-c331e55ea355-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:41 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-d4f91710-1156-4598-93ce-6fe5d893ab3b tempest-SnapshotDependencyTests-3664945 None] Deleted volume successfully. Sep 03 11:32:41 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4d87d4ed-04fd-4d21-8bc1-d9fc600527d5 tempest-ProjectReaderTests-1112694435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced.444e9201-2ba6-475f-b502-07500956fcb8" returned: 0 in 0.431s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-4d87d4ed-04fd-4d21-8bc1-d9fc600527d5 tempest-ProjectReaderTests-1112694435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0d4d31a-4adf-4b7a-821b-e99096eccced(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[eff606ac-ef12-4655-bd16-4d65047d004d]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d4f91710-1156-4598-93ce-6fe5d893ab3b tempest-SnapshotDependencyTests-3664945 None] Lock "cinder-658be396-d1ae-40ff-bb2e-43881abb6a27-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4d87d4ed-04fd-4d21-8bc1-d9fc600527d5 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-70b41be2-8728-480d-a4b2-eaacf680108a tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-quobyte-48ab4bbd-e13f-4b87-b357-c331e55ea355" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-70b41be2-8728-480d-a4b2-eaacf680108a tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-48ab4bbd-e13f-4b87-b357-c331e55ea355" acquired by "delete_volume" :: waited 0.019s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e8464eb-3f08-438d-a31f-771e4996e5db]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:41 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-70b41be2-8728-480d-a4b2-eaacf680108a tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:42 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced Sep 03 11:32:42 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:42 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355 Sep 03 11:32:42 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:42 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4d87d4ed-04fd-4d21-8bc1-d9fc600527d5 tempest-ProjectReaderTests-1112694435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced" returned: 0 in 0.393s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4d87d4ed-04fd-4d21-8bc1-d9fc600527d5 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced.444e9201-2ba6-475f-b502-07500956fcb8 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:42 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced.444e9201-2ba6-475f-b502-07500956fcb8 Sep 03 11:32:42 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:42 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-70b41be2-8728-480d-a4b2-eaacf680108a tempest-ProjectMemberTests-1830166883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355" returned: 0 in 0.402s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-70b41be2-8728-480d-a4b2-eaacf680108a tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:42 devstack sudo[106660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355 Sep 03 11:32:42 devstack sudo[106660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:42 devstack sudo[106660]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-70b41be2-8728-480d-a4b2-eaacf680108a tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-48ab4bbd-e13f-4b87-b357-c331e55ea355" returned: 0 in 0.299s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:42 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-70b41be2-8728-480d-a4b2-eaacf680108a tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-48ab4bbd-e13f-4b87-b357-c331e55ea355" released by "delete_volume" :: held 0.768s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:42 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4d87d4ed-04fd-4d21-8bc1-d9fc600527d5 tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced.444e9201-2ba6-475f-b502-07500956fcb8" returned: 0 in 0.431s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4d87d4ed-04fd-4d21-8bc1-d9fc600527d5 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced.444e9201-2ba6-475f-b502-07500956fcb8 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:42 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced.444e9201-2ba6-475f-b502-07500956fcb8 Sep 03 11:32:42 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:42 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-70b41be2-8728-480d-a4b2-eaacf680108a tempest-ProjectMemberTests-1830166883 None] Created reservations ['bcab2431-943a-4928-9c64-5b777c1d60ba', 'acb54bfc-cee3-4f6d-8f58-2ef3e11256f2', '0421c9a1-4a34-40cb-b28d-c2658d7bc506', '1316bec1-9167-4b4b-be95-e8b4cb4dff11'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:32:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-70b41be2-8728-480d-a4b2-eaacf680108a tempest-ProjectMemberTests-1830166883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-70b41be2-8728-480d-a4b2-eaacf680108a tempest-ProjectMemberTests-1830166883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:42 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-70b41be2-8728-480d-a4b2-eaacf680108a tempest-ProjectMemberTests-1830166883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:32:42 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-70b41be2-8728-480d-a4b2-eaacf680108a tempest-ProjectMemberTests-1830166883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:32:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-70b41be2-8728-480d-a4b2-eaacf680108a tempest-ProjectMemberTests-1830166883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:42 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-70b41be2-8728-480d-a4b2-eaacf680108a tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:42 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:32:42 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:43 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4d87d4ed-04fd-4d21-8bc1-d9fc600527d5 tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced.444e9201-2ba6-475f-b502-07500956fcb8" returned: 0 in 0.300s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:43 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4d87d4ed-04fd-4d21-8bc1-d9fc600527d5 tempest-ProjectReaderTests-1112694435 None] Lock "cinder-quobyte-444e9201-2ba6-475f-b502-07500956fcb8" released by "_delete_snapshot" :: held 1.683s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:43 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4d87d4ed-04fd-4d21-8bc1-d9fc600527d5 tempest-ProjectReaderTests-1112694435 None] Lock "cinder-quobyte-c0d4d31a-4adf-4b7a-821b-e99096eccced" released by "delete_snapshot" :: held 1.721s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:43 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-70b41be2-8728-480d-a4b2-eaacf680108a tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.270s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:43 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-70b41be2-8728-480d-a4b2-eaacf680108a tempest-ProjectMemberTests-1830166883 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:32:43 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-70b41be2-8728-480d-a4b2-eaacf680108a tempest-ProjectMemberTests-1830166883 None] Deleted volume successfully. Sep 03 11:32:43 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-70b41be2-8728-480d-a4b2-eaacf680108a tempest-ProjectMemberTests-1830166883 None] Lock "cinder-48ab4bbd-e13f-4b87-b357-c331e55ea355-delete_volume" released by "delete_volume" :: held 1.338s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:43 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-4d87d4ed-04fd-4d21-8bc1-d9fc600527d5 tempest-ProjectReaderTests-1112694435 None] Created reservations ['36a5dfad-800c-4d9a-a618-85f94318078f', '8d56fe6a-75de-4dc9-a170-cfc61ad53664', 'd637441d-d2b1-4e1f-8e86-ab67cf5c08b7', 'b48e0f53-ff85-4244-85bb-16a389e0f701'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:32:43 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-4d87d4ed-04fd-4d21-8bc1-d9fc600527d5 tempest-ProjectReaderTests-1112694435 None] Delete snapshot completed successfully. Sep 03 11:32:43 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-4d87d4ed-04fd-4d21-8bc1-d9fc600527d5 tempest-ProjectReaderTests-1112694435 None] Lock "cinder-444e9201-2ba6-475f-b502-07500956fcb8-delete_snapshot" released by "delete_snapshot" :: held 1.920s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:43 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-83bef69a-6f82-481a-a9a3-144802ccee0e tempest-ProjectReaderTests-1112694435 None] Acquiring lock "cinder-c0d4d31a-4adf-4b7a-821b-e99096eccced-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:43 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-83bef69a-6f82-481a-a9a3-144802ccee0e tempest-ProjectReaderTests-1112694435 None] Lock "cinder-c0d4d31a-4adf-4b7a-821b-e99096eccced-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:43 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-83bef69a-6f82-481a-a9a3-144802ccee0e tempest-ProjectReaderTests-1112694435 None] Acquiring lock "cinder-quobyte-c0d4d31a-4adf-4b7a-821b-e99096eccced" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:43 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-83bef69a-6f82-481a-a9a3-144802ccee0e tempest-ProjectReaderTests-1112694435 None] Lock "cinder-quobyte-c0d4d31a-4adf-4b7a-821b-e99096eccced" acquired by "delete_volume" :: waited 0.019s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:43 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8b297d-986c-471f-9148-e29f28b16ba9]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-83bef69a-6f82-481a-a9a3-144802ccee0e tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:43 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e63063e-4b03-49b0-a9cf-c8da97b718da tempest-ProjectMemberTests-1830166883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:32:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1e63063e-4b03-49b0-a9cf-c8da97b718da tempest-ProjectMemberTests-1830166883 None] Flow 'volume_create_manager' (93fc047f-b019-4a33-9e59-11e958908e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:32:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1e63063e-4b03-49b0-a9cf-c8da97b718da tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d18e580c-d671-4f2b-b499-0c9b2b2850c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1e63063e-4b03-49b0-a9cf-c8da97b718da tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d18e580c-d671-4f2b-b499-0c9b2b2850c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1582337724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf989b56-e684-4c93-ba26-7677ccea320e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e9ee545cbb4eb99d3a310cf4efc844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:32:44Z,use_quota=True,user_id='badece1d173b4e51add55b4a7c961a4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1e63063e-4b03-49b0-a9cf-c8da97b718da tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f1fd4c8-d502-45db-bb1a-acaa6e33d1da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1e63063e-4b03-49b0-a9cf-c8da97b718da tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f1fd4c8-d502-45db-bb1a-acaa6e33d1da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1e63063e-4b03-49b0-a9cf-c8da97b718da tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12643132-0b72-4d2b-a6bf-3b4d6829535d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1e63063e-4b03-49b0-a9cf-c8da97b718da tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12643132-0b72-4d2b-a6bf-3b4d6829535d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf989b56-e684-4c93-ba26-7677ccea320e', 'volume_name': 'volume-cf989b56-e684-4c93-ba26-7677ccea320e', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1e63063e-4b03-49b0-a9cf-c8da97b718da tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e371b36-6912-425e-8294-40181b36d287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1e63063e-4b03-49b0-a9cf-c8da97b718da tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e371b36-6912-425e-8294-40181b36d287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:43 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced Sep 03 11:32:43 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1e63063e-4b03-49b0-a9cf-c8da97b718da tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fefa7c20-2b2d-43ee-a968-fdaca5f65596) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:43 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:43 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-1e63063e-4b03-49b0-a9cf-c8da97b718da tempest-ProjectMemberTests-1830166883 None] Volume cf989b56-e684-4c93-ba26-7677ccea320e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf989b56-e684-4c93-ba26-7677ccea320e', 'volume_size': 1} Sep 03 11:32:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1e63063e-4b03-49b0-a9cf-c8da97b718da tempest-ProjectMemberTests-1830166883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1e63063e-4b03-49b0-a9cf-c8da97b718da tempest-ProjectMemberTests-1830166883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1e63063e-4b03-49b0-a9cf-c8da97b718da tempest-ProjectMemberTests-1830166883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:32:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1582337724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf989b56-e684-4c93-ba26-7677ccea320e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e9ee545cbb4eb99d3a310cf4efc844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:32:44Z,use_quota=True,user_id='badece1d173b4e51add55b4a7c961a4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:32:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-1e63063e-4b03-49b0-a9cf-c8da97b718da tempest-ProjectMemberTests-1830166883 None] Creating volume cf989b56-e684-4c93-ba26-7677ccea320e {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:32:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1e63063e-4b03-49b0-a9cf-c8da97b718da tempest-ProjectMemberTests-1830166883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1e63063e-4b03-49b0-a9cf-c8da97b718da tempest-ProjectMemberTests-1830166883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1e63063e-4b03-49b0-a9cf-c8da97b718da tempest-ProjectMemberTests-1830166883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:32:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1e63063e-4b03-49b0-a9cf-c8da97b718da tempest-ProjectMemberTests-1830166883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:32:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1e63063e-4b03-49b0-a9cf-c8da97b718da tempest-ProjectMemberTests-1830166883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:43 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1e63063e-4b03-49b0-a9cf-c8da97b718da tempest-ProjectMemberTests-1830166883 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:32:43 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-1e63063e-4b03-49b0-a9cf-c8da97b718da tempest-ProjectMemberTests-1830166883 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:32:43 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1e63063e-4b03-49b0-a9cf-c8da97b718da tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:43 devstack sudo[106675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e 1073741824 Sep 03 11:32:43 devstack sudo[106675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:44 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-83bef69a-6f82-481a-a9a3-144802ccee0e tempest-ProjectReaderTests-1112694435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced" returned: 0 in 0.390s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-83bef69a-6f82-481a-a9a3-144802ccee0e tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:44 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced Sep 03 11:32:44 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:44 devstack sudo[106675]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1e63063e-4b03-49b0-a9cf-c8da97b718da tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e 1073741824" returned: 0 in 0.443s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1e63063e-4b03-49b0-a9cf-c8da97b718da tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:44 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e Sep 03 11:32:44 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:44 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-83bef69a-6f82-481a-a9a3-144802ccee0e tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c0d4d31a-4adf-4b7a-821b-e99096eccced" returned: 0 in 0.302s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:44 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-83bef69a-6f82-481a-a9a3-144802ccee0e tempest-ProjectReaderTests-1112694435 None] Lock "cinder-quobyte-c0d4d31a-4adf-4b7a-821b-e99096eccced" released by "delete_volume" :: held 0.771s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:44 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-83bef69a-6f82-481a-a9a3-144802ccee0e tempest-ProjectReaderTests-1112694435 None] Created reservations ['a92faacb-4a00-4db8-a4dc-d26cdcaa32bc', 'be596f45-123d-4e3b-9501-b6a644076c9b', '2452ac9a-c327-47db-9cd0-c2ea586684e9', 'd8508f5c-b2de-434e-9ad7-b12032d5c014'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:32:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-83bef69a-6f82-481a-a9a3-144802ccee0e tempest-ProjectReaderTests-1112694435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-83bef69a-6f82-481a-a9a3-144802ccee0e tempest-ProjectReaderTests-1112694435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-83bef69a-6f82-481a-a9a3-144802ccee0e tempest-ProjectReaderTests-1112694435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:32:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-83bef69a-6f82-481a-a9a3-144802ccee0e tempest-ProjectReaderTests-1112694435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:32:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-83bef69a-6f82-481a-a9a3-144802ccee0e tempest-ProjectReaderTests-1112694435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-83bef69a-6f82-481a-a9a3-144802ccee0e tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:44 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:32:44 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:44 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1e63063e-4b03-49b0-a9cf-c8da97b718da tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e" returned: 0 in 0.359s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:44 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-1e63063e-4b03-49b0-a9cf-c8da97b718da tempest-ProjectMemberTests-1830166883 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:32:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-1e63063e-4b03-49b0-a9cf-c8da97b718da tempest-ProjectMemberTests-1830166883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1e63063e-4b03-49b0-a9cf-c8da97b718da tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fefa7c20-2b2d-43ee-a968-fdaca5f65596) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf989b56-e684-4c93-ba26-7677ccea320e', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1e63063e-4b03-49b0-a9cf-c8da97b718da tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (537e1bd7-aff1-4933-b182-5811c037e03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:44 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-1e63063e-4b03-49b0-a9cf-c8da97b718da tempest-ProjectMemberTests-1830166883 None] Volume volume-cf989b56-e684-4c93-ba26-7677ccea320e (cf989b56-e684-4c93-ba26-7677ccea320e): created successfully Sep 03 11:32:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1e63063e-4b03-49b0-a9cf-c8da97b718da tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (537e1bd7-aff1-4933-b182-5811c037e03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:44 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-1e63063e-4b03-49b0-a9cf-c8da97b718da tempest-ProjectMemberTests-1830166883 None] Flow 'volume_create_manager' (93fc047f-b019-4a33-9e59-11e958908e05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:32:44 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-1e63063e-4b03-49b0-a9cf-c8da97b718da tempest-ProjectMemberTests-1830166883 None] Created volume successfully. Sep 03 11:32:44 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:44 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-83bef69a-6f82-481a-a9a3-144802ccee0e tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.273s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:44 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-83bef69a-6f82-481a-a9a3-144802ccee0e tempest-ProjectReaderTests-1112694435 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:32:44 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-83bef69a-6f82-481a-a9a3-144802ccee0e tempest-ProjectReaderTests-1112694435 None] Deleted volume successfully. Sep 03 11:32:44 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-83bef69a-6f82-481a-a9a3-144802ccee0e tempest-ProjectReaderTests-1112694435 None] Lock "cinder-c0d4d31a-4adf-4b7a-821b-e99096eccced-delete_volume" released by "delete_volume" :: held 1.315s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:45 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-911efd0e-ecd9-4b13-9ad5-669bebd712d9 tempest-ProjectReaderTests-1112694435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:32:45 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-911efd0e-ecd9-4b13-9ad5-669bebd712d9 tempest-ProjectReaderTests-1112694435 None] Flow 'volume_create_manager' (ea8eb9d7-ea0b-43f4-a725-16c5b13d833b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:32:45 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-911efd0e-ecd9-4b13-9ad5-669bebd712d9 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d8398e-a87a-4c83-9441-0047fef60c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:45 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-911efd0e-ecd9-4b13-9ad5-669bebd712d9 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d8398e-a87a-4c83-9441-0047fef60c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-10465209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e0a387f-774a-4632-8301-9452986c67f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dcd4de0122b4179a023a1174825fdff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:32:45Z,use_quota=True,user_id='2c8f8d82e5ea4c34a765336d2de00340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:45 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-911efd0e-ecd9-4b13-9ad5-669bebd712d9 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (996221f7-d2a9-46dc-ae3a-a7644ef65630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:45 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-911efd0e-ecd9-4b13-9ad5-669bebd712d9 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (996221f7-d2a9-46dc-ae3a-a7644ef65630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:45 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-911efd0e-ecd9-4b13-9ad5-669bebd712d9 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ae1eb5-8b9f-4fc9-8f2a-d7562562ee57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:45 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-911efd0e-ecd9-4b13-9ad5-669bebd712d9 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7ae1eb5-8b9f-4fc9-8f2a-d7562562ee57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e0a387f-774a-4632-8301-9452986c67f1', 'volume_name': 'volume-8e0a387f-774a-4632-8301-9452986c67f1', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:45 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-911efd0e-ecd9-4b13-9ad5-669bebd712d9 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (334555a5-9384-4a06-afa8-9fca3d9b14b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:45 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-911efd0e-ecd9-4b13-9ad5-669bebd712d9 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (334555a5-9384-4a06-afa8-9fca3d9b14b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:45 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-911efd0e-ecd9-4b13-9ad5-669bebd712d9 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c663844-4b9c-491f-8288-ed4e0ab08f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:45 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-911efd0e-ecd9-4b13-9ad5-669bebd712d9 tempest-ProjectReaderTests-1112694435 None] Volume 8e0a387f-774a-4632-8301-9452986c67f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e0a387f-774a-4632-8301-9452986c67f1', 'volume_size': 1} Sep 03 11:32:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-911efd0e-ecd9-4b13-9ad5-669bebd712d9 tempest-ProjectReaderTests-1112694435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-911efd0e-ecd9-4b13-9ad5-669bebd712d9 tempest-ProjectReaderTests-1112694435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:45 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-911efd0e-ecd9-4b13-9ad5-669bebd712d9 tempest-ProjectReaderTests-1112694435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:32:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-10465209',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e0a387f-774a-4632-8301-9452986c67f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dcd4de0122b4179a023a1174825fdff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:32:45Z,use_quota=True,user_id='2c8f8d82e5ea4c34a765336d2de00340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:32:45 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-911efd0e-ecd9-4b13-9ad5-669bebd712d9 tempest-ProjectReaderTests-1112694435 None] Creating volume 8e0a387f-774a-4632-8301-9452986c67f1 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:32:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-911efd0e-ecd9-4b13-9ad5-669bebd712d9 tempest-ProjectReaderTests-1112694435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-911efd0e-ecd9-4b13-9ad5-669bebd712d9 tempest-ProjectReaderTests-1112694435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:45 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-911efd0e-ecd9-4b13-9ad5-669bebd712d9 tempest-ProjectReaderTests-1112694435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:32:45 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-911efd0e-ecd9-4b13-9ad5-669bebd712d9 tempest-ProjectReaderTests-1112694435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:32:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-911efd0e-ecd9-4b13-9ad5-669bebd712d9 tempest-ProjectReaderTests-1112694435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:45 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-911efd0e-ecd9-4b13-9ad5-669bebd712d9 tempest-ProjectReaderTests-1112694435 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:32:45 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-911efd0e-ecd9-4b13-9ad5-669bebd712d9 tempest-ProjectReaderTests-1112694435 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:32:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-911efd0e-ecd9-4b13-9ad5-669bebd712d9 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:45 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1 1073741824 Sep 03 11:32:45 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:45 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-911efd0e-ecd9-4b13-9ad5-669bebd712d9 tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1 1073741824" returned: 0 in 0.523s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-911efd0e-ecd9-4b13-9ad5-669bebd712d9 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:45 devstack sudo[106699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1 Sep 03 11:32:45 devstack sudo[106699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:45 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-75fa36f9-5156-4a4b-9fd4-56cf71a8ab3d tempest-ProjectMemberTests-1830166883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:46 devstack sudo[106699]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-911efd0e-ecd9-4b13-9ad5-669bebd712d9 tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1" returned: 0 in 0.257s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:46 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-911efd0e-ecd9-4b13-9ad5-669bebd712d9 tempest-ProjectReaderTests-1112694435 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:32:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-911efd0e-ecd9-4b13-9ad5-669bebd712d9 tempest-ProjectReaderTests-1112694435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-75fa36f9-5156-4a4b-9fd4-56cf71a8ab3d tempest-ProjectMemberTests-1830166883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.170s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:46 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-911efd0e-ecd9-4b13-9ad5-669bebd712d9 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c663844-4b9c-491f-8288-ed4e0ab08f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e0a387f-774a-4632-8301-9452986c67f1', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:46 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-911efd0e-ecd9-4b13-9ad5-669bebd712d9 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1cfcd5d-9765-415f-8e91-fed81b2462cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:46 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-75fa36f9-5156-4a4b-9fd4-56cf71a8ab3d tempest-ProjectMemberTests-1830166883 None] Creating offline snapshot 751cbd0e-4d15-4ec6-b1ac-282d90500c76 of volume cf989b56-e684-4c93-ba26-7677ccea320e {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:32:46 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-911efd0e-ecd9-4b13-9ad5-669bebd712d9 tempest-ProjectReaderTests-1112694435 None] Volume volume-8e0a387f-774a-4632-8301-9452986c67f1 (8e0a387f-774a-4632-8301-9452986c67f1): created successfully Sep 03 11:32:46 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-911efd0e-ecd9-4b13-9ad5-669bebd712d9 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1cfcd5d-9765-415f-8e91-fed81b2462cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:46 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-911efd0e-ecd9-4b13-9ad5-669bebd712d9 tempest-ProjectReaderTests-1112694435 None] Flow 'volume_create_manager' (ea8eb9d7-ea0b-43f4-a725-16c5b13d833b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:32:46 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2ca178-9898-4058-ab3b-a666a246596f]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-75fa36f9-5156-4a4b-9fd4-56cf71a8ab3d tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:46 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-911efd0e-ecd9-4b13-9ad5-669bebd712d9 tempest-ProjectReaderTests-1112694435 None] Created volume successfully. Sep 03 11:32:46 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e Sep 03 11:32:46 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:46 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-75fa36f9-5156-4a4b-9fd4-56cf71a8ab3d tempest-ProjectMemberTests-1830166883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e" returned: 0 in 0.379s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-75fa36f9-5156-4a4b-9fd4-56cf71a8ab3d tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e.751cbd0e-4d15-4ec6-b1ac-282d90500c76 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:46 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e.751cbd0e-4d15-4ec6-b1ac-282d90500c76 1G Sep 03 11:32:46 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:46 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-75fa36f9-5156-4a4b-9fd4-56cf71a8ab3d tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e.751cbd0e-4d15-4ec6-b1ac-282d90500c76 1G" returned: 0 in 0.428s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:46 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-75fa36f9-5156-4a4b-9fd4-56cf71a8ab3d tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf989b56-e684-4c93-ba26-7677ccea320e -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e.751cbd0e-4d15-4ec6-b1ac-282d90500c76 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:46 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf989b56-e684-4c93-ba26-7677ccea320e -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e.751cbd0e-4d15-4ec6-b1ac-282d90500c76 Sep 03 11:32:46 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:47 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-75fa36f9-5156-4a4b-9fd4-56cf71a8ab3d tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cf989b56-e684-4c93-ba26-7677ccea320e -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e.751cbd0e-4d15-4ec6-b1ac-282d90500c76" returned: 0 in 0.333s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:47 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-75fa36f9-5156-4a4b-9fd4-56cf71a8ab3d tempest-ProjectMemberTests-1830166883 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e.751cbd0e-4d15-4ec6-b1ac-282d90500c76 is being set with open permissions: ugo+rw Sep 03 11:32:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-75fa36f9-5156-4a4b-9fd4-56cf71a8ab3d tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e.751cbd0e-4d15-4ec6-b1ac-282d90500c76 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:47 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e.751cbd0e-4d15-4ec6-b1ac-282d90500c76 Sep 03 11:32:47 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-da35cc6a-e036-4533-bb4e-3039618d47cd tempest-ProjectReaderTests-1112694435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:47 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-75fa36f9-5156-4a4b-9fd4-56cf71a8ab3d tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e.751cbd0e-4d15-4ec6-b1ac-282d90500c76" returned: 0 in 0.281s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-75fa36f9-5156-4a4b-9fd4-56cf71a8ab3d tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:47 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e.info Sep 03 11:32:47 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:47 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-75fa36f9-5156-4a4b-9fd4-56cf71a8ab3d tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e.info" returned: 0 in 0.282s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:47 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-75fa36f9-5156-4a4b-9fd4-56cf71a8ab3d tempest-ProjectMemberTests-1830166883 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e.info is being set with open permissions: ugo+rw Sep 03 11:32:47 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-75fa36f9-5156-4a4b-9fd4-56cf71a8ab3d tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:47 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e.info Sep 03 11:32:47 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:48 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-75fa36f9-5156-4a4b-9fd4-56cf71a8ab3d tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e.info" returned: 0 in 0.257s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-75fa36f9-5156-4a4b-9fd4-56cf71a8ab3d tempest-ProjectMemberTests-1830166883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.074s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-da35cc6a-e036-4533-bb4e-3039618d47cd tempest-ProjectReaderTests-1112694435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.707s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:48 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-da35cc6a-e036-4533-bb4e-3039618d47cd tempest-ProjectReaderTests-1112694435 None] Creating offline snapshot 14c7396b-635c-4b22-8da3-01ebfe9b3818 of volume 8e0a387f-774a-4632-8301-9452986c67f1 {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:32:48 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-75fa36f9-5156-4a4b-9fd4-56cf71a8ab3d tempest-ProjectMemberTests-1830166883 None] Create snapshot completed successfully Sep 03 11:32:48 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46edda7-0afe-45ca-9605-672e34a12a22]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-da35cc6a-e036-4533-bb4e-3039618d47cd tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:48 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1 Sep 03 11:32:48 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:48 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-da35cc6a-e036-4533-bb4e-3039618d47cd tempest-ProjectReaderTests-1112694435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1" returned: 0 in 0.360s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-da35cc6a-e036-4533-bb4e-3039618d47cd tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1.14c7396b-635c-4b22-8da3-01ebfe9b3818 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:48 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1.14c7396b-635c-4b22-8da3-01ebfe9b3818 1G Sep 03 11:32:48 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:48 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-da35cc6a-e036-4533-bb4e-3039618d47cd tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1.14c7396b-635c-4b22-8da3-01ebfe9b3818 1G" returned: 0 in 0.423s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:48 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-da35cc6a-e036-4533-bb4e-3039618d47cd tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e0a387f-774a-4632-8301-9452986c67f1 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1.14c7396b-635c-4b22-8da3-01ebfe9b3818 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:48 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e0a387f-774a-4632-8301-9452986c67f1 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1.14c7396b-635c-4b22-8da3-01ebfe9b3818 Sep 03 11:32:48 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:49 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-120b993b-2012-448d-b6ce-b37b6d1c7024 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-751cbd0e-4d15-4ec6-b1ac-282d90500c76-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:49 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-120b993b-2012-448d-b6ce-b37b6d1c7024 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-751cbd0e-4d15-4ec6-b1ac-282d90500c76-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:49 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-120b993b-2012-448d-b6ce-b37b6d1c7024 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-quobyte-cf989b56-e684-4c93-ba26-7677ccea320e" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:49 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-120b993b-2012-448d-b6ce-b37b6d1c7024 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-cf989b56-e684-4c93-ba26-7677ccea320e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:49 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-120b993b-2012-448d-b6ce-b37b6d1c7024 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-quobyte-751cbd0e-4d15-4ec6-b1ac-282d90500c76" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:49 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-120b993b-2012-448d-b6ce-b37b6d1c7024 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-751cbd0e-4d15-4ec6-b1ac-282d90500c76" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:49 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-120b993b-2012-448d-b6ce-b37b6d1c7024 tempest-ProjectMemberTests-1830166883 None] Deleting offline snapshot 751cbd0e-4d15-4ec6-b1ac-282d90500c76 of volume cf989b56-e684-4c93-ba26-7677ccea320e {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:32:49 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-120b993b-2012-448d-b6ce-b37b6d1c7024 tempest-ProjectMemberTests-1830166883 None] snapshot_file for this snap is: volume-cf989b56-e684-4c93-ba26-7677ccea320e.751cbd0e-4d15-4ec6-b1ac-282d90500c76 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:32:49 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[3855dd56-42f8-40ea-a858-1d91077b604b]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-120b993b-2012-448d-b6ce-b37b6d1c7024 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e.751cbd0e-4d15-4ec6-b1ac-282d90500c76 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:49 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e.751cbd0e-4d15-4ec6-b1ac-282d90500c76 Sep 03 11:32:49 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:49 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-da35cc6a-e036-4533-bb4e-3039618d47cd tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e0a387f-774a-4632-8301-9452986c67f1 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1.14c7396b-635c-4b22-8da3-01ebfe9b3818" returned: 0 in 0.303s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:49 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-da35cc6a-e036-4533-bb4e-3039618d47cd tempest-ProjectReaderTests-1112694435 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1.14c7396b-635c-4b22-8da3-01ebfe9b3818 is being set with open permissions: ugo+rw Sep 03 11:32:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-da35cc6a-e036-4533-bb4e-3039618d47cd tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1.14c7396b-635c-4b22-8da3-01ebfe9b3818 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:49 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1.14c7396b-635c-4b22-8da3-01ebfe9b3818 Sep 03 11:32:49 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:49 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-120b993b-2012-448d-b6ce-b37b6d1c7024 tempest-ProjectMemberTests-1830166883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e.751cbd0e-4d15-4ec6-b1ac-282d90500c76" returned: 0 in 0.405s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:49 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-120b993b-2012-448d-b6ce-b37b6d1c7024 tempest-ProjectMemberTests-1830166883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cf989b56-e684-4c93-ba26-7677ccea320e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:32:49 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-da35cc6a-e036-4533-bb4e-3039618d47cd tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1.14c7396b-635c-4b22-8da3-01ebfe9b3818" returned: 0 in 0.274s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:49 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2228359-4d84-47d8-859a-3382e81e0828]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-120b993b-2012-448d-b6ce-b37b6d1c7024 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-da35cc6a-e036-4533-bb4e-3039618d47cd tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:49 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1.info Sep 03 11:32:49 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:49 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e Sep 03 11:32:49 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:49 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-da35cc6a-e036-4533-bb4e-3039618d47cd tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1.info" returned: 0 in 0.314s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:49 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-da35cc6a-e036-4533-bb4e-3039618d47cd tempest-ProjectReaderTests-1112694435 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1.info is being set with open permissions: ugo+rw Sep 03 11:32:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-da35cc6a-e036-4533-bb4e-3039618d47cd tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:49 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1.info Sep 03 11:32:49 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:49 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-120b993b-2012-448d-b6ce-b37b6d1c7024 tempest-ProjectMemberTests-1830166883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e" returned: 0 in 0.448s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:49 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-120b993b-2012-448d-b6ce-b37b6d1c7024 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e.751cbd0e-4d15-4ec6-b1ac-282d90500c76 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:50 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e.751cbd0e-4d15-4ec6-b1ac-282d90500c76 Sep 03 11:32:50 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:50 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-da35cc6a-e036-4533-bb4e-3039618d47cd tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1.info" returned: 0 in 0.270s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-da35cc6a-e036-4533-bb4e-3039618d47cd tempest-ProjectReaderTests-1112694435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.081s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:50 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-da35cc6a-e036-4533-bb4e-3039618d47cd tempest-ProjectReaderTests-1112694435 None] Create snapshot completed successfully Sep 03 11:32:50 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-120b993b-2012-448d-b6ce-b37b6d1c7024 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e.751cbd0e-4d15-4ec6-b1ac-282d90500c76" returned: 0 in 0.374s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-120b993b-2012-448d-b6ce-b37b6d1c7024 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e.751cbd0e-4d15-4ec6-b1ac-282d90500c76 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:50 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e.751cbd0e-4d15-4ec6-b1ac-282d90500c76 Sep 03 11:32:50 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:50 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-23aa533d-d4a5-4a8b-8e0e-f8475981421c tempest-ProjectReaderTests-1112694435 None] Acquiring lock "cinder-14c7396b-635c-4b22-8da3-01ebfe9b3818-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:50 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-23aa533d-d4a5-4a8b-8e0e-f8475981421c tempest-ProjectReaderTests-1112694435 None] Lock "cinder-14c7396b-635c-4b22-8da3-01ebfe9b3818-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:50 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-23aa533d-d4a5-4a8b-8e0e-f8475981421c tempest-ProjectReaderTests-1112694435 None] Acquiring lock "cinder-quobyte-8e0a387f-774a-4632-8301-9452986c67f1" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:50 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-23aa533d-d4a5-4a8b-8e0e-f8475981421c tempest-ProjectReaderTests-1112694435 None] Lock "cinder-quobyte-8e0a387f-774a-4632-8301-9452986c67f1" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:50 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-23aa533d-d4a5-4a8b-8e0e-f8475981421c tempest-ProjectReaderTests-1112694435 None] Acquiring lock "cinder-quobyte-14c7396b-635c-4b22-8da3-01ebfe9b3818" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:50 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-23aa533d-d4a5-4a8b-8e0e-f8475981421c tempest-ProjectReaderTests-1112694435 None] Lock "cinder-quobyte-14c7396b-635c-4b22-8da3-01ebfe9b3818" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:50 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-23aa533d-d4a5-4a8b-8e0e-f8475981421c tempest-ProjectReaderTests-1112694435 None] Deleting offline snapshot 14c7396b-635c-4b22-8da3-01ebfe9b3818 of volume 8e0a387f-774a-4632-8301-9452986c67f1 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:32:50 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:50 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-23aa533d-d4a5-4a8b-8e0e-f8475981421c tempest-ProjectReaderTests-1112694435 None] snapshot_file for this snap is: volume-8e0a387f-774a-4632-8301-9452986c67f1.14c7396b-635c-4b22-8da3-01ebfe9b3818 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:32:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-120b993b-2012-448d-b6ce-b37b6d1c7024 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e.751cbd0e-4d15-4ec6-b1ac-282d90500c76" returned: 0 in 0.366s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:50 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3cf4c6-07fa-497a-adfd-1e01e275ba06]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:50 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23aa533d-d4a5-4a8b-8e0e-f8475981421c tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1.14c7396b-635c-4b22-8da3-01ebfe9b3818 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:50 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-120b993b-2012-448d-b6ce-b37b6d1c7024 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-751cbd0e-4d15-4ec6-b1ac-282d90500c76" released by "_delete_snapshot" :: held 1.740s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:50 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-120b993b-2012-448d-b6ce-b37b6d1c7024 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-cf989b56-e684-4c93-ba26-7677ccea320e" released by "delete_snapshot" :: held 1.768s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:50 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-120b993b-2012-448d-b6ce-b37b6d1c7024 tempest-ProjectMemberTests-1830166883 None] Created reservations ['80ead935-643d-4694-ab1b-7195b88bae4e', '9eeb34cd-21e0-46aa-a16d-76f3737630c8', '614a5027-ccfe-48ac-8387-2f5865451e35', '45f36f96-da6d-4903-84c6-6019d7925c8e'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:32:50 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1.14c7396b-635c-4b22-8da3-01ebfe9b3818 Sep 03 11:32:50 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:50 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-120b993b-2012-448d-b6ce-b37b6d1c7024 tempest-ProjectMemberTests-1830166883 None] Delete snapshot completed successfully. Sep 03 11:32:50 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-120b993b-2012-448d-b6ce-b37b6d1c7024 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-751cbd0e-4d15-4ec6-b1ac-282d90500c76-delete_snapshot" released by "delete_snapshot" :: held 1.934s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:51 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:51 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-41e4f209-7e5d-4109-8933-fc85244c2cf6 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-cf989b56-e684-4c93-ba26-7677ccea320e-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23aa533d-d4a5-4a8b-8e0e-f8475981421c tempest-ProjectReaderTests-1112694435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1.14c7396b-635c-4b22-8da3-01ebfe9b3818" returned: 0 in 0.413s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:51 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-23aa533d-d4a5-4a8b-8e0e-f8475981421c tempest-ProjectReaderTests-1112694435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e0a387f-774a-4632-8301-9452986c67f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:32:51 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-41e4f209-7e5d-4109-8933-fc85244c2cf6 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-cf989b56-e684-4c93-ba26-7677ccea320e-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:51 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[11078fa7-ece9-4a77-aaf4-c311ce8bde27]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23aa533d-d4a5-4a8b-8e0e-f8475981421c tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:51 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-41e4f209-7e5d-4109-8933-fc85244c2cf6 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-quobyte-cf989b56-e684-4c93-ba26-7677ccea320e" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:51 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-41e4f209-7e5d-4109-8933-fc85244c2cf6 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-cf989b56-e684-4c93-ba26-7677ccea320e" acquired by "delete_volume" :: waited 0.019s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:51 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[f743c2e7-6726-485c-9d24-2f116f57c93b]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-41e4f209-7e5d-4109-8933-fc85244c2cf6 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:51 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1 Sep 03 11:32:51 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:51 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e Sep 03 11:32:51 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:51 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23aa533d-d4a5-4a8b-8e0e-f8475981421c tempest-ProjectReaderTests-1112694435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1" returned: 0 in 0.411s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23aa533d-d4a5-4a8b-8e0e-f8475981421c tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1.14c7396b-635c-4b22-8da3-01ebfe9b3818 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:51 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1.14c7396b-635c-4b22-8da3-01ebfe9b3818 Sep 03 11:32:51 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:51 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-41e4f209-7e5d-4109-8933-fc85244c2cf6 tempest-ProjectMemberTests-1830166883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e" returned: 0 in 0.426s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:51 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-41e4f209-7e5d-4109-8933-fc85244c2cf6 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:51 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e Sep 03 11:32:51 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:52 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23aa533d-d4a5-4a8b-8e0e-f8475981421c tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1.14c7396b-635c-4b22-8da3-01ebfe9b3818" returned: 0 in 0.414s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23aa533d-d4a5-4a8b-8e0e-f8475981421c tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1.14c7396b-635c-4b22-8da3-01ebfe9b3818 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:52 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-41e4f209-7e5d-4109-8933-fc85244c2cf6 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-cf989b56-e684-4c93-ba26-7677ccea320e" returned: 0 in 0.301s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:52 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1.14c7396b-635c-4b22-8da3-01ebfe9b3818 Sep 03 11:32:52 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-41e4f209-7e5d-4109-8933-fc85244c2cf6 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-cf989b56-e684-4c93-ba26-7677ccea320e" released by "delete_volume" :: held 0.801s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:52 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:52 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-41e4f209-7e5d-4109-8933-fc85244c2cf6 tempest-ProjectMemberTests-1830166883 None] Created reservations ['f23d9291-97e0-4fde-8913-c45616a19e1a', '76a03abd-3ded-4857-8e05-538687c8ba80', 'ce36b3c8-1306-4d0b-a66e-9615af2d6213', '474b8829-3cb0-4308-bbb7-b399c0b6ab16'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:32:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-41e4f209-7e5d-4109-8933-fc85244c2cf6 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-41e4f209-7e5d-4109-8933-fc85244c2cf6 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:52 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-41e4f209-7e5d-4109-8933-fc85244c2cf6 tempest-ProjectMemberTests-1830166883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:32:52 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-41e4f209-7e5d-4109-8933-fc85244c2cf6 tempest-ProjectMemberTests-1830166883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:32:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-41e4f209-7e5d-4109-8933-fc85244c2cf6 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-41e4f209-7e5d-4109-8933-fc85244c2cf6 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:52 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:32:52 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:52 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23aa533d-d4a5-4a8b-8e0e-f8475981421c tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1.14c7396b-635c-4b22-8da3-01ebfe9b3818" returned: 0 in 0.303s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:52 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-23aa533d-d4a5-4a8b-8e0e-f8475981421c tempest-ProjectReaderTests-1112694435 None] Lock "cinder-quobyte-14c7396b-635c-4b22-8da3-01ebfe9b3818" released by "_delete_snapshot" :: held 1.730s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:52 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-23aa533d-d4a5-4a8b-8e0e-f8475981421c tempest-ProjectReaderTests-1112694435 None] Lock "cinder-quobyte-8e0a387f-774a-4632-8301-9452986c67f1" released by "delete_snapshot" :: held 1.775s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:52 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-23aa533d-d4a5-4a8b-8e0e-f8475981421c tempest-ProjectReaderTests-1112694435 None] Created reservations ['3e4fb28a-bbc1-4a1f-a461-6dfab08fb36a', '4c34d59b-00f6-4043-8a06-92190d900ff5', 'c3191c01-c80e-44ac-a530-dc7906b40f2f', '37a1b5bd-ed98-4c16-8094-6b955e8897e7'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:32:52 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-41e4f209-7e5d-4109-8933-fc85244c2cf6 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.321s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:52 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-41e4f209-7e5d-4109-8933-fc85244c2cf6 tempest-ProjectMemberTests-1830166883 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:32:52 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-23aa533d-d4a5-4a8b-8e0e-f8475981421c tempest-ProjectReaderTests-1112694435 None] Delete snapshot completed successfully. Sep 03 11:32:52 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-41e4f209-7e5d-4109-8933-fc85244c2cf6 tempest-ProjectMemberTests-1830166883 None] Deleted volume successfully. Sep 03 11:32:52 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-23aa533d-d4a5-4a8b-8e0e-f8475981421c tempest-ProjectReaderTests-1112694435 None] Lock "cinder-14c7396b-635c-4b22-8da3-01ebfe9b3818-delete_snapshot" released by "delete_snapshot" :: held 1.992s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:52 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-41e4f209-7e5d-4109-8933-fc85244c2cf6 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-cf989b56-e684-4c93-ba26-7677ccea320e-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:52 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d7443ac0-b350-4d12-b08e-e913c5b27775 tempest-ProjectReaderTests-1112694435 None] Acquiring lock "cinder-8e0a387f-774a-4632-8301-9452986c67f1-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:52 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d7443ac0-b350-4d12-b08e-e913c5b27775 tempest-ProjectReaderTests-1112694435 None] Lock "cinder-8e0a387f-774a-4632-8301-9452986c67f1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:52 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d7443ac0-b350-4d12-b08e-e913c5b27775 tempest-ProjectReaderTests-1112694435 None] Acquiring lock "cinder-quobyte-8e0a387f-774a-4632-8301-9452986c67f1" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:52 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d7443ac0-b350-4d12-b08e-e913c5b27775 tempest-ProjectReaderTests-1112694435 None] Lock "cinder-quobyte-8e0a387f-774a-4632-8301-9452986c67f1" acquired by "delete_volume" :: waited 0.022s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:52 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e307de-69f7-4769-85c5-ee5532805991]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:52 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d7443ac0-b350-4d12-b08e-e913c5b27775 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-e920a780-ca9a-43ff-9431-a008c34132cb tempest-ProjectMemberTests-1830166883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e920a780-ca9a-43ff-9431-a008c34132cb tempest-ProjectMemberTests-1830166883 None] Flow 'volume_create_manager' (9de809e1-a114-4dea-8e91-2fd5b2a3b0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e920a780-ca9a-43ff-9431-a008c34132cb tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f87ef3ab-cf58-41b6-a33b-d33121d813ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e920a780-ca9a-43ff-9431-a008c34132cb tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f87ef3ab-cf58-41b6-a33b-d33121d813ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-557972854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b2bc240-f5c0-44b9-bdb7-a63455c5fde7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e9ee545cbb4eb99d3a310cf4efc844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:32:53Z,use_quota=True,user_id='badece1d173b4e51add55b4a7c961a4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e920a780-ca9a-43ff-9431-a008c34132cb tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa35104c-8e87-4075-9c1a-6cef9edceaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e920a780-ca9a-43ff-9431-a008c34132cb tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa35104c-8e87-4075-9c1a-6cef9edceaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e920a780-ca9a-43ff-9431-a008c34132cb tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4748841-407a-4a1f-bc91-9b5a5348074d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:53 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1 Sep 03 11:32:53 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e920a780-ca9a-43ff-9431-a008c34132cb tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4748841-407a-4a1f-bc91-9b5a5348074d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b2bc240-f5c0-44b9-bdb7-a63455c5fde7', 'volume_name': 'volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e920a780-ca9a-43ff-9431-a008c34132cb tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f99f1d65-3a1e-4e7a-ab8d-a548a982170b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e920a780-ca9a-43ff-9431-a008c34132cb tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f99f1d65-3a1e-4e7a-ab8d-a548a982170b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e920a780-ca9a-43ff-9431-a008c34132cb tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5affb558-7b2a-4405-8804-039ae90fadaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:53 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-e920a780-ca9a-43ff-9431-a008c34132cb tempest-ProjectMemberTests-1830166883 None] Volume 9b2bc240-f5c0-44b9-bdb7-a63455c5fde7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7', 'volume_size': 1} Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e920a780-ca9a-43ff-9431-a008c34132cb tempest-ProjectMemberTests-1830166883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e920a780-ca9a-43ff-9431-a008c34132cb tempest-ProjectMemberTests-1830166883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e920a780-ca9a-43ff-9431-a008c34132cb tempest-ProjectMemberTests-1830166883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:32:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-557972854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b2bc240-f5c0-44b9-bdb7-a63455c5fde7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e9ee545cbb4eb99d3a310cf4efc844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:32:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:32:53Z,use_quota=True,user_id='badece1d173b4e51add55b4a7c961a4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-e920a780-ca9a-43ff-9431-a008c34132cb tempest-ProjectMemberTests-1830166883 None] Creating volume 9b2bc240-f5c0-44b9-bdb7-a63455c5fde7 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e920a780-ca9a-43ff-9431-a008c34132cb tempest-ProjectMemberTests-1830166883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e920a780-ca9a-43ff-9431-a008c34132cb tempest-ProjectMemberTests-1830166883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e920a780-ca9a-43ff-9431-a008c34132cb tempest-ProjectMemberTests-1830166883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e920a780-ca9a-43ff-9431-a008c34132cb tempest-ProjectMemberTests-1830166883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e920a780-ca9a-43ff-9431-a008c34132cb tempest-ProjectMemberTests-1830166883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e920a780-ca9a-43ff-9431-a008c34132cb tempest-ProjectMemberTests-1830166883 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:32:53 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-e920a780-ca9a-43ff-9431-a008c34132cb tempest-ProjectMemberTests-1830166883 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e920a780-ca9a-43ff-9431-a008c34132cb tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:53 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7 1073741824 Sep 03 11:32:53 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:53 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d7443ac0-b350-4d12-b08e-e913c5b27775 tempest-ProjectReaderTests-1112694435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1" returned: 0 in 0.385s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d7443ac0-b350-4d12-b08e-e913c5b27775 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:53 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1 Sep 03 11:32:53 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:53 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e920a780-ca9a-43ff-9431-a008c34132cb tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7 1073741824" returned: 0 in 0.413s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e920a780-ca9a-43ff-9431-a008c34132cb tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:53 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7 Sep 03 11:32:53 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:53 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d7443ac0-b350-4d12-b08e-e913c5b27775 tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-8e0a387f-774a-4632-8301-9452986c67f1" returned: 0 in 0.273s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d7443ac0-b350-4d12-b08e-e913c5b27775 tempest-ProjectReaderTests-1112694435 None] Lock "cinder-quobyte-8e0a387f-774a-4632-8301-9452986c67f1" released by "delete_volume" :: held 0.735s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-d7443ac0-b350-4d12-b08e-e913c5b27775 tempest-ProjectReaderTests-1112694435 None] Created reservations ['4921efa7-2c09-40ee-b208-aefd0832a5f1', '3d333d1f-2574-4004-8ef3-f25731aafe16', 'f98b8a42-7620-4a91-ae41-58d36775fecc', '2a817427-0ef2-448f-961a-371c426199db'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d7443ac0-b350-4d12-b08e-e913c5b27775 tempest-ProjectReaderTests-1112694435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d7443ac0-b350-4d12-b08e-e913c5b27775 tempest-ProjectReaderTests-1112694435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d7443ac0-b350-4d12-b08e-e913c5b27775 tempest-ProjectReaderTests-1112694435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d7443ac0-b350-4d12-b08e-e913c5b27775 tempest-ProjectReaderTests-1112694435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d7443ac0-b350-4d12-b08e-e913c5b27775 tempest-ProjectReaderTests-1112694435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d7443ac0-b350-4d12-b08e-e913c5b27775 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:53 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:32:53 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:53 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-e920a780-ca9a-43ff-9431-a008c34132cb tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7" returned: 0 in 0.255s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-e920a780-ca9a-43ff-9431-a008c34132cb tempest-ProjectMemberTests-1830166883 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-e920a780-ca9a-43ff-9431-a008c34132cb tempest-ProjectMemberTests-1830166883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e920a780-ca9a-43ff-9431-a008c34132cb tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5affb558-7b2a-4405-8804-039ae90fadaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e920a780-ca9a-43ff-9431-a008c34132cb tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc168dc-857a-4f28-877e-5611b309e625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:53 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-e920a780-ca9a-43ff-9431-a008c34132cb tempest-ProjectMemberTests-1830166883 None] Volume volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7 (9b2bc240-f5c0-44b9-bdb7-a63455c5fde7): created successfully Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e920a780-ca9a-43ff-9431-a008c34132cb tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bc168dc-857a-4f28-877e-5611b309e625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:53 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-e920a780-ca9a-43ff-9431-a008c34132cb tempest-ProjectMemberTests-1830166883 None] Flow 'volume_create_manager' (9de809e1-a114-4dea-8e91-2fd5b2a3b0cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:32:53 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-e920a780-ca9a-43ff-9431-a008c34132cb tempest-ProjectMemberTests-1830166883 None] Created volume successfully. Sep 03 11:32:54 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d7443ac0-b350-4d12-b08e-e913c5b27775 tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.262s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:54 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-d7443ac0-b350-4d12-b08e-e913c5b27775 tempest-ProjectReaderTests-1112694435 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:32:54 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-d7443ac0-b350-4d12-b08e-e913c5b27775 tempest-ProjectReaderTests-1112694435 None] Deleted volume successfully. Sep 03 11:32:54 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d7443ac0-b350-4d12-b08e-e913c5b27775 tempest-ProjectReaderTests-1112694435 None] Lock "cinder-8e0a387f-774a-4632-8301-9452986c67f1-delete_volume" released by "delete_volume" :: held 1.210s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5bd5b230-6b6e-4b4e-8950-cb17157f0dbd tempest-ProjectMemberTests-1830166883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5bd5b230-6b6e-4b4e-8950-cb17157f0dbd tempest-ProjectMemberTests-1830166883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:54 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-5bd5b230-6b6e-4b4e-8950-cb17157f0dbd tempest-ProjectMemberTests-1830166883 None] Creating offline snapshot 1c6c2232-39b0-495b-8e72-6987eab89723 of volume 9b2bc240-f5c0-44b9-bdb7-a63455c5fde7 {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:32:54 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[7722fb67-e924-4ebe-974d-8bf004eaf372]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5bd5b230-6b6e-4b4e-8950-cb17157f0dbd tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:54 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7 Sep 03 11:32:54 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:54 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-54dc80ce-179e-4298-8f90-73b796da9025 tempest-ProjectReaderTests-1112694435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:32:54 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-54dc80ce-179e-4298-8f90-73b796da9025 tempest-ProjectReaderTests-1112694435 None] Flow 'volume_create_manager' (a6b243ee-6982-49c6-bb83-864856d95676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:32:54 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-54dc80ce-179e-4298-8f90-73b796da9025 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dee7d8d-8b50-416a-88e1-7db9b1a2dc1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:54 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-54dc80ce-179e-4298-8f90-73b796da9025 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4dee7d8d-8b50-416a-88e1-7db9b1a2dc1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1748304663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a24762da-bc85-4e21-b9f8-6d42e78f62c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dcd4de0122b4179a023a1174825fdff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:32:54Z,use_quota=True,user_id='2c8f8d82e5ea4c34a765336d2de00340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:54 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-54dc80ce-179e-4298-8f90-73b796da9025 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6214a5db-b1f3-45c7-a88f-eb4764879b40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:54 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-54dc80ce-179e-4298-8f90-73b796da9025 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6214a5db-b1f3-45c7-a88f-eb4764879b40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:54 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-54dc80ce-179e-4298-8f90-73b796da9025 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d159c5b-c5b3-43ae-a01d-a2f7225c1696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:54 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-54dc80ce-179e-4298-8f90-73b796da9025 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d159c5b-c5b3-43ae-a01d-a2f7225c1696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a24762da-bc85-4e21-b9f8-6d42e78f62c5', 'volume_name': 'volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:54 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-54dc80ce-179e-4298-8f90-73b796da9025 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd4e66ee-f979-49c3-9f5b-c366ca173d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:54 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-54dc80ce-179e-4298-8f90-73b796da9025 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd4e66ee-f979-49c3-9f5b-c366ca173d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:54 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-54dc80ce-179e-4298-8f90-73b796da9025 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (053e3b35-9b3e-47f1-b8cd-f6218c4507c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:54 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-54dc80ce-179e-4298-8f90-73b796da9025 tempest-ProjectReaderTests-1112694435 None] Volume a24762da-bc85-4e21-b9f8-6d42e78f62c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5', 'volume_size': 1} Sep 03 11:32:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-54dc80ce-179e-4298-8f90-73b796da9025 tempest-ProjectReaderTests-1112694435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:54 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5bd5b230-6b6e-4b4e-8950-cb17157f0dbd tempest-ProjectMemberTests-1830166883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7" returned: 0 in 0.457s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:54 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5bd5b230-6b6e-4b4e-8950-cb17157f0dbd tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7.1c6c2232-39b0-495b-8e72-6987eab89723 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:54 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7.1c6c2232-39b0-495b-8e72-6987eab89723 1G Sep 03 11:32:54 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:55 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5bd5b230-6b6e-4b4e-8950-cb17157f0dbd tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7.1c6c2232-39b0-495b-8e72-6987eab89723 1G" returned: 0 in 0.384s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5bd5b230-6b6e-4b4e-8950-cb17157f0dbd tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7.1c6c2232-39b0-495b-8e72-6987eab89723 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:55 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7.1c6c2232-39b0-495b-8e72-6987eab89723 Sep 03 11:32:55 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:55 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5bd5b230-6b6e-4b4e-8950-cb17157f0dbd tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7.1c6c2232-39b0-495b-8e72-6987eab89723" returned: 0 in 0.289s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:55 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-5bd5b230-6b6e-4b4e-8950-cb17157f0dbd tempest-ProjectMemberTests-1830166883 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7.1c6c2232-39b0-495b-8e72-6987eab89723 is being set with open permissions: ugo+rw Sep 03 11:32:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5bd5b230-6b6e-4b4e-8950-cb17157f0dbd tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7.1c6c2232-39b0-495b-8e72-6987eab89723 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:55 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7.1c6c2232-39b0-495b-8e72-6987eab89723 Sep 03 11:32:55 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:55 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5bd5b230-6b6e-4b4e-8950-cb17157f0dbd tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7.1c6c2232-39b0-495b-8e72-6987eab89723" returned: 0 in 0.246s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5bd5b230-6b6e-4b4e-8950-cb17157f0dbd tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:55 devstack sudo[106842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7.info Sep 03 11:32:55 devstack sudo[106842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:55 devstack sudo[106842]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5bd5b230-6b6e-4b4e-8950-cb17157f0dbd tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7.info" returned: 0 in 0.249s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:55 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-5bd5b230-6b6e-4b4e-8950-cb17157f0dbd tempest-ProjectMemberTests-1830166883 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7.info is being set with open permissions: ugo+rw Sep 03 11:32:55 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5bd5b230-6b6e-4b4e-8950-cb17157f0dbd tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:55 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7.info Sep 03 11:32:55 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:56 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5bd5b230-6b6e-4b4e-8950-cb17157f0dbd tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7.info" returned: 0 in 0.238s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-5bd5b230-6b6e-4b4e-8950-cb17157f0dbd tempest-ProjectMemberTests-1830166883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.940s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-54dc80ce-179e-4298-8f90-73b796da9025 tempest-ProjectReaderTests-1112694435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.502s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-54dc80ce-179e-4298-8f90-73b796da9025 tempest-ProjectReaderTests-1112694435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:32:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1748304663',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a24762da-bc85-4e21-b9f8-6d42e78f62c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dcd4de0122b4179a023a1174825fdff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:32:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:32:54Z,use_quota=True,user_id='2c8f8d82e5ea4c34a765336d2de00340',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:32:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-54dc80ce-179e-4298-8f90-73b796da9025 tempest-ProjectReaderTests-1112694435 None] Creating volume a24762da-bc85-4e21-b9f8-6d42e78f62c5 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:32:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-54dc80ce-179e-4298-8f90-73b796da9025 tempest-ProjectReaderTests-1112694435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-54dc80ce-179e-4298-8f90-73b796da9025 tempest-ProjectReaderTests-1112694435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-54dc80ce-179e-4298-8f90-73b796da9025 tempest-ProjectReaderTests-1112694435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:32:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-54dc80ce-179e-4298-8f90-73b796da9025 tempest-ProjectReaderTests-1112694435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:32:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-54dc80ce-179e-4298-8f90-73b796da9025 tempest-ProjectReaderTests-1112694435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-54dc80ce-179e-4298-8f90-73b796da9025 tempest-ProjectReaderTests-1112694435 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:32:56 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-54dc80ce-179e-4298-8f90-73b796da9025 tempest-ProjectReaderTests-1112694435 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:32:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-54dc80ce-179e-4298-8f90-73b796da9025 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:56 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5 1073741824 Sep 03 11:32:56 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:56 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-5bd5b230-6b6e-4b4e-8950-cb17157f0dbd tempest-ProjectMemberTests-1830166883 None] Create snapshot completed successfully Sep 03 11:32:56 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5d068abd-9b4e-4488-bc83-f33fa1f75274 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-1c6c2232-39b0-495b-8e72-6987eab89723-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:56 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5d068abd-9b4e-4488-bc83-f33fa1f75274 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-1c6c2232-39b0-495b-8e72-6987eab89723-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:56 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5d068abd-9b4e-4488-bc83-f33fa1f75274 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-quobyte-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:56 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5d068abd-9b4e-4488-bc83-f33fa1f75274 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:56 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5d068abd-9b4e-4488-bc83-f33fa1f75274 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-quobyte-1c6c2232-39b0-495b-8e72-6987eab89723" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:56 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5d068abd-9b4e-4488-bc83-f33fa1f75274 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-1c6c2232-39b0-495b-8e72-6987eab89723" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-5d068abd-9b4e-4488-bc83-f33fa1f75274 tempest-ProjectMemberTests-1830166883 None] Deleting offline snapshot 1c6c2232-39b0-495b-8e72-6987eab89723 of volume 9b2bc240-f5c0-44b9-bdb7-a63455c5fde7 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:32:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-5d068abd-9b4e-4488-bc83-f33fa1f75274 tempest-ProjectMemberTests-1830166883 None] snapshot_file for this snap is: volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7.1c6c2232-39b0-495b-8e72-6987eab89723 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:32:56 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b42e0c-d6b1-40d9-a8ed-a1a1488e9466]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5d068abd-9b4e-4488-bc83-f33fa1f75274 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7.1c6c2232-39b0-495b-8e72-6987eab89723 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:56 devstack sudo[106853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7.1c6c2232-39b0-495b-8e72-6987eab89723 Sep 03 11:32:56 devstack sudo[106853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:56 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-54dc80ce-179e-4298-8f90-73b796da9025 tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5 1073741824" returned: 0 in 0.454s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-54dc80ce-179e-4298-8f90-73b796da9025 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:56 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5 Sep 03 11:32:56 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:56 devstack sudo[106853]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5d068abd-9b4e-4488-bc83-f33fa1f75274 tempest-ProjectMemberTests-1830166883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7.1c6c2232-39b0-495b-8e72-6987eab89723" returned: 0 in 0.391s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-5d068abd-9b4e-4488-bc83-f33fa1f75274 tempest-ProjectMemberTests-1830166883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:32:56 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98346ea-9795-4bde-83a9-0dfede5734a0]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5d068abd-9b4e-4488-bc83-f33fa1f75274 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:56 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-54dc80ce-179e-4298-8f90-73b796da9025 tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5" returned: 0 in 0.250s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:56 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-54dc80ce-179e-4298-8f90-73b796da9025 tempest-ProjectReaderTests-1112694435 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:32:56 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-54dc80ce-179e-4298-8f90-73b796da9025 tempest-ProjectReaderTests-1112694435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:56 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-54dc80ce-179e-4298-8f90-73b796da9025 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (053e3b35-9b3e-47f1-b8cd-f6218c4507c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:56 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-54dc80ce-179e-4298-8f90-73b796da9025 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa86f15-783f-4312-9baf-c56ed2bda0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:32:56 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7 Sep 03 11:32:56 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:56 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-54dc80ce-179e-4298-8f90-73b796da9025 tempest-ProjectReaderTests-1112694435 None] Volume volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5 (a24762da-bc85-4e21-b9f8-6d42e78f62c5): created successfully Sep 03 11:32:56 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-54dc80ce-179e-4298-8f90-73b796da9025 tempest-ProjectReaderTests-1112694435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (daa86f15-783f-4312-9baf-c56ed2bda0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:32:56 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-54dc80ce-179e-4298-8f90-73b796da9025 tempest-ProjectReaderTests-1112694435 None] Flow 'volume_create_manager' (a6b243ee-6982-49c6-bb83-864856d95676) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:32:56 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-54dc80ce-179e-4298-8f90-73b796da9025 tempest-ProjectReaderTests-1112694435 None] Created volume successfully. Sep 03 11:32:57 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5d068abd-9b4e-4488-bc83-f33fa1f75274 tempest-ProjectMemberTests-1830166883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7" returned: 0 in 0.371s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5d068abd-9b4e-4488-bc83-f33fa1f75274 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7.1c6c2232-39b0-495b-8e72-6987eab89723 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:57 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7.1c6c2232-39b0-495b-8e72-6987eab89723 Sep 03 11:32:57 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:57 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5d068abd-9b4e-4488-bc83-f33fa1f75274 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7.1c6c2232-39b0-495b-8e72-6987eab89723" returned: 0 in 0.323s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5d068abd-9b4e-4488-bc83-f33fa1f75274 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7.1c6c2232-39b0-495b-8e72-6987eab89723 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:57 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7.1c6c2232-39b0-495b-8e72-6987eab89723 Sep 03 11:32:57 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:57 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-5d068abd-9b4e-4488-bc83-f33fa1f75274 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7.1c6c2232-39b0-495b-8e72-6987eab89723" returned: 0 in 0.252s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:57 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5d068abd-9b4e-4488-bc83-f33fa1f75274 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-1c6c2232-39b0-495b-8e72-6987eab89723" released by "_delete_snapshot" :: held 1.435s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:57 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5d068abd-9b4e-4488-bc83-f33fa1f75274 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7" released by "delete_snapshot" :: held 1.460s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a9744fdf-25a8-4782-bc71-ae7c97a9ba06 tempest-ProjectReaderTests-1112694435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a9744fdf-25a8-4782-bc71-ae7c97a9ba06 tempest-ProjectReaderTests-1112694435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:57 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-a9744fdf-25a8-4782-bc71-ae7c97a9ba06 tempest-ProjectReaderTests-1112694435 None] Creating offline snapshot 59df6c44-eae8-4569-a9b0-611a4d0d3c95 of volume a24762da-bc85-4e21-b9f8-6d42e78f62c5 {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:32:57 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43677ba-25eb-4bdb-b702-5b7aacb975eb]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:57 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a9744fdf-25a8-4782-bc71-ae7c97a9ba06 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:57 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-5d068abd-9b4e-4488-bc83-f33fa1f75274 tempest-ProjectMemberTests-1830166883 None] Created reservations ['e4320d18-1f4b-4a4f-a19b-ff88c8cef485', '01fd7061-d08f-4584-9316-d9f107e6671f', '2f16f357-2038-45d7-bb55-81883c72e3a1', '4e231312-273e-413d-a6a0-6482af75f9a0'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:32:57 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-5d068abd-9b4e-4488-bc83-f33fa1f75274 tempest-ProjectMemberTests-1830166883 None] Delete snapshot completed successfully. Sep 03 11:32:57 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-5d068abd-9b4e-4488-bc83-f33fa1f75274 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-1c6c2232-39b0-495b-8e72-6987eab89723-delete_snapshot" released by "delete_snapshot" :: held 1.625s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:57 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5 Sep 03 11:32:57 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:58 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a9744fdf-25a8-4782-bc71-ae7c97a9ba06 tempest-ProjectReaderTests-1112694435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5" returned: 0 in 0.344s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a9744fdf-25a8-4782-bc71-ae7c97a9ba06 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5.59df6c44-eae8-4569-a9b0-611a4d0d3c95 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:58 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5.59df6c44-eae8-4569-a9b0-611a4d0d3c95 1G Sep 03 11:32:58 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:58 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-427c629e-6e8a-4ff3-8bf4-f0c18dad5305 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:58 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-427c629e-6e8a-4ff3-8bf4-f0c18dad5305 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:58 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-427c629e-6e8a-4ff3-8bf4-f0c18dad5305 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-quobyte-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:58 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-427c629e-6e8a-4ff3-8bf4-f0c18dad5305 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7" acquired by "delete_volume" :: waited 0.014s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:58 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[66809f85-8889-4ff1-97a9-83fe3a150ab7]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:32:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-427c629e-6e8a-4ff3-8bf4-f0c18dad5305 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:58 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a9744fdf-25a8-4782-bc71-ae7c97a9ba06 tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5.59df6c44-eae8-4569-a9b0-611a4d0d3c95 1G" returned: 0 in 0.424s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a9744fdf-25a8-4782-bc71-ae7c97a9ba06 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5.59df6c44-eae8-4569-a9b0-611a4d0d3c95 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:58 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5.59df6c44-eae8-4569-a9b0-611a4d0d3c95 Sep 03 11:32:58 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:58 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7 Sep 03 11:32:58 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:58 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:58 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a9744fdf-25a8-4782-bc71-ae7c97a9ba06 tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5.59df6c44-eae8-4569-a9b0-611a4d0d3c95" returned: 0 in 0.300s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:58 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-a9744fdf-25a8-4782-bc71-ae7c97a9ba06 tempest-ProjectReaderTests-1112694435 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5.59df6c44-eae8-4569-a9b0-611a4d0d3c95 is being set with open permissions: ugo+rw Sep 03 11:32:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a9744fdf-25a8-4782-bc71-ae7c97a9ba06 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5.59df6c44-eae8-4569-a9b0-611a4d0d3c95 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-427c629e-6e8a-4ff3-8bf4-f0c18dad5305 tempest-ProjectMemberTests-1830166883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7" returned: 0 in 0.373s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:58 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-427c629e-6e8a-4ff3-8bf4-f0c18dad5305 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:58 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5.59df6c44-eae8-4569-a9b0-611a4d0d3c95 Sep 03 11:32:58 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:58 devstack sudo[106898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7 Sep 03 11:32:58 devstack sudo[106898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:59 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a9744fdf-25a8-4782-bc71-ae7c97a9ba06 tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5.59df6c44-eae8-4569-a9b0-611a4d0d3c95" returned: 0 in 0.245s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:59 devstack sudo[106898]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-427c629e-6e8a-4ff3-8bf4-f0c18dad5305 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7" returned: 0 in 0.251s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:59 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-427c629e-6e8a-4ff3-8bf4-f0c18dad5305 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7" released by "delete_volume" :: held 0.687s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a9744fdf-25a8-4782-bc71-ae7c97a9ba06 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:59 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5.info Sep 03 11:32:59 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:59 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-427c629e-6e8a-4ff3-8bf4-f0c18dad5305 tempest-ProjectMemberTests-1830166883 None] Created reservations ['75398b26-414a-458c-8610-f306bf7e2540', '12f72581-16b3-4c79-bef0-8c058642305f', 'bade7f5c-41fe-419f-88a4-c9164fe0c4d4', '70368af3-946d-4460-a783-6c3ef602fbf6'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:32:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-427c629e-6e8a-4ff3-8bf4-f0c18dad5305 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:32:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-427c629e-6e8a-4ff3-8bf4-f0c18dad5305 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:32:59 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-427c629e-6e8a-4ff3-8bf4-f0c18dad5305 tempest-ProjectMemberTests-1830166883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:32:59 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-427c629e-6e8a-4ff3-8bf4-f0c18dad5305 tempest-ProjectMemberTests-1830166883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:32:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-427c629e-6e8a-4ff3-8bf4-f0c18dad5305 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-427c629e-6e8a-4ff3-8bf4-f0c18dad5305 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:59 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:32:59 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:59 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a9744fdf-25a8-4782-bc71-ae7c97a9ba06 tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5.info" returned: 0 in 0.257s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:59 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-a9744fdf-25a8-4782-bc71-ae7c97a9ba06 tempest-ProjectReaderTests-1112694435 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5.info is being set with open permissions: ugo+rw Sep 03 11:32:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a9744fdf-25a8-4782-bc71-ae7c97a9ba06 tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:32:59 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5.info Sep 03 11:32:59 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:32:59 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-427c629e-6e8a-4ff3-8bf4-f0c18dad5305 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.278s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:59 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-427c629e-6e8a-4ff3-8bf4-f0c18dad5305 tempest-ProjectMemberTests-1830166883 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:32:59 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-427c629e-6e8a-4ff3-8bf4-f0c18dad5305 tempest-ProjectMemberTests-1830166883 None] Deleted volume successfully. Sep 03 11:32:59 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-427c629e-6e8a-4ff3-8bf4-f0c18dad5305 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-9b2bc240-f5c0-44b9-bdb7-a63455c5fde7-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:32:59 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Sep 03 11:32:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a9744fdf-25a8-4782-bc71-ae7c97a9ba06 tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5.info" returned: 0 in 0.261s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:32:59 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a9744fdf-25a8-4782-bc71-ae7c97a9ba06 tempest-ProjectReaderTests-1112694435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.933s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:32:59 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-a9744fdf-25a8-4782-bc71-ae7c97a9ba06 tempest-ProjectReaderTests-1112694435 None] Create snapshot completed successfully Sep 03 11:32:59 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-06312591-5e55-4652-a317-4a20145e8ceb tempest-ProjectReaderTests-1112694435 None] Acquiring lock "cinder-59df6c44-eae8-4569-a9b0-611a4d0d3c95-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:59 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-06312591-5e55-4652-a317-4a20145e8ceb tempest-ProjectReaderTests-1112694435 None] Lock "cinder-59df6c44-eae8-4569-a9b0-611a4d0d3c95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:59 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-06312591-5e55-4652-a317-4a20145e8ceb tempest-ProjectReaderTests-1112694435 None] Acquiring lock "cinder-quobyte-a24762da-bc85-4e21-b9f8-6d42e78f62c5" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:59 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-06312591-5e55-4652-a317-4a20145e8ceb tempest-ProjectReaderTests-1112694435 None] Lock "cinder-quobyte-a24762da-bc85-4e21-b9f8-6d42e78f62c5" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:59 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-06312591-5e55-4652-a317-4a20145e8ceb tempest-ProjectReaderTests-1112694435 None] Acquiring lock "cinder-quobyte-59df6c44-eae8-4569-a9b0-611a4d0d3c95" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:32:59 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-06312591-5e55-4652-a317-4a20145e8ceb tempest-ProjectReaderTests-1112694435 None] Lock "cinder-quobyte-59df6c44-eae8-4569-a9b0-611a4d0d3c95" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:32:59 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-06312591-5e55-4652-a317-4a20145e8ceb tempest-ProjectReaderTests-1112694435 None] Deleting offline snapshot 59df6c44-eae8-4569-a9b0-611a4d0d3c95 of volume a24762da-bc85-4e21-b9f8-6d42e78f62c5 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-06312591-5e55-4652-a317-4a20145e8ceb tempest-ProjectReaderTests-1112694435 None] snapshot_file for this snap is: volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5.59df6c44-eae8-4569-a9b0-611a4d0d3c95 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb62080-66e3-4754-b4f9-84f7195fea4b]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-06312591-5e55-4652-a317-4a20145e8ceb tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5.59df6c44-eae8-4569-a9b0-611a4d0d3c95 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee29f970-2686-4fca-8e76-29b463e9d76b tempest-ProjectMemberTests-1830166883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ee29f970-2686-4fca-8e76-29b463e9d76b tempest-ProjectMemberTests-1830166883 None] Flow 'volume_create_manager' (2b55e93d-19c9-4319-8396-7809da94f7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ee29f970-2686-4fca-8e76-29b463e9d76b tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8963684-0a08-4cf9-9a51-e67ee10fda29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ee29f970-2686-4fca-8e76-29b463e9d76b tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8963684-0a08-4cf9-9a51-e67ee10fda29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1499993196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a56e2f3a-3a6b-448e-a39f-619a41f00823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e9ee545cbb4eb99d3a310cf4efc844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:33:00Z,use_quota=True,user_id='badece1d173b4e51add55b4a7c961a4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ee29f970-2686-4fca-8e76-29b463e9d76b tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01d84bcc-6095-449f-9dd8-09044c715f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ee29f970-2686-4fca-8e76-29b463e9d76b tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01d84bcc-6095-449f-9dd8-09044c715f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ee29f970-2686-4fca-8e76-29b463e9d76b tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eab20ae-671c-4f5e-add6-0bbbe27df896) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:00 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5.59df6c44-eae8-4569-a9b0-611a4d0d3c95 Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ee29f970-2686-4fca-8e76-29b463e9d76b tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1eab20ae-671c-4f5e-add6-0bbbe27df896) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a56e2f3a-3a6b-448e-a39f-619a41f00823', 'volume_name': 'volume-a56e2f3a-3a6b-448e-a39f-619a41f00823', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:00 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ee29f970-2686-4fca-8e76-29b463e9d76b tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (637237b6-314e-426e-8d3d-ad62d52e53f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ee29f970-2686-4fca-8e76-29b463e9d76b tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (637237b6-314e-426e-8d3d-ad62d52e53f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ee29f970-2686-4fca-8e76-29b463e9d76b tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eea24c37-19f6-40f6-8e89-426319d4efee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:00 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-ee29f970-2686-4fca-8e76-29b463e9d76b tempest-ProjectMemberTests-1830166883 None] Volume a56e2f3a-3a6b-448e-a39f-619a41f00823: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a56e2f3a-3a6b-448e-a39f-619a41f00823', 'volume_size': 1} Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ee29f970-2686-4fca-8e76-29b463e9d76b tempest-ProjectMemberTests-1830166883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ee29f970-2686-4fca-8e76-29b463e9d76b tempest-ProjectMemberTests-1830166883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ee29f970-2686-4fca-8e76-29b463e9d76b tempest-ProjectMemberTests-1830166883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1499993196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a56e2f3a-3a6b-448e-a39f-619a41f00823,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e9ee545cbb4eb99d3a310cf4efc844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:33:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:33:00Z,use_quota=True,user_id='badece1d173b4e51add55b4a7c961a4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-ee29f970-2686-4fca-8e76-29b463e9d76b tempest-ProjectMemberTests-1830166883 None] Creating volume a56e2f3a-3a6b-448e-a39f-619a41f00823 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ee29f970-2686-4fca-8e76-29b463e9d76b tempest-ProjectMemberTests-1830166883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ee29f970-2686-4fca-8e76-29b463e9d76b tempest-ProjectMemberTests-1830166883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ee29f970-2686-4fca-8e76-29b463e9d76b tempest-ProjectMemberTests-1830166883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ee29f970-2686-4fca-8e76-29b463e9d76b tempest-ProjectMemberTests-1830166883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ee29f970-2686-4fca-8e76-29b463e9d76b tempest-ProjectMemberTests-1830166883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ee29f970-2686-4fca-8e76-29b463e9d76b tempest-ProjectMemberTests-1830166883 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:33:00 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-ee29f970-2686-4fca-8e76-29b463e9d76b tempest-ProjectMemberTests-1830166883 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ee29f970-2686-4fca-8e76-29b463e9d76b tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:00 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823 1073741824 Sep 03 11:33:00 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:00 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-06312591-5e55-4652-a317-4a20145e8ceb tempest-ProjectReaderTests-1112694435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5.59df6c44-eae8-4569-a9b0-611a4d0d3c95" returned: 0 in 0.391s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-06312591-5e55-4652-a317-4a20145e8ceb tempest-ProjectReaderTests-1112694435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[155e2b1d-cf06-4da3-b587-e36a9fbd12c7]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-06312591-5e55-4652-a317-4a20145e8ceb tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:00 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5 Sep 03 11:33:00 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:00 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ee29f970-2686-4fca-8e76-29b463e9d76b tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823 1073741824" returned: 0 in 0.419s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ee29f970-2686-4fca-8e76-29b463e9d76b tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:00 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823 Sep 03 11:33:00 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:00 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-06312591-5e55-4652-a317-4a20145e8ceb tempest-ProjectReaderTests-1112694435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5" returned: 0 in 0.373s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-06312591-5e55-4652-a317-4a20145e8ceb tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5.59df6c44-eae8-4569-a9b0-611a4d0d3c95 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:00 devstack sudo[106929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5.59df6c44-eae8-4569-a9b0-611a4d0d3c95 Sep 03 11:33:00 devstack sudo[106929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:00 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-ee29f970-2686-4fca-8e76-29b463e9d76b tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823" returned: 0 in 0.251s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-ee29f970-2686-4fca-8e76-29b463e9d76b tempest-ProjectMemberTests-1830166883 None] <== create_volume: return (715ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-ee29f970-2686-4fca-8e76-29b463e9d76b tempest-ProjectMemberTests-1830166883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ee29f970-2686-4fca-8e76-29b463e9d76b tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eea24c37-19f6-40f6-8e89-426319d4efee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a56e2f3a-3a6b-448e-a39f-619a41f00823', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ee29f970-2686-4fca-8e76-29b463e9d76b tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bb167c6-0e2f-4161-97c1-ff369ebe3118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:00 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-ee29f970-2686-4fca-8e76-29b463e9d76b tempest-ProjectMemberTests-1830166883 None] Volume volume-a56e2f3a-3a6b-448e-a39f-619a41f00823 (a56e2f3a-3a6b-448e-a39f-619a41f00823): created successfully Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ee29f970-2686-4fca-8e76-29b463e9d76b tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bb167c6-0e2f-4161-97c1-ff369ebe3118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:00 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-ee29f970-2686-4fca-8e76-29b463e9d76b tempest-ProjectMemberTests-1830166883 None] Flow 'volume_create_manager' (2b55e93d-19c9-4319-8396-7809da94f7ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:33:00 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-ee29f970-2686-4fca-8e76-29b463e9d76b tempest-ProjectMemberTests-1830166883 None] Created volume successfully. Sep 03 11:33:01 devstack sudo[106929]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:01 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-06312591-5e55-4652-a317-4a20145e8ceb tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5.59df6c44-eae8-4569-a9b0-611a4d0d3c95" returned: 0 in 0.356s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:01 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-06312591-5e55-4652-a317-4a20145e8ceb tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5.59df6c44-eae8-4569-a9b0-611a4d0d3c95 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:01 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5.59df6c44-eae8-4569-a9b0-611a4d0d3c95 Sep 03 11:33:01 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:01 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9211c641-8c5c-4704-8f5f-2ad605253dd1 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:33:01 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9211c641-8c5c-4704-8f5f-2ad605253dd1 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:33:01 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-9211c641-8c5c-4704-8f5f-2ad605253dd1 tempest-ProjectMemberTests-1830166883 None] Creating offline snapshot 603b0fa2-1ba1-4315-8508-7b9270c09ba2 of volume a56e2f3a-3a6b-448e-a39f-619a41f00823 {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:33:01 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[927315a0-fce7-48bf-87a3-f7532d6f000d]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:33:01 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9211c641-8c5c-4704-8f5f-2ad605253dd1 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:01 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823 Sep 03 11:33:01 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:01 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:01 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-06312591-5e55-4652-a317-4a20145e8ceb tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5.59df6c44-eae8-4569-a9b0-611a4d0d3c95" returned: 0 in 0.260s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:01 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-06312591-5e55-4652-a317-4a20145e8ceb tempest-ProjectReaderTests-1112694435 None] Lock "cinder-quobyte-59df6c44-eae8-4569-a9b0-611a4d0d3c95" released by "_delete_snapshot" :: held 1.469s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:01 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-06312591-5e55-4652-a317-4a20145e8ceb tempest-ProjectReaderTests-1112694435 None] Lock "cinder-quobyte-a24762da-bc85-4e21-b9f8-6d42e78f62c5" released by "delete_snapshot" :: held 1.490s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:01 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-06312591-5e55-4652-a317-4a20145e8ceb tempest-ProjectReaderTests-1112694435 None] Created reservations ['aee3df80-31a1-4fd3-b249-84e1d8037acf', 'b9f808c5-4906-460c-bd25-7e69df473c97', 'cbd5fcdc-24c2-4a68-8bb9-fc2bc14c2a07', 'c491a615-a45e-48cc-9a50-2c5b03ef4a99'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:33:01 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-06312591-5e55-4652-a317-4a20145e8ceb tempest-ProjectReaderTests-1112694435 None] Delete snapshot completed successfully. Sep 03 11:33:01 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-06312591-5e55-4652-a317-4a20145e8ceb tempest-ProjectReaderTests-1112694435 None] Lock "cinder-59df6c44-eae8-4569-a9b0-611a4d0d3c95-delete_snapshot" released by "delete_snapshot" :: held 1.638s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:01 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:01 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9211c641-8c5c-4704-8f5f-2ad605253dd1 tempest-ProjectMemberTests-1830166883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823" returned: 0 in 0.365s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:01 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9211c641-8c5c-4704-8f5f-2ad605253dd1 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823.603b0fa2-1ba1-4315-8508-7b9270c09ba2 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:01 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823.603b0fa2-1ba1-4315-8508-7b9270c09ba2 1G Sep 03 11:33:01 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:02 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9211c641-8c5c-4704-8f5f-2ad605253dd1 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823.603b0fa2-1ba1-4315-8508-7b9270c09ba2 1G" returned: 0 in 0.368s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9211c641-8c5c-4704-8f5f-2ad605253dd1 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a56e2f3a-3a6b-448e-a39f-619a41f00823 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823.603b0fa2-1ba1-4315-8508-7b9270c09ba2 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:02 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a56e2f3a-3a6b-448e-a39f-619a41f00823 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823.603b0fa2-1ba1-4315-8508-7b9270c09ba2 Sep 03 11:33:02 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:02 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d79a4ddb-c92e-4a52-9d52-83eab277ad9a tempest-ProjectReaderTests-1112694435 None] Acquiring lock "cinder-a24762da-bc85-4e21-b9f8-6d42e78f62c5-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:33:02 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d79a4ddb-c92e-4a52-9d52-83eab277ad9a tempest-ProjectReaderTests-1112694435 None] Lock "cinder-a24762da-bc85-4e21-b9f8-6d42e78f62c5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:33:02 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d79a4ddb-c92e-4a52-9d52-83eab277ad9a tempest-ProjectReaderTests-1112694435 None] Acquiring lock "cinder-quobyte-a24762da-bc85-4e21-b9f8-6d42e78f62c5" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:33:02 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d79a4ddb-c92e-4a52-9d52-83eab277ad9a tempest-ProjectReaderTests-1112694435 None] Lock "cinder-quobyte-a24762da-bc85-4e21-b9f8-6d42e78f62c5" acquired by "delete_volume" :: waited 0.018s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:33:02 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[be85804c-d6d0-4ba5-bf23-4519a22e8a1a]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:33:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d79a4ddb-c92e-4a52-9d52-83eab277ad9a tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:02 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9211c641-8c5c-4704-8f5f-2ad605253dd1 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a56e2f3a-3a6b-448e-a39f-619a41f00823 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823.603b0fa2-1ba1-4315-8508-7b9270c09ba2" returned: 0 in 0.302s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:02 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-9211c641-8c5c-4704-8f5f-2ad605253dd1 tempest-ProjectMemberTests-1830166883 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823.603b0fa2-1ba1-4315-8508-7b9270c09ba2 is being set with open permissions: ugo+rw Sep 03 11:33:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9211c641-8c5c-4704-8f5f-2ad605253dd1 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823.603b0fa2-1ba1-4315-8508-7b9270c09ba2 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:02 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5 Sep 03 11:33:02 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:02 devstack sudo[106955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823.603b0fa2-1ba1-4315-8508-7b9270c09ba2 Sep 03 11:33:02 devstack sudo[106955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:02 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:02 devstack sudo[106955]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9211c641-8c5c-4704-8f5f-2ad605253dd1 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823.603b0fa2-1ba1-4315-8508-7b9270c09ba2" returned: 0 in 0.251s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d79a4ddb-c92e-4a52-9d52-83eab277ad9a tempest-ProjectReaderTests-1112694435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5" returned: 0 in 0.368s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d79a4ddb-c92e-4a52-9d52-83eab277ad9a tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:02 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5 Sep 03 11:33:02 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9211c641-8c5c-4704-8f5f-2ad605253dd1 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:02 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823.info Sep 03 11:33:02 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:02 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d79a4ddb-c92e-4a52-9d52-83eab277ad9a tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a24762da-bc85-4e21-b9f8-6d42e78f62c5" returned: 0 in 0.247s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:02 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d79a4ddb-c92e-4a52-9d52-83eab277ad9a tempest-ProjectReaderTests-1112694435 None] Lock "cinder-quobyte-a24762da-bc85-4e21-b9f8-6d42e78f62c5" released by "delete_volume" :: held 0.676s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:02 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9211c641-8c5c-4704-8f5f-2ad605253dd1 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823.info" returned: 0 in 0.265s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:02 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-9211c641-8c5c-4704-8f5f-2ad605253dd1 tempest-ProjectMemberTests-1830166883 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823.info is being set with open permissions: ugo+rw Sep 03 11:33:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9211c641-8c5c-4704-8f5f-2ad605253dd1 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:02 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-d79a4ddb-c92e-4a52-9d52-83eab277ad9a tempest-ProjectReaderTests-1112694435 None] Created reservations ['0fda05ed-cdea-4eb2-8a6e-5e24dcc0a22d', '1b33741c-8f2a-4fa4-b99c-6db971434fcc', '5ec06eb1-fe9c-4568-9d42-38a8024813dc', 'e96dcfe4-40cc-4886-87ba-3104ed198c28'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:33:02 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823.info Sep 03 11:33:02 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d79a4ddb-c92e-4a52-9d52-83eab277ad9a tempest-ProjectReaderTests-1112694435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:33:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d79a4ddb-c92e-4a52-9d52-83eab277ad9a tempest-ProjectReaderTests-1112694435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:33:02 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d79a4ddb-c92e-4a52-9d52-83eab277ad9a tempest-ProjectReaderTests-1112694435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:33:02 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d79a4ddb-c92e-4a52-9d52-83eab277ad9a tempest-ProjectReaderTests-1112694435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:33:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d79a4ddb-c92e-4a52-9d52-83eab277ad9a tempest-ProjectReaderTests-1112694435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:33:02 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d79a4ddb-c92e-4a52-9d52-83eab277ad9a tempest-ProjectReaderTests-1112694435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:03 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:33:03 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:03 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9211c641-8c5c-4704-8f5f-2ad605253dd1 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823.info" returned: 0 in 0.253s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9211c641-8c5c-4704-8f5f-2ad605253dd1 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.904s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:33:03 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-9211c641-8c5c-4704-8f5f-2ad605253dd1 tempest-ProjectMemberTests-1830166883 None] Create snapshot completed successfully Sep 03 11:33:03 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d79a4ddb-c92e-4a52-9d52-83eab277ad9a tempest-ProjectReaderTests-1112694435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.255s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:03 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-d79a4ddb-c92e-4a52-9d52-83eab277ad9a tempest-ProjectReaderTests-1112694435 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:33:03 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-d79a4ddb-c92e-4a52-9d52-83eab277ad9a tempest-ProjectReaderTests-1112694435 None] Deleted volume successfully. Sep 03 11:33:03 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-d79a4ddb-c92e-4a52-9d52-83eab277ad9a tempest-ProjectReaderTests-1112694435 None] Lock "cinder-a24762da-bc85-4e21-b9f8-6d42e78f62c5-delete_volume" released by "delete_volume" :: held 1.148s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:03 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a9b3f492-7d97-4e90-b9b1-12ff74e03044 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-603b0fa2-1ba1-4315-8508-7b9270c09ba2-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:33:03 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a9b3f492-7d97-4e90-b9b1-12ff74e03044 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-603b0fa2-1ba1-4315-8508-7b9270c09ba2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:33:03 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a9b3f492-7d97-4e90-b9b1-12ff74e03044 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-quobyte-a56e2f3a-3a6b-448e-a39f-619a41f00823" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:33:03 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a9b3f492-7d97-4e90-b9b1-12ff74e03044 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-a56e2f3a-3a6b-448e-a39f-619a41f00823" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:33:03 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a9b3f492-7d97-4e90-b9b1-12ff74e03044 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-quobyte-603b0fa2-1ba1-4315-8508-7b9270c09ba2" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:33:03 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a9b3f492-7d97-4e90-b9b1-12ff74e03044 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-603b0fa2-1ba1-4315-8508-7b9270c09ba2" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:33:03 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-a9b3f492-7d97-4e90-b9b1-12ff74e03044 tempest-ProjectMemberTests-1830166883 None] Deleting offline snapshot 603b0fa2-1ba1-4315-8508-7b9270c09ba2 of volume a56e2f3a-3a6b-448e-a39f-619a41f00823 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:33:03 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-a9b3f492-7d97-4e90-b9b1-12ff74e03044 tempest-ProjectMemberTests-1830166883 None] snapshot_file for this snap is: volume-a56e2f3a-3a6b-448e-a39f-619a41f00823.603b0fa2-1ba1-4315-8508-7b9270c09ba2 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:33:03 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[26307202-257e-4e69-a5f6-97447abd4a41]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:33:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a9b3f492-7d97-4e90-b9b1-12ff74e03044 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823.603b0fa2-1ba1-4315-8508-7b9270c09ba2 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:03 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823.603b0fa2-1ba1-4315-8508-7b9270c09ba2 Sep 03 11:33:03 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:03 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a9b3f492-7d97-4e90-b9b1-12ff74e03044 tempest-ProjectMemberTests-1830166883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823.603b0fa2-1ba1-4315-8508-7b9270c09ba2" returned: 0 in 0.370s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:03 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-a9b3f492-7d97-4e90-b9b1-12ff74e03044 tempest-ProjectMemberTests-1830166883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a56e2f3a-3a6b-448e-a39f-619a41f00823(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:33:03 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadc2965-c506-485b-8f64-3f1cf12be8b4]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:33:03 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a9b3f492-7d97-4e90-b9b1-12ff74e03044 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:04 devstack sudo[106980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823 Sep 03 11:33:04 devstack sudo[106980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:04 devstack sudo[106980]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a9b3f492-7d97-4e90-b9b1-12ff74e03044 tempest-ProjectMemberTests-1830166883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823" returned: 0 in 0.371s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a9b3f492-7d97-4e90-b9b1-12ff74e03044 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823.603b0fa2-1ba1-4315-8508-7b9270c09ba2 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:04 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823.603b0fa2-1ba1-4315-8508-7b9270c09ba2 Sep 03 11:33:04 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:04 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a9b3f492-7d97-4e90-b9b1-12ff74e03044 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823.603b0fa2-1ba1-4315-8508-7b9270c09ba2" returned: 0 in 0.390s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a9b3f492-7d97-4e90-b9b1-12ff74e03044 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823.603b0fa2-1ba1-4315-8508-7b9270c09ba2 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:04 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823.603b0fa2-1ba1-4315-8508-7b9270c09ba2 Sep 03 11:33:04 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:04 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:04 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a9b3f492-7d97-4e90-b9b1-12ff74e03044 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823.603b0fa2-1ba1-4315-8508-7b9270c09ba2" returned: 0 in 0.276s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:04 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a9b3f492-7d97-4e90-b9b1-12ff74e03044 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-603b0fa2-1ba1-4315-8508-7b9270c09ba2" released by "_delete_snapshot" :: held 1.513s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:04 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a9b3f492-7d97-4e90-b9b1-12ff74e03044 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-a56e2f3a-3a6b-448e-a39f-619a41f00823" released by "delete_snapshot" :: held 1.539s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:05 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-a9b3f492-7d97-4e90-b9b1-12ff74e03044 tempest-ProjectMemberTests-1830166883 None] Created reservations ['e311347c-4d2b-4fee-8d75-e1caab301111', 'e48970a7-f952-4bf3-87bf-890678e7de38', 'c4b323a0-fe6a-4adb-9ff8-91237c0ef4a6', '709589fc-9b43-44e4-a254-b476789c3936'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:33:05 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-a9b3f492-7d97-4e90-b9b1-12ff74e03044 tempest-ProjectMemberTests-1830166883 None] Delete snapshot completed successfully. Sep 03 11:33:05 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a9b3f492-7d97-4e90-b9b1-12ff74e03044 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-603b0fa2-1ba1-4315-8508-7b9270c09ba2-delete_snapshot" released by "delete_snapshot" :: held 1.685s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:05 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-34e670cc-2500-47ee-9195-e2f1fc5f29da tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-a56e2f3a-3a6b-448e-a39f-619a41f00823-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:33:05 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-34e670cc-2500-47ee-9195-e2f1fc5f29da tempest-ProjectMemberTests-1830166883 None] Lock "cinder-a56e2f3a-3a6b-448e-a39f-619a41f00823-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:33:05 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-34e670cc-2500-47ee-9195-e2f1fc5f29da tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-quobyte-a56e2f3a-3a6b-448e-a39f-619a41f00823" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:33:05 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-34e670cc-2500-47ee-9195-e2f1fc5f29da tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-a56e2f3a-3a6b-448e-a39f-619a41f00823" acquired by "delete_volume" :: waited 0.022s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:33:05 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ce57191-78f4-4e79-9612-690d8ccbc4d8]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:33:05 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-34e670cc-2500-47ee-9195-e2f1fc5f29da tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:05 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823 Sep 03 11:33:05 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:06 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-34e670cc-2500-47ee-9195-e2f1fc5f29da tempest-ProjectMemberTests-1830166883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823" returned: 0 in 0.377s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-34e670cc-2500-47ee-9195-e2f1fc5f29da tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:06 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823 Sep 03 11:33:06 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:06 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-34e670cc-2500-47ee-9195-e2f1fc5f29da tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-a56e2f3a-3a6b-448e-a39f-619a41f00823" returned: 0 in 0.251s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:06 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-34e670cc-2500-47ee-9195-e2f1fc5f29da tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-a56e2f3a-3a6b-448e-a39f-619a41f00823" released by "delete_volume" :: held 0.698s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:06 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-34e670cc-2500-47ee-9195-e2f1fc5f29da tempest-ProjectMemberTests-1830166883 None] Created reservations ['53644ebb-ff9f-489b-a718-d9332461f753', 'acc5fb7c-891b-4f92-91b6-b1018a8cfe2e', 'c2978bb7-8297-4e85-8444-2681140de2b1', '2060389e-3f54-4aa8-b60d-0bf09533faac'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:33:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-34e670cc-2500-47ee-9195-e2f1fc5f29da tempest-ProjectMemberTests-1830166883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:33:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-34e670cc-2500-47ee-9195-e2f1fc5f29da tempest-ProjectMemberTests-1830166883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:33:06 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-34e670cc-2500-47ee-9195-e2f1fc5f29da tempest-ProjectMemberTests-1830166883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:33:06 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-34e670cc-2500-47ee-9195-e2f1fc5f29da tempest-ProjectMemberTests-1830166883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:33:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-34e670cc-2500-47ee-9195-e2f1fc5f29da tempest-ProjectMemberTests-1830166883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:33:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-34e670cc-2500-47ee-9195-e2f1fc5f29da tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:06 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:33:06 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:06 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:06 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-34e670cc-2500-47ee-9195-e2f1fc5f29da tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.252s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:06 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-34e670cc-2500-47ee-9195-e2f1fc5f29da tempest-ProjectMemberTests-1830166883 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:33:06 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-34e670cc-2500-47ee-9195-e2f1fc5f29da tempest-ProjectMemberTests-1830166883 None] Deleted volume successfully. Sep 03 11:33:06 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-34e670cc-2500-47ee-9195-e2f1fc5f29da tempest-ProjectMemberTests-1830166883 None] Lock "cinder-a56e2f3a-3a6b-448e-a39f-619a41f00823-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:07 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-74e55716-9e11-4123-be85-fb8ca5d57cc6 tempest-ProjectMemberTests-1830166883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:33:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-74e55716-9e11-4123-be85-fb8ca5d57cc6 tempest-ProjectMemberTests-1830166883 None] Flow 'volume_create_manager' (87f4a941-0b1e-4b0e-8683-e6c0bf3adc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:33:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-74e55716-9e11-4123-be85-fb8ca5d57cc6 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f944072-7245-4eb9-85b9-5539ab0c1b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-74e55716-9e11-4123-be85-fb8ca5d57cc6 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f944072-7245-4eb9-85b9-5539ab0c1b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1994738245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd85949-0469-40a3-820b-a22887ca94f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e9ee545cbb4eb99d3a310cf4efc844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:33:07Z,use_quota=True,user_id='badece1d173b4e51add55b4a7c961a4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-74e55716-9e11-4123-be85-fb8ca5d57cc6 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5bb5b1d-4987-4197-97c6-9b8971c5372f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-74e55716-9e11-4123-be85-fb8ca5d57cc6 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f5bb5b1d-4987-4197-97c6-9b8971c5372f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-74e55716-9e11-4123-be85-fb8ca5d57cc6 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e809ea1-cdb5-4bf8-a1fe-d2d572737120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-74e55716-9e11-4123-be85-fb8ca5d57cc6 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e809ea1-cdb5-4bf8-a1fe-d2d572737120) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fd85949-0469-40a3-820b-a22887ca94f5', 'volume_name': 'volume-2fd85949-0469-40a3-820b-a22887ca94f5', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-74e55716-9e11-4123-be85-fb8ca5d57cc6 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40069d28-50b7-466b-9977-136a9e87fa0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-74e55716-9e11-4123-be85-fb8ca5d57cc6 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40069d28-50b7-466b-9977-136a9e87fa0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:07 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-74e55716-9e11-4123-be85-fb8ca5d57cc6 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a89111ba-0f9a-42e7-83fc-f9914fe783c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:07 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-74e55716-9e11-4123-be85-fb8ca5d57cc6 tempest-ProjectMemberTests-1830166883 None] Volume 2fd85949-0469-40a3-820b-a22887ca94f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fd85949-0469-40a3-820b-a22887ca94f5', 'volume_size': 1} Sep 03 11:33:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-74e55716-9e11-4123-be85-fb8ca5d57cc6 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:33:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-74e55716-9e11-4123-be85-fb8ca5d57cc6 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:33:07 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-74e55716-9e11-4123-be85-fb8ca5d57cc6 tempest-ProjectMemberTests-1830166883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1994738245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fd85949-0469-40a3-820b-a22887ca94f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e9ee545cbb4eb99d3a310cf4efc844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:33:07Z,use_quota=True,user_id='badece1d173b4e51add55b4a7c961a4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:33:07 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-74e55716-9e11-4123-be85-fb8ca5d57cc6 tempest-ProjectMemberTests-1830166883 None] Creating volume 2fd85949-0469-40a3-820b-a22887ca94f5 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:33:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-74e55716-9e11-4123-be85-fb8ca5d57cc6 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:33:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-74e55716-9e11-4123-be85-fb8ca5d57cc6 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:33:07 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-74e55716-9e11-4123-be85-fb8ca5d57cc6 tempest-ProjectMemberTests-1830166883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:33:07 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-74e55716-9e11-4123-be85-fb8ca5d57cc6 tempest-ProjectMemberTests-1830166883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:33:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-74e55716-9e11-4123-be85-fb8ca5d57cc6 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:33:07 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-74e55716-9e11-4123-be85-fb8ca5d57cc6 tempest-ProjectMemberTests-1830166883 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:33:07 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-74e55716-9e11-4123-be85-fb8ca5d57cc6 tempest-ProjectMemberTests-1830166883 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:33:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-74e55716-9e11-4123-be85-fb8ca5d57cc6 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:07 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5 1073741824 Sep 03 11:33:07 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:07 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-74e55716-9e11-4123-be85-fb8ca5d57cc6 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5 1073741824" returned: 0 in 0.386s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:07 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-74e55716-9e11-4123-be85-fb8ca5d57cc6 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:07 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5 Sep 03 11:33:07 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:08 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-74e55716-9e11-4123-be85-fb8ca5d57cc6 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5" returned: 0 in 0.245s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-74e55716-9e11-4123-be85-fb8ca5d57cc6 tempest-ProjectMemberTests-1830166883 None] <== create_volume: return (709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:33:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-74e55716-9e11-4123-be85-fb8ca5d57cc6 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:33:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-74e55716-9e11-4123-be85-fb8ca5d57cc6 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a89111ba-0f9a-42e7-83fc-f9914fe783c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fd85949-0469-40a3-820b-a22887ca94f5', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-74e55716-9e11-4123-be85-fb8ca5d57cc6 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9454f116-088c-4665-942b-244adafb829a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:08 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-74e55716-9e11-4123-be85-fb8ca5d57cc6 tempest-ProjectMemberTests-1830166883 None] Volume volume-2fd85949-0469-40a3-820b-a22887ca94f5 (2fd85949-0469-40a3-820b-a22887ca94f5): created successfully Sep 03 11:33:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-74e55716-9e11-4123-be85-fb8ca5d57cc6 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9454f116-088c-4665-942b-244adafb829a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:08 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-74e55716-9e11-4123-be85-fb8ca5d57cc6 tempest-ProjectMemberTests-1830166883 None] Flow 'volume_create_manager' (87f4a941-0b1e-4b0e-8683-e6c0bf3adc11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:33:08 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-74e55716-9e11-4123-be85-fb8ca5d57cc6 tempest-ProjectMemberTests-1830166883 None] Created volume successfully. Sep 03 11:33:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-19431087-37b5-4bf5-99c2-f7bfa614af7d tempest-ProjectMemberTests-1830166883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:33:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-19431087-37b5-4bf5-99c2-f7bfa614af7d tempest-ProjectMemberTests-1830166883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:33:08 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-19431087-37b5-4bf5-99c2-f7bfa614af7d tempest-ProjectMemberTests-1830166883 None] Creating offline snapshot 8663fa07-2dbb-4c83-901a-80acb7268dd5 of volume 2fd85949-0469-40a3-820b-a22887ca94f5 {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:33:08 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d741df-b6df-4b1c-9ee8-4582e0a5dcc0]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:33:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-19431087-37b5-4bf5-99c2-f7bfa614af7d tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:08 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5 Sep 03 11:33:08 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:08 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-19431087-37b5-4bf5-99c2-f7bfa614af7d tempest-ProjectMemberTests-1830166883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5" returned: 0 in 0.376s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:08 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-19431087-37b5-4bf5-99c2-f7bfa614af7d tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5.8663fa07-2dbb-4c83-901a-80acb7268dd5 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:08 devstack sudo[107020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5.8663fa07-2dbb-4c83-901a-80acb7268dd5 1G Sep 03 11:33:08 devstack sudo[107020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:09 devstack sudo[107020]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-19431087-37b5-4bf5-99c2-f7bfa614af7d tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5.8663fa07-2dbb-4c83-901a-80acb7268dd5 1G" returned: 0 in 0.361s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-19431087-37b5-4bf5-99c2-f7bfa614af7d tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fd85949-0469-40a3-820b-a22887ca94f5 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5.8663fa07-2dbb-4c83-901a-80acb7268dd5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:09 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fd85949-0469-40a3-820b-a22887ca94f5 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5.8663fa07-2dbb-4c83-901a-80acb7268dd5 Sep 03 11:33:09 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:09 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-19431087-37b5-4bf5-99c2-f7bfa614af7d tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2fd85949-0469-40a3-820b-a22887ca94f5 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5.8663fa07-2dbb-4c83-901a-80acb7268dd5" returned: 0 in 0.276s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:09 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-19431087-37b5-4bf5-99c2-f7bfa614af7d tempest-ProjectMemberTests-1830166883 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5.8663fa07-2dbb-4c83-901a-80acb7268dd5 is being set with open permissions: ugo+rw Sep 03 11:33:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-19431087-37b5-4bf5-99c2-f7bfa614af7d tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5.8663fa07-2dbb-4c83-901a-80acb7268dd5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:09 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5.8663fa07-2dbb-4c83-901a-80acb7268dd5 Sep 03 11:33:09 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:09 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-19431087-37b5-4bf5-99c2-f7bfa614af7d tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5.8663fa07-2dbb-4c83-901a-80acb7268dd5" returned: 0 in 0.235s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:09 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-19431087-37b5-4bf5-99c2-f7bfa614af7d tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:09 devstack sudo[107033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5.info Sep 03 11:33:09 devstack sudo[107033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:10 devstack sudo[107033]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-19431087-37b5-4bf5-99c2-f7bfa614af7d tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5.info" returned: 0 in 0.258s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:10 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-19431087-37b5-4bf5-99c2-f7bfa614af7d tempest-ProjectMemberTests-1830166883 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5.info is being set with open permissions: ugo+rw Sep 03 11:33:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-19431087-37b5-4bf5-99c2-f7bfa614af7d tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:10 devstack sudo[107036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5.info Sep 03 11:33:10 devstack sudo[107036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:10 devstack sudo[107036]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-19431087-37b5-4bf5-99c2-f7bfa614af7d tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5.info" returned: 0 in 0.254s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-19431087-37b5-4bf5-99c2-f7bfa614af7d tempest-ProjectMemberTests-1830166883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.851s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:33:10 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-19431087-37b5-4bf5-99c2-f7bfa614af7d tempest-ProjectMemberTests-1830166883 None] Create snapshot completed successfully Sep 03 11:33:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1fdb80d5-fbfe-4bc7-a395-f55dbcfcea06 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-8663fa07-2dbb-4c83-901a-80acb7268dd5-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:33:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1fdb80d5-fbfe-4bc7-a395-f55dbcfcea06 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-8663fa07-2dbb-4c83-901a-80acb7268dd5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:33:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1fdb80d5-fbfe-4bc7-a395-f55dbcfcea06 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-quobyte-2fd85949-0469-40a3-820b-a22887ca94f5" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:33:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1fdb80d5-fbfe-4bc7-a395-f55dbcfcea06 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-2fd85949-0469-40a3-820b-a22887ca94f5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:33:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1fdb80d5-fbfe-4bc7-a395-f55dbcfcea06 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-quobyte-8663fa07-2dbb-4c83-901a-80acb7268dd5" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:33:10 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1fdb80d5-fbfe-4bc7-a395-f55dbcfcea06 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-8663fa07-2dbb-4c83-901a-80acb7268dd5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:33:10 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-1fdb80d5-fbfe-4bc7-a395-f55dbcfcea06 tempest-ProjectMemberTests-1830166883 None] Deleting offline snapshot 8663fa07-2dbb-4c83-901a-80acb7268dd5 of volume 2fd85949-0469-40a3-820b-a22887ca94f5 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:33:10 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-1fdb80d5-fbfe-4bc7-a395-f55dbcfcea06 tempest-ProjectMemberTests-1830166883 None] snapshot_file for this snap is: volume-2fd85949-0469-40a3-820b-a22887ca94f5.8663fa07-2dbb-4c83-901a-80acb7268dd5 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:33:10 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fb31de-a0ff-4c61-ac86-8152d1860d7b]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:33:10 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1fdb80d5-fbfe-4bc7-a395-f55dbcfcea06 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5.8663fa07-2dbb-4c83-901a-80acb7268dd5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:10 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5.8663fa07-2dbb-4c83-901a-80acb7268dd5 Sep 03 11:33:10 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:11 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1fdb80d5-fbfe-4bc7-a395-f55dbcfcea06 tempest-ProjectMemberTests-1830166883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5.8663fa07-2dbb-4c83-901a-80acb7268dd5" returned: 0 in 0.350s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:11 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-1fdb80d5-fbfe-4bc7-a395-f55dbcfcea06 tempest-ProjectMemberTests-1830166883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2fd85949-0469-40a3-820b-a22887ca94f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:33:11 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[87b3bdb5-4ff5-49a0-af7d-199457861fe8]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:33:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1fdb80d5-fbfe-4bc7-a395-f55dbcfcea06 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:11 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5 Sep 03 11:33:11 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:11 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1fdb80d5-fbfe-4bc7-a395-f55dbcfcea06 tempest-ProjectMemberTests-1830166883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5" returned: 0 in 0.347s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1fdb80d5-fbfe-4bc7-a395-f55dbcfcea06 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5.8663fa07-2dbb-4c83-901a-80acb7268dd5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:11 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5.8663fa07-2dbb-4c83-901a-80acb7268dd5 Sep 03 11:33:11 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:11 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1fdb80d5-fbfe-4bc7-a395-f55dbcfcea06 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5.8663fa07-2dbb-4c83-901a-80acb7268dd5" returned: 0 in 0.337s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:11 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1fdb80d5-fbfe-4bc7-a395-f55dbcfcea06 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5.8663fa07-2dbb-4c83-901a-80acb7268dd5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:11 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5.8663fa07-2dbb-4c83-901a-80acb7268dd5 Sep 03 11:33:11 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:12 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-1fdb80d5-fbfe-4bc7-a395-f55dbcfcea06 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5.8663fa07-2dbb-4c83-901a-80acb7268dd5" returned: 0 in 0.260s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:12 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1fdb80d5-fbfe-4bc7-a395-f55dbcfcea06 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-8663fa07-2dbb-4c83-901a-80acb7268dd5" released by "_delete_snapshot" :: held 1.382s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:12 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1fdb80d5-fbfe-4bc7-a395-f55dbcfcea06 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-2fd85949-0469-40a3-820b-a22887ca94f5" released by "delete_snapshot" :: held 1.408s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:12 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-1fdb80d5-fbfe-4bc7-a395-f55dbcfcea06 tempest-ProjectMemberTests-1830166883 None] Created reservations ['633d5aab-1e67-48e0-817a-0135b4e86fbb', '1f862684-4efb-499f-98c4-957cf8f94c34', '0e45335b-c8e3-4610-9d0a-a955a55ebf90', 'df207e39-d40d-41f5-8806-cde45b5f3759'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:33:12 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-1fdb80d5-fbfe-4bc7-a395-f55dbcfcea06 tempest-ProjectMemberTests-1830166883 None] Delete snapshot completed successfully. Sep 03 11:33:12 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-1fdb80d5-fbfe-4bc7-a395-f55dbcfcea06 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-8663fa07-2dbb-4c83-901a-80acb7268dd5-delete_snapshot" released by "delete_snapshot" :: held 1.566s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:12 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fea6dbe4-c29c-42a2-9b84-a689f93d423c tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-2fd85949-0469-40a3-820b-a22887ca94f5-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:33:12 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fea6dbe4-c29c-42a2-9b84-a689f93d423c tempest-ProjectMemberTests-1830166883 None] Lock "cinder-2fd85949-0469-40a3-820b-a22887ca94f5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:33:12 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fea6dbe4-c29c-42a2-9b84-a689f93d423c tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-quobyte-2fd85949-0469-40a3-820b-a22887ca94f5" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:33:12 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fea6dbe4-c29c-42a2-9b84-a689f93d423c tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-2fd85949-0469-40a3-820b-a22887ca94f5" acquired by "delete_volume" :: waited 0.015s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:33:12 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[85e48017-e0a2-4926-bbe4-0c9c915e97f4]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:33:12 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fea6dbe4-c29c-42a2-9b84-a689f93d423c tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:13 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5 Sep 03 11:33:13 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:13 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fea6dbe4-c29c-42a2-9b84-a689f93d423c tempest-ProjectMemberTests-1830166883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5" returned: 0 in 0.386s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fea6dbe4-c29c-42a2-9b84-a689f93d423c tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:13 devstack sudo[107062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5 Sep 03 11:33:13 devstack sudo[107062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:13 devstack sudo[107062]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fea6dbe4-c29c-42a2-9b84-a689f93d423c tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-2fd85949-0469-40a3-820b-a22887ca94f5" returned: 0 in 0.259s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:13 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fea6dbe4-c29c-42a2-9b84-a689f93d423c tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-2fd85949-0469-40a3-820b-a22887ca94f5" released by "delete_volume" :: held 0.723s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:13 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-fea6dbe4-c29c-42a2-9b84-a689f93d423c tempest-ProjectMemberTests-1830166883 None] Created reservations ['5e07e963-f2f0-4dd6-9ac9-5c6627415ad3', '9e390fc9-a397-4d4c-a05a-25cccabdf95f', '5ee7c253-5f5a-41e8-afda-7331389268bd', 'cad21bbf-0d0a-4d51-80ca-cb5b45806827'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:33:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-fea6dbe4-c29c-42a2-9b84-a689f93d423c tempest-ProjectMemberTests-1830166883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:33:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-fea6dbe4-c29c-42a2-9b84-a689f93d423c tempest-ProjectMemberTests-1830166883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:33:13 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-fea6dbe4-c29c-42a2-9b84-a689f93d423c tempest-ProjectMemberTests-1830166883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:33:13 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-fea6dbe4-c29c-42a2-9b84-a689f93d423c tempest-ProjectMemberTests-1830166883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:33:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-fea6dbe4-c29c-42a2-9b84-a689f93d423c tempest-ProjectMemberTests-1830166883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:33:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fea6dbe4-c29c-42a2-9b84-a689f93d423c tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:13 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:33:13 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:13 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:13 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-fea6dbe4-c29c-42a2-9b84-a689f93d423c tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.261s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:13 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-fea6dbe4-c29c-42a2-9b84-a689f93d423c tempest-ProjectMemberTests-1830166883 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:33:13 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-fea6dbe4-c29c-42a2-9b84-a689f93d423c tempest-ProjectMemberTests-1830166883 None] Deleted volume successfully. Sep 03 11:33:13 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-fea6dbe4-c29c-42a2-9b84-a689f93d423c tempest-ProjectMemberTests-1830166883 None] Lock "cinder-2fd85949-0469-40a3-820b-a22887ca94f5-delete_volume" released by "delete_volume" :: held 1.198s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:14 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-99e6002f-2c95-4428-8fde-1b0aacdca813 tempest-ProjectMemberTests-1830166883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:33:14 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-99e6002f-2c95-4428-8fde-1b0aacdca813 tempest-ProjectMemberTests-1830166883 None] Flow 'volume_create_manager' (ac85bcd6-58dd-4641-a787-eb6b0ebfd827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:33:14 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-99e6002f-2c95-4428-8fde-1b0aacdca813 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d523056-5e21-44ef-966e-878666b65a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:14 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-99e6002f-2c95-4428-8fde-1b0aacdca813 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d523056-5e21-44ef-966e-878666b65a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1693103156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46da1ef7-2232-47a7-8769-d59d6139ef47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e9ee545cbb4eb99d3a310cf4efc844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:33:14Z,use_quota=True,user_id='badece1d173b4e51add55b4a7c961a4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:14 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-99e6002f-2c95-4428-8fde-1b0aacdca813 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (398888c4-49ec-4a19-ae2c-59723fcf6318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:14 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-99e6002f-2c95-4428-8fde-1b0aacdca813 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (398888c4-49ec-4a19-ae2c-59723fcf6318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:14 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-99e6002f-2c95-4428-8fde-1b0aacdca813 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdf09f6a-b82f-4799-a44f-8c61203233ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:14 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-99e6002f-2c95-4428-8fde-1b0aacdca813 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdf09f6a-b82f-4799-a44f-8c61203233ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46da1ef7-2232-47a7-8769-d59d6139ef47', 'volume_name': 'volume-46da1ef7-2232-47a7-8769-d59d6139ef47', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:14 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-99e6002f-2c95-4428-8fde-1b0aacdca813 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c51e72bc-1266-4b26-8130-0ce697de524f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:14 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-99e6002f-2c95-4428-8fde-1b0aacdca813 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c51e72bc-1266-4b26-8130-0ce697de524f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:14 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-99e6002f-2c95-4428-8fde-1b0aacdca813 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dea1929d-bf67-4ea6-b81d-fb5a8bbcec47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:14 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-99e6002f-2c95-4428-8fde-1b0aacdca813 tempest-ProjectMemberTests-1830166883 None] Volume 46da1ef7-2232-47a7-8769-d59d6139ef47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46da1ef7-2232-47a7-8769-d59d6139ef47', 'volume_size': 1} Sep 03 11:33:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-99e6002f-2c95-4428-8fde-1b0aacdca813 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:33:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-99e6002f-2c95-4428-8fde-1b0aacdca813 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:33:14 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-99e6002f-2c95-4428-8fde-1b0aacdca813 tempest-ProjectMemberTests-1830166883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1693103156',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46da1ef7-2232-47a7-8769-d59d6139ef47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e9ee545cbb4eb99d3a310cf4efc844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:33:14Z,use_quota=True,user_id='badece1d173b4e51add55b4a7c961a4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:33:14 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-99e6002f-2c95-4428-8fde-1b0aacdca813 tempest-ProjectMemberTests-1830166883 None] Creating volume 46da1ef7-2232-47a7-8769-d59d6139ef47 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:33:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-99e6002f-2c95-4428-8fde-1b0aacdca813 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:33:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-99e6002f-2c95-4428-8fde-1b0aacdca813 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:33:14 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-99e6002f-2c95-4428-8fde-1b0aacdca813 tempest-ProjectMemberTests-1830166883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:33:14 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-99e6002f-2c95-4428-8fde-1b0aacdca813 tempest-ProjectMemberTests-1830166883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:33:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-99e6002f-2c95-4428-8fde-1b0aacdca813 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:33:14 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-99e6002f-2c95-4428-8fde-1b0aacdca813 tempest-ProjectMemberTests-1830166883 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:33:14 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-99e6002f-2c95-4428-8fde-1b0aacdca813 tempest-ProjectMemberTests-1830166883 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:33:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-99e6002f-2c95-4428-8fde-1b0aacdca813 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:14 devstack sudo[107068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47 1073741824 Sep 03 11:33:14 devstack sudo[107068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:14 devstack sudo[107068]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-99e6002f-2c95-4428-8fde-1b0aacdca813 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47 1073741824" returned: 0 in 0.413s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:14 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-99e6002f-2c95-4428-8fde-1b0aacdca813 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:14 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47 Sep 03 11:33:14 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:15 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-99e6002f-2c95-4428-8fde-1b0aacdca813 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47" returned: 0 in 0.252s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:15 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-99e6002f-2c95-4428-8fde-1b0aacdca813 tempest-ProjectMemberTests-1830166883 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:33:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-99e6002f-2c95-4428-8fde-1b0aacdca813 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:33:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-99e6002f-2c95-4428-8fde-1b0aacdca813 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dea1929d-bf67-4ea6-b81d-fb5a8bbcec47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46da1ef7-2232-47a7-8769-d59d6139ef47', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-99e6002f-2c95-4428-8fde-1b0aacdca813 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f8ef25-7610-433c-9ff9-71d8b3907433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:15 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-99e6002f-2c95-4428-8fde-1b0aacdca813 tempest-ProjectMemberTests-1830166883 None] Volume volume-46da1ef7-2232-47a7-8769-d59d6139ef47 (46da1ef7-2232-47a7-8769-d59d6139ef47): created successfully Sep 03 11:33:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-99e6002f-2c95-4428-8fde-1b0aacdca813 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4f8ef25-7610-433c-9ff9-71d8b3907433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:15 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-99e6002f-2c95-4428-8fde-1b0aacdca813 tempest-ProjectMemberTests-1830166883 None] Flow 'volume_create_manager' (ac85bcd6-58dd-4641-a787-eb6b0ebfd827) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:33:15 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-99e6002f-2c95-4428-8fde-1b0aacdca813 tempest-ProjectMemberTests-1830166883 None] Created volume successfully. Sep 03 11:33:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4a84dd24-d686-4191-b4b4-fe43df442936 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:33:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4a84dd24-d686-4191-b4b4-fe43df442936 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:33:15 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-4a84dd24-d686-4191-b4b4-fe43df442936 tempest-ProjectMemberTests-1830166883 None] Creating offline snapshot 04b89209-a5e0-4c8f-b3e4-89fcc42828c0 of volume 46da1ef7-2232-47a7-8769-d59d6139ef47 {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:33:15 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbe6d96-f777-4480-8fd6-64a477c31ec1]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:33:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4a84dd24-d686-4191-b4b4-fe43df442936 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:15 devstack sudo[107077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47 Sep 03 11:33:15 devstack sudo[107077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:15 devstack sudo[107077]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4a84dd24-d686-4191-b4b4-fe43df442936 tempest-ProjectMemberTests-1830166883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47" returned: 0 in 0.364s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:15 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4a84dd24-d686-4191-b4b4-fe43df442936 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47.04b89209-a5e0-4c8f-b3e4-89fcc42828c0 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:16 devstack sudo[107082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47.04b89209-a5e0-4c8f-b3e4-89fcc42828c0 1G Sep 03 11:33:16 devstack sudo[107082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:16 devstack sudo[107082]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4a84dd24-d686-4191-b4b4-fe43df442936 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47.04b89209-a5e0-4c8f-b3e4-89fcc42828c0 1G" returned: 0 in 0.414s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4a84dd24-d686-4191-b4b4-fe43df442936 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46da1ef7-2232-47a7-8769-d59d6139ef47 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47.04b89209-a5e0-4c8f-b3e4-89fcc42828c0 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:16 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46da1ef7-2232-47a7-8769-d59d6139ef47 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47.04b89209-a5e0-4c8f-b3e4-89fcc42828c0 Sep 03 11:33:16 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:16 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4a84dd24-d686-4191-b4b4-fe43df442936 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-46da1ef7-2232-47a7-8769-d59d6139ef47 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47.04b89209-a5e0-4c8f-b3e4-89fcc42828c0" returned: 0 in 0.297s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:16 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-4a84dd24-d686-4191-b4b4-fe43df442936 tempest-ProjectMemberTests-1830166883 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47.04b89209-a5e0-4c8f-b3e4-89fcc42828c0 is being set with open permissions: ugo+rw Sep 03 11:33:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4a84dd24-d686-4191-b4b4-fe43df442936 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47.04b89209-a5e0-4c8f-b3e4-89fcc42828c0 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:16 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47.04b89209-a5e0-4c8f-b3e4-89fcc42828c0 Sep 03 11:33:16 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:16 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4a84dd24-d686-4191-b4b4-fe43df442936 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47.04b89209-a5e0-4c8f-b3e4-89fcc42828c0" returned: 0 in 0.255s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:16 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4a84dd24-d686-4191-b4b4-fe43df442936 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:17 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47.info Sep 03 11:33:17 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:17 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4a84dd24-d686-4191-b4b4-fe43df442936 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47.info" returned: 0 in 0.256s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:17 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-4a84dd24-d686-4191-b4b4-fe43df442936 tempest-ProjectMemberTests-1830166883 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47.info is being set with open permissions: ugo+rw Sep 03 11:33:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4a84dd24-d686-4191-b4b4-fe43df442936 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:17 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47.info Sep 03 11:33:17 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:17 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-4a84dd24-d686-4191-b4b4-fe43df442936 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47.info" returned: 0 in 0.250s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-4a84dd24-d686-4191-b4b4-fe43df442936 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.931s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:33:17 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-4a84dd24-d686-4191-b4b4-fe43df442936 tempest-ProjectMemberTests-1830166883 None] Create snapshot completed successfully Sep 03 11:33:17 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-c2715a27-555f-4846-9f75-62d7cccc5377 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-04b89209-a5e0-4c8f-b3e4-89fcc42828c0-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:33:17 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-c2715a27-555f-4846-9f75-62d7cccc5377 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-04b89209-a5e0-4c8f-b3e4-89fcc42828c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:33:17 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-c2715a27-555f-4846-9f75-62d7cccc5377 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-quobyte-46da1ef7-2232-47a7-8769-d59d6139ef47" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:33:17 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-c2715a27-555f-4846-9f75-62d7cccc5377 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-46da1ef7-2232-47a7-8769-d59d6139ef47" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:33:17 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-c2715a27-555f-4846-9f75-62d7cccc5377 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-quobyte-04b89209-a5e0-4c8f-b3e4-89fcc42828c0" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:33:17 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-c2715a27-555f-4846-9f75-62d7cccc5377 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-04b89209-a5e0-4c8f-b3e4-89fcc42828c0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:33:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-c2715a27-555f-4846-9f75-62d7cccc5377 tempest-ProjectMemberTests-1830166883 None] Deleting offline snapshot 04b89209-a5e0-4c8f-b3e4-89fcc42828c0 of volume 46da1ef7-2232-47a7-8769-d59d6139ef47 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:33:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-c2715a27-555f-4846-9f75-62d7cccc5377 tempest-ProjectMemberTests-1830166883 None] snapshot_file for this snap is: volume-46da1ef7-2232-47a7-8769-d59d6139ef47.04b89209-a5e0-4c8f-b3e4-89fcc42828c0 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:33:17 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa2e4aa-c585-46c9-9e57-86487ba7cf82]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:33:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c2715a27-555f-4846-9f75-62d7cccc5377 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47.04b89209-a5e0-4c8f-b3e4-89fcc42828c0 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:17 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47.04b89209-a5e0-4c8f-b3e4-89fcc42828c0 Sep 03 11:33:17 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:17 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:33:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:33:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:33:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:33:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:33:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:33:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:18 devstack sudo[107104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:33:18 devstack sudo[107104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:18 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c2715a27-555f-4846-9f75-62d7cccc5377 tempest-ProjectMemberTests-1830166883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47.04b89209-a5e0-4c8f-b3e4-89fcc42828c0" returned: 0 in 0.397s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:18 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-c2715a27-555f-4846-9f75-62d7cccc5377 tempest-ProjectMemberTests-1830166883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-46da1ef7-2232-47a7-8769-d59d6139ef47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:33:18 devstack sudo[107104]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.264s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:18 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:33:18 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[9018604c-1730-4e1b-b1e6-39e97d506e41]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:33:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c2715a27-555f-4846-9f75-62d7cccc5377 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:18 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:33:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread count: 28 {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:33:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread info: [<_MainThread(MainThread, started 139554943000704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:33:18 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47 Sep 03 11:33:18 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:18 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c2715a27-555f-4846-9f75-62d7cccc5377 tempest-ProjectMemberTests-1830166883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47" returned: 0 in 0.374s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c2715a27-555f-4846-9f75-62d7cccc5377 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47.04b89209-a5e0-4c8f-b3e4-89fcc42828c0 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:18 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47.04b89209-a5e0-4c8f-b3e4-89fcc42828c0 Sep 03 11:33:18 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:18 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c2715a27-555f-4846-9f75-62d7cccc5377 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47.04b89209-a5e0-4c8f-b3e4-89fcc42828c0" returned: 0 in 0.335s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c2715a27-555f-4846-9f75-62d7cccc5377 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47.04b89209-a5e0-4c8f-b3e4-89fcc42828c0 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:18 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47.04b89209-a5e0-4c8f-b3e4-89fcc42828c0 Sep 03 11:33:18 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:19 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:19 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-c2715a27-555f-4846-9f75-62d7cccc5377 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47.04b89209-a5e0-4c8f-b3e4-89fcc42828c0" returned: 0 in 0.237s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:19 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-c2715a27-555f-4846-9f75-62d7cccc5377 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-04b89209-a5e0-4c8f-b3e4-89fcc42828c0" released by "_delete_snapshot" :: held 1.446s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:19 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-c2715a27-555f-4846-9f75-62d7cccc5377 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-46da1ef7-2232-47a7-8769-d59d6139ef47" released by "delete_snapshot" :: held 1.470s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:19 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=182,cinder:INSERT=61,cinder:UPDATE=245,cinder:DELETE=16 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:33:19 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:UPDATE=215,cinder:SELECT=187,cinder:INSERT=67,cinder:DELETE=22 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:33:19 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-c2715a27-555f-4846-9f75-62d7cccc5377 tempest-ProjectMemberTests-1830166883 None] Created reservations ['9318b34e-ab86-4244-a0af-b68897e5b6fd', '0018d333-8083-4e34-8104-4a1eb8825909', 'c3553a41-8ab9-4c79-9205-d4253f63fab8', 'ae27379d-9b22-4b8e-99a7-8c242cdede8e'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:33:19 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-c2715a27-555f-4846-9f75-62d7cccc5377 tempest-ProjectMemberTests-1830166883 None] Delete snapshot completed successfully. Sep 03 11:33:19 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-c2715a27-555f-4846-9f75-62d7cccc5377 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-04b89209-a5e0-4c8f-b3e4-89fcc42828c0-delete_snapshot" released by "delete_snapshot" :: held 1.621s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:19 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-657da4c0-0e28-41d7-a9e9-2eda5a596be1 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-46da1ef7-2232-47a7-8769-d59d6139ef47-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:33:19 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-657da4c0-0e28-41d7-a9e9-2eda5a596be1 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-46da1ef7-2232-47a7-8769-d59d6139ef47-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:33:19 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-657da4c0-0e28-41d7-a9e9-2eda5a596be1 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-quobyte-46da1ef7-2232-47a7-8769-d59d6139ef47" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:33:19 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-657da4c0-0e28-41d7-a9e9-2eda5a596be1 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-46da1ef7-2232-47a7-8769-d59d6139ef47" acquired by "delete_volume" :: waited 0.014s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:33:20 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[14aa0114-82f7-45ea-b70f-be003ad60fb9]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:33:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-657da4c0-0e28-41d7-a9e9-2eda5a596be1 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:20 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47 Sep 03 11:33:20 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:20 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-657da4c0-0e28-41d7-a9e9-2eda5a596be1 tempest-ProjectMemberTests-1830166883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47" returned: 0 in 0.364s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-657da4c0-0e28-41d7-a9e9-2eda5a596be1 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:20 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47 Sep 03 11:33:20 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:20 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-47c6573e-1279-4cda-85c4-eb0574284954 tempest-ProjectReaderTests-1111155487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:33:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-47c6573e-1279-4cda-85c4-eb0574284954 tempest-ProjectReaderTests-1111155487 None] Flow 'volume_create_manager' (2a0fc0de-6b19-4399-b243-55c39ecd2348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:33:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-47c6573e-1279-4cda-85c4-eb0574284954 tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cbfabca-5852-4bd7-8b07-d32bc4995109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-47c6573e-1279-4cda-85c4-eb0574284954 tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cbfabca-5852-4bd7-8b07-d32bc4995109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-737080601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d088cf-8616-4576-ae67-c0077595a263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2e65bfad7f34ca2aa1420d76086fdfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:33:20Z,use_quota=True,user_id='6582462860e94247a16b78e95869a430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-47c6573e-1279-4cda-85c4-eb0574284954 tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e1a92f-94bc-450a-bcd3-10828ee064b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-47c6573e-1279-4cda-85c4-eb0574284954 tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e1a92f-94bc-450a-bcd3-10828ee064b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-47c6573e-1279-4cda-85c4-eb0574284954 tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b82696c-8b4f-47a3-9122-445914170e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-47c6573e-1279-4cda-85c4-eb0574284954 tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b82696c-8b4f-47a3-9122-445914170e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8d088cf-8616-4576-ae67-c0077595a263', 'volume_name': 'volume-d8d088cf-8616-4576-ae67-c0077595a263', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-47c6573e-1279-4cda-85c4-eb0574284954 tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88e8b90f-3113-46f4-adde-19d0c021f696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-47c6573e-1279-4cda-85c4-eb0574284954 tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88e8b90f-3113-46f4-adde-19d0c021f696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:20 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-47c6573e-1279-4cda-85c4-eb0574284954 tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f312a5c-1eda-40b1-a0ab-494edde93392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:20 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-47c6573e-1279-4cda-85c4-eb0574284954 tempest-ProjectReaderTests-1111155487 None] Volume d8d088cf-8616-4576-ae67-c0077595a263: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8d088cf-8616-4576-ae67-c0077595a263', 'volume_size': 1} Sep 03 11:33:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-47c6573e-1279-4cda-85c4-eb0574284954 tempest-ProjectReaderTests-1111155487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:33:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-47c6573e-1279-4cda-85c4-eb0574284954 tempest-ProjectReaderTests-1111155487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:33:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-47c6573e-1279-4cda-85c4-eb0574284954 tempest-ProjectReaderTests-1111155487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-737080601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d088cf-8616-4576-ae67-c0077595a263,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2e65bfad7f34ca2aa1420d76086fdfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:33:20Z,use_quota=True,user_id='6582462860e94247a16b78e95869a430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:33:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-47c6573e-1279-4cda-85c4-eb0574284954 tempest-ProjectReaderTests-1111155487 None] Creating volume d8d088cf-8616-4576-ae67-c0077595a263 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:33:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-47c6573e-1279-4cda-85c4-eb0574284954 tempest-ProjectReaderTests-1111155487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:33:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-47c6573e-1279-4cda-85c4-eb0574284954 tempest-ProjectReaderTests-1111155487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:33:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-47c6573e-1279-4cda-85c4-eb0574284954 tempest-ProjectReaderTests-1111155487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:33:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-47c6573e-1279-4cda-85c4-eb0574284954 tempest-ProjectReaderTests-1111155487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:33:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-47c6573e-1279-4cda-85c4-eb0574284954 tempest-ProjectReaderTests-1111155487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:33:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-47c6573e-1279-4cda-85c4-eb0574284954 tempest-ProjectReaderTests-1111155487 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:33:20 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-47c6573e-1279-4cda-85c4-eb0574284954 tempest-ProjectReaderTests-1111155487 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:33:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-47c6573e-1279-4cda-85c4-eb0574284954 tempest-ProjectReaderTests-1111155487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d8d088cf-8616-4576-ae67-c0077595a263 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:20 devstack sudo[107132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d8d088cf-8616-4576-ae67-c0077595a263 1073741824 Sep 03 11:33:20 devstack sudo[107132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:20 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-657da4c0-0e28-41d7-a9e9-2eda5a596be1 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-46da1ef7-2232-47a7-8769-d59d6139ef47" returned: 0 in 0.259s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:20 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-657da4c0-0e28-41d7-a9e9-2eda5a596be1 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-46da1ef7-2232-47a7-8769-d59d6139ef47" released by "delete_volume" :: held 0.689s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:20 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-657da4c0-0e28-41d7-a9e9-2eda5a596be1 tempest-ProjectMemberTests-1830166883 None] Created reservations ['69c3256f-0ae6-4f89-ad0f-55b1b723642b', 'bc20f5ad-3eae-4c25-9ea9-0bf4facd8a2c', 'cda0bd17-6ef8-4803-aadd-6d08ca416d43', '25b886fe-c679-4d90-98e8-2fa35a8c54fe'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:33:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-657da4c0-0e28-41d7-a9e9-2eda5a596be1 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:33:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-657da4c0-0e28-41d7-a9e9-2eda5a596be1 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:33:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-657da4c0-0e28-41d7-a9e9-2eda5a596be1 tempest-ProjectMemberTests-1830166883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:33:20 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-657da4c0-0e28-41d7-a9e9-2eda5a596be1 tempest-ProjectMemberTests-1830166883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:33:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-657da4c0-0e28-41d7-a9e9-2eda5a596be1 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:33:20 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-657da4c0-0e28-41d7-a9e9-2eda5a596be1 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:20 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:33:20 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:21 devstack sudo[107132]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-47c6573e-1279-4cda-85c4-eb0574284954 tempest-ProjectReaderTests-1111155487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d8d088cf-8616-4576-ae67-c0077595a263 1073741824" returned: 0 in 0.435s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:21 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-657da4c0-0e28-41d7-a9e9-2eda5a596be1 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.254s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-657da4c0-0e28-41d7-a9e9-2eda5a596be1 tempest-ProjectMemberTests-1830166883 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:33:21 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-657da4c0-0e28-41d7-a9e9-2eda5a596be1 tempest-ProjectMemberTests-1830166883 None] Deleted volume successfully. Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-47c6573e-1279-4cda-85c4-eb0574284954 tempest-ProjectReaderTests-1111155487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d8d088cf-8616-4576-ae67-c0077595a263 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-657da4c0-0e28-41d7-a9e9-2eda5a596be1 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-46da1ef7-2232-47a7-8769-d59d6139ef47-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:21 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d8d088cf-8616-4576-ae67-c0077595a263 Sep 03 11:33:21 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:21 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-47c6573e-1279-4cda-85c4-eb0574284954 tempest-ProjectReaderTests-1111155487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d8d088cf-8616-4576-ae67-c0077595a263" returned: 0 in 0.273s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-47c6573e-1279-4cda-85c4-eb0574284954 tempest-ProjectReaderTests-1111155487 None] <== create_volume: return (760ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-47c6573e-1279-4cda-85c4-eb0574284954 tempest-ProjectReaderTests-1111155487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-47c6573e-1279-4cda-85c4-eb0574284954 tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f312a5c-1eda-40b1-a0ab-494edde93392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8d088cf-8616-4576-ae67-c0077595a263', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-47c6573e-1279-4cda-85c4-eb0574284954 tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc68b8e-de0e-4901-a00d-c6cce4dfde32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:21 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-47c6573e-1279-4cda-85c4-eb0574284954 tempest-ProjectReaderTests-1111155487 None] Volume volume-d8d088cf-8616-4576-ae67-c0077595a263 (d8d088cf-8616-4576-ae67-c0077595a263): created successfully Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-47c6573e-1279-4cda-85c4-eb0574284954 tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efc68b8e-de0e-4901-a00d-c6cce4dfde32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-47c6573e-1279-4cda-85c4-eb0574284954 tempest-ProjectReaderTests-1111155487 None] Flow 'volume_create_manager' (2a0fc0de-6b19-4399-b243-55c39ecd2348) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:33:21 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-47c6573e-1279-4cda-85c4-eb0574284954 tempest-ProjectReaderTests-1111155487 None] Created volume successfully. Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3b94dca-afcc-434d-8aba-d5bb3d8b5328 tempest-ProjectMemberTests-1830166883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a3b94dca-afcc-434d-8aba-d5bb3d8b5328 tempest-ProjectMemberTests-1830166883 None] Flow 'volume_create_manager' (d369d6ef-10f6-4a91-b7c4-bc6a9d9df99e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a3b94dca-afcc-434d-8aba-d5bb3d8b5328 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e23eb344-be2f-4c57-81f1-1bceb3f5e989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a3b94dca-afcc-434d-8aba-d5bb3d8b5328 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e23eb344-be2f-4c57-81f1-1bceb3f5e989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-818518809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3971ca8-67bd-4290-8b51-246ce134c0b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e9ee545cbb4eb99d3a310cf4efc844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:33:21Z,use_quota=True,user_id='badece1d173b4e51add55b4a7c961a4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a3b94dca-afcc-434d-8aba-d5bb3d8b5328 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61893010-398b-4c84-8ac0-a493c95d3ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a3b94dca-afcc-434d-8aba-d5bb3d8b5328 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61893010-398b-4c84-8ac0-a493c95d3ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a3b94dca-afcc-434d-8aba-d5bb3d8b5328 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ff15bc-9d08-4e34-b214-ee652d2fe939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a3b94dca-afcc-434d-8aba-d5bb3d8b5328 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92ff15bc-9d08-4e34-b214-ee652d2fe939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3971ca8-67bd-4290-8b51-246ce134c0b8', 'volume_name': 'volume-e3971ca8-67bd-4290-8b51-246ce134c0b8', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a3b94dca-afcc-434d-8aba-d5bb3d8b5328 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66190f71-42ac-4fcb-ab38-15688b888944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a3b94dca-afcc-434d-8aba-d5bb3d8b5328 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66190f71-42ac-4fcb-ab38-15688b888944) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a3b94dca-afcc-434d-8aba-d5bb3d8b5328 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cb9cd05-e881-4056-9b77-9166f021f17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:21 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-a3b94dca-afcc-434d-8aba-d5bb3d8b5328 tempest-ProjectMemberTests-1830166883 None] Volume e3971ca8-67bd-4290-8b51-246ce134c0b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3971ca8-67bd-4290-8b51-246ce134c0b8', 'volume_size': 1} Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a3b94dca-afcc-434d-8aba-d5bb3d8b5328 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a3b94dca-afcc-434d-8aba-d5bb3d8b5328 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a3b94dca-afcc-434d-8aba-d5bb3d8b5328 tempest-ProjectMemberTests-1830166883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-818518809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3971ca8-67bd-4290-8b51-246ce134c0b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e9ee545cbb4eb99d3a310cf4efc844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:33:21Z,use_quota=True,user_id='badece1d173b4e51add55b4a7c961a4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-a3b94dca-afcc-434d-8aba-d5bb3d8b5328 tempest-ProjectMemberTests-1830166883 None] Creating volume e3971ca8-67bd-4290-8b51-246ce134c0b8 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a3b94dca-afcc-434d-8aba-d5bb3d8b5328 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a3b94dca-afcc-434d-8aba-d5bb3d8b5328 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a3b94dca-afcc-434d-8aba-d5bb3d8b5328 tempest-ProjectMemberTests-1830166883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a3b94dca-afcc-434d-8aba-d5bb3d8b5328 tempest-ProjectMemberTests-1830166883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a3b94dca-afcc-434d-8aba-d5bb3d8b5328 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a3b94dca-afcc-434d-8aba-d5bb3d8b5328 tempest-ProjectMemberTests-1830166883 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:33:21 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-a3b94dca-afcc-434d-8aba-d5bb3d8b5328 tempest-ProjectMemberTests-1830166883 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a3b94dca-afcc-434d-8aba-d5bb3d8b5328 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-52e3cd00-96d3-42ca-9fd1-4cb06e055fe9 tempest-ProjectReaderTests-1111155487 None] Acquiring lock "cinder-d8d088cf-8616-4576-ae67-c0077595a263-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:33:21 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8 1073741824 Sep 03 11:33:21 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-52e3cd00-96d3-42ca-9fd1-4cb06e055fe9 tempest-ProjectReaderTests-1111155487 None] Lock "cinder-d8d088cf-8616-4576-ae67-c0077595a263-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-52e3cd00-96d3-42ca-9fd1-4cb06e055fe9 tempest-ProjectReaderTests-1111155487 None] Acquiring lock "cinder-quobyte-d8d088cf-8616-4576-ae67-c0077595a263" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-52e3cd00-96d3-42ca-9fd1-4cb06e055fe9 tempest-ProjectReaderTests-1111155487 None] Lock "cinder-quobyte-d8d088cf-8616-4576-ae67-c0077595a263" acquired by "delete_volume" :: waited 0.016s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[d253f023-0a21-42c2-9f1d-85ae8b1785a0]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:33:21 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-52e3cd00-96d3-42ca-9fd1-4cb06e055fe9 tempest-ProjectReaderTests-1111155487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d8d088cf-8616-4576-ae67-c0077595a263 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:21 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d8d088cf-8616-4576-ae67-c0077595a263 Sep 03 11:33:21 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:22 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a3b94dca-afcc-434d-8aba-d5bb3d8b5328 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8 1073741824" returned: 0 in 0.424s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a3b94dca-afcc-434d-8aba-d5bb3d8b5328 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:22 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8 Sep 03 11:33:22 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:22 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-52e3cd00-96d3-42ca-9fd1-4cb06e055fe9 tempest-ProjectReaderTests-1111155487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d8d088cf-8616-4576-ae67-c0077595a263" returned: 0 in 0.385s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-52e3cd00-96d3-42ca-9fd1-4cb06e055fe9 tempest-ProjectReaderTests-1111155487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d8d088cf-8616-4576-ae67-c0077595a263 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:22 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d8d088cf-8616-4576-ae67-c0077595a263 Sep 03 11:33:22 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:22 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a3b94dca-afcc-434d-8aba-d5bb3d8b5328 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8" returned: 0 in 0.258s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:22 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a3b94dca-afcc-434d-8aba-d5bb3d8b5328 tempest-ProjectMemberTests-1830166883 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:33:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a3b94dca-afcc-434d-8aba-d5bb3d8b5328 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:33:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a3b94dca-afcc-434d-8aba-d5bb3d8b5328 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cb9cd05-e881-4056-9b77-9166f021f17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3971ca8-67bd-4290-8b51-246ce134c0b8', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a3b94dca-afcc-434d-8aba-d5bb3d8b5328 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6946ffdb-b094-4503-9ee6-e4f9f3046733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:22 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-a3b94dca-afcc-434d-8aba-d5bb3d8b5328 tempest-ProjectMemberTests-1830166883 None] Volume volume-e3971ca8-67bd-4290-8b51-246ce134c0b8 (e3971ca8-67bd-4290-8b51-246ce134c0b8): created successfully Sep 03 11:33:22 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a3b94dca-afcc-434d-8aba-d5bb3d8b5328 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6946ffdb-b094-4503-9ee6-e4f9f3046733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:22 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-a3b94dca-afcc-434d-8aba-d5bb3d8b5328 tempest-ProjectMemberTests-1830166883 None] Flow 'volume_create_manager' (d369d6ef-10f6-4a91-b7c4-bc6a9d9df99e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:33:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-52e3cd00-96d3-42ca-9fd1-4cb06e055fe9 tempest-ProjectReaderTests-1111155487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-d8d088cf-8616-4576-ae67-c0077595a263" returned: 0 in 0.267s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:22 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-52e3cd00-96d3-42ca-9fd1-4cb06e055fe9 tempest-ProjectReaderTests-1111155487 None] Lock "cinder-quobyte-d8d088cf-8616-4576-ae67-c0077595a263" released by "delete_volume" :: held 0.695s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:22 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-a3b94dca-afcc-434d-8aba-d5bb3d8b5328 tempest-ProjectMemberTests-1830166883 None] Created volume successfully. Sep 03 11:33:22 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-52e3cd00-96d3-42ca-9fd1-4cb06e055fe9 tempest-ProjectReaderTests-1111155487 None] Created reservations ['51f15c5e-36e0-4ba8-a3f0-a038674abb27', 'e096c9f1-b837-4177-9b17-3cca2b5d21d5', '67b1f1b1-ffe0-41f6-8c2f-c92d0b3aa66e', 'f9c57816-1f9e-4a17-9932-fac4957ab133'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:33:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-52e3cd00-96d3-42ca-9fd1-4cb06e055fe9 tempest-ProjectReaderTests-1111155487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:33:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-52e3cd00-96d3-42ca-9fd1-4cb06e055fe9 tempest-ProjectReaderTests-1111155487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:33:22 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-52e3cd00-96d3-42ca-9fd1-4cb06e055fe9 tempest-ProjectReaderTests-1111155487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:33:22 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-52e3cd00-96d3-42ca-9fd1-4cb06e055fe9 tempest-ProjectReaderTests-1111155487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:33:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-52e3cd00-96d3-42ca-9fd1-4cb06e055fe9 tempest-ProjectReaderTests-1111155487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:33:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-52e3cd00-96d3-42ca-9fd1-4cb06e055fe9 tempest-ProjectReaderTests-1111155487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:22 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:33:22 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-af634134-5be6-4727-a4f2-64862c9f552d tempest-ProjectMemberTests-1830166883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:33:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-af634134-5be6-4727-a4f2-64862c9f552d tempest-ProjectMemberTests-1830166883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:33:22 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-af634134-5be6-4727-a4f2-64862c9f552d tempest-ProjectMemberTests-1830166883 None] Creating offline snapshot 200730c8-7b4f-424d-abde-967ff6f40585 of volume e3971ca8-67bd-4290-8b51-246ce134c0b8 {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:33:22 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a9fc79a-ca78-43dc-ad7d-9f652f67e5aa]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:33:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af634134-5be6-4727-a4f2-64862c9f552d tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:22 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:22 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-52e3cd00-96d3-42ca-9fd1-4cb06e055fe9 tempest-ProjectReaderTests-1111155487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.275s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:22 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-52e3cd00-96d3-42ca-9fd1-4cb06e055fe9 tempest-ProjectReaderTests-1111155487 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:33:22 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-52e3cd00-96d3-42ca-9fd1-4cb06e055fe9 tempest-ProjectReaderTests-1111155487 None] Deleted volume successfully. Sep 03 11:33:22 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-52e3cd00-96d3-42ca-9fd1-4cb06e055fe9 tempest-ProjectReaderTests-1111155487 None] Lock "cinder-d8d088cf-8616-4576-ae67-c0077595a263-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:22 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8 Sep 03 11:33:22 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:23 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af634134-5be6-4727-a4f2-64862c9f552d tempest-ProjectMemberTests-1830166883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8" returned: 0 in 0.387s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af634134-5be6-4727-a4f2-64862c9f552d tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8.200730c8-7b4f-424d-abde-967ff6f40585 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:23 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8.200730c8-7b4f-424d-abde-967ff6f40585 1G Sep 03 11:33:23 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:23 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-991b208f-41f4-4d00-96e9-e12a60cd9299 tempest-ProjectReaderTests-1111155487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:33:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-991b208f-41f4-4d00-96e9-e12a60cd9299 tempest-ProjectReaderTests-1111155487 None] Flow 'volume_create_manager' (dd30f770-50fe-4c52-8d7c-a705d7363e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:33:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-991b208f-41f4-4d00-96e9-e12a60cd9299 tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea26e7ae-b032-464b-83d0-1130a18d0514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-991b208f-41f4-4d00-96e9-e12a60cd9299 tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea26e7ae-b032-464b-83d0-1130a18d0514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1782110154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7061010-d6fc-49eb-9f6a-1f99ae6f2ccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2e65bfad7f34ca2aa1420d76086fdfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:33:23Z,use_quota=True,user_id='6582462860e94247a16b78e95869a430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-991b208f-41f4-4d00-96e9-e12a60cd9299 tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e857ddb7-8e58-4aa6-a944-4e043789b616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-991b208f-41f4-4d00-96e9-e12a60cd9299 tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e857ddb7-8e58-4aa6-a944-4e043789b616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-991b208f-41f4-4d00-96e9-e12a60cd9299 tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f9bf2b2-76f5-426b-8740-56c6bca5b17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-991b208f-41f4-4d00-96e9-e12a60cd9299 tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f9bf2b2-76f5-426b-8740-56c6bca5b17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7061010-d6fc-49eb-9f6a-1f99ae6f2ccf', 'volume_name': 'volume-c7061010-d6fc-49eb-9f6a-1f99ae6f2ccf', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-991b208f-41f4-4d00-96e9-e12a60cd9299 tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (672cbdc4-f0f9-45de-9268-17e1930ee710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-991b208f-41f4-4d00-96e9-e12a60cd9299 tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (672cbdc4-f0f9-45de-9268-17e1930ee710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:23 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-991b208f-41f4-4d00-96e9-e12a60cd9299 tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e95b0bd-b600-4604-bbd8-f7a944e73bf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:23 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-991b208f-41f4-4d00-96e9-e12a60cd9299 tempest-ProjectReaderTests-1111155487 None] Volume c7061010-d6fc-49eb-9f6a-1f99ae6f2ccf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7061010-d6fc-49eb-9f6a-1f99ae6f2ccf', 'volume_size': 1} Sep 03 11:33:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-991b208f-41f4-4d00-96e9-e12a60cd9299 tempest-ProjectReaderTests-1111155487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:33:23 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af634134-5be6-4727-a4f2-64862c9f552d tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8.200730c8-7b4f-424d-abde-967ff6f40585 1G" returned: 0 in 0.385s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af634134-5be6-4727-a4f2-64862c9f552d tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3971ca8-67bd-4290-8b51-246ce134c0b8 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8.200730c8-7b4f-424d-abde-967ff6f40585 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:23 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3971ca8-67bd-4290-8b51-246ce134c0b8 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8.200730c8-7b4f-424d-abde-967ff6f40585 Sep 03 11:33:23 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:23 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af634134-5be6-4727-a4f2-64862c9f552d tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e3971ca8-67bd-4290-8b51-246ce134c0b8 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8.200730c8-7b4f-424d-abde-967ff6f40585" returned: 0 in 0.280s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:23 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-af634134-5be6-4727-a4f2-64862c9f552d tempest-ProjectMemberTests-1830166883 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8.200730c8-7b4f-424d-abde-967ff6f40585 is being set with open permissions: ugo+rw Sep 03 11:33:23 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af634134-5be6-4727-a4f2-64862c9f552d tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8.200730c8-7b4f-424d-abde-967ff6f40585 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:23 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8.200730c8-7b4f-424d-abde-967ff6f40585 Sep 03 11:33:23 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:24 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af634134-5be6-4727-a4f2-64862c9f552d tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8.200730c8-7b4f-424d-abde-967ff6f40585" returned: 0 in 0.233s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af634134-5be6-4727-a4f2-64862c9f552d tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:24 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8.info Sep 03 11:33:24 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:24 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af634134-5be6-4727-a4f2-64862c9f552d tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8.info" returned: 0 in 0.245s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:24 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-af634134-5be6-4727-a4f2-64862c9f552d tempest-ProjectMemberTests-1830166883 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8.info is being set with open permissions: ugo+rw Sep 03 11:33:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af634134-5be6-4727-a4f2-64862c9f552d tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:24 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8.info Sep 03 11:33:24 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:24 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-af634134-5be6-4727-a4f2-64862c9f552d tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8.info" returned: 0 in 0.252s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-af634134-5be6-4727-a4f2-64862c9f552d tempest-ProjectMemberTests-1830166883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.867s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:33:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-991b208f-41f4-4d00-96e9-e12a60cd9299 tempest-ProjectReaderTests-1111155487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.253s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:33:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-991b208f-41f4-4d00-96e9-e12a60cd9299 tempest-ProjectReaderTests-1111155487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:33:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1782110154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7061010-d6fc-49eb-9f6a-1f99ae6f2ccf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2e65bfad7f34ca2aa1420d76086fdfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:33:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:33:23Z,use_quota=True,user_id='6582462860e94247a16b78e95869a430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:33:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-991b208f-41f4-4d00-96e9-e12a60cd9299 tempest-ProjectReaderTests-1111155487 None] Creating volume c7061010-d6fc-49eb-9f6a-1f99ae6f2ccf {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:33:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-991b208f-41f4-4d00-96e9-e12a60cd9299 tempest-ProjectReaderTests-1111155487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:33:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-991b208f-41f4-4d00-96e9-e12a60cd9299 tempest-ProjectReaderTests-1111155487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:33:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-991b208f-41f4-4d00-96e9-e12a60cd9299 tempest-ProjectReaderTests-1111155487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:33:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-991b208f-41f4-4d00-96e9-e12a60cd9299 tempest-ProjectReaderTests-1111155487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:33:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-991b208f-41f4-4d00-96e9-e12a60cd9299 tempest-ProjectReaderTests-1111155487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:33:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-991b208f-41f4-4d00-96e9-e12a60cd9299 tempest-ProjectReaderTests-1111155487 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:33:24 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-991b208f-41f4-4d00-96e9-e12a60cd9299 tempest-ProjectReaderTests-1111155487 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:33:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-991b208f-41f4-4d00-96e9-e12a60cd9299 tempest-ProjectReaderTests-1111155487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c7061010-d6fc-49eb-9f6a-1f99ae6f2ccf 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:24 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c7061010-d6fc-49eb-9f6a-1f99ae6f2ccf 1073741824 Sep 03 11:33:24 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:24 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-af634134-5be6-4727-a4f2-64862c9f552d tempest-ProjectMemberTests-1830166883 None] Create snapshot completed successfully Sep 03 11:33:24 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-202de1c8-63d0-4e69-8ea4-418375682eda tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-200730c8-7b4f-424d-abde-967ff6f40585-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:33:24 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-202de1c8-63d0-4e69-8ea4-418375682eda tempest-ProjectMemberTests-1830166883 None] Lock "cinder-200730c8-7b4f-424d-abde-967ff6f40585-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:33:24 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-202de1c8-63d0-4e69-8ea4-418375682eda tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-quobyte-e3971ca8-67bd-4290-8b51-246ce134c0b8" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:33:24 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-202de1c8-63d0-4e69-8ea4-418375682eda tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-e3971ca8-67bd-4290-8b51-246ce134c0b8" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:33:24 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-202de1c8-63d0-4e69-8ea4-418375682eda tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-quobyte-200730c8-7b4f-424d-abde-967ff6f40585" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:33:24 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-202de1c8-63d0-4e69-8ea4-418375682eda tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-200730c8-7b4f-424d-abde-967ff6f40585" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:33:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-202de1c8-63d0-4e69-8ea4-418375682eda tempest-ProjectMemberTests-1830166883 None] Deleting offline snapshot 200730c8-7b4f-424d-abde-967ff6f40585 of volume e3971ca8-67bd-4290-8b51-246ce134c0b8 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:33:24 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-202de1c8-63d0-4e69-8ea4-418375682eda tempest-ProjectMemberTests-1830166883 None] snapshot_file for this snap is: volume-e3971ca8-67bd-4290-8b51-246ce134c0b8.200730c8-7b4f-424d-abde-967ff6f40585 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:33:24 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db72387-fd78-4266-ab8d-901c1f112499]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:33:24 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-202de1c8-63d0-4e69-8ea4-418375682eda tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8.200730c8-7b4f-424d-abde-967ff6f40585 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:25 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8.200730c8-7b4f-424d-abde-967ff6f40585 Sep 03 11:33:25 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:25 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-991b208f-41f4-4d00-96e9-e12a60cd9299 tempest-ProjectReaderTests-1111155487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c7061010-d6fc-49eb-9f6a-1f99ae6f2ccf 1073741824" returned: 0 in 0.450s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-991b208f-41f4-4d00-96e9-e12a60cd9299 tempest-ProjectReaderTests-1111155487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c7061010-d6fc-49eb-9f6a-1f99ae6f2ccf {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:25 devstack sudo[107233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c7061010-d6fc-49eb-9f6a-1f99ae6f2ccf Sep 03 11:33:25 devstack sudo[107233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:25 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-202de1c8-63d0-4e69-8ea4-418375682eda tempest-ProjectMemberTests-1830166883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8.200730c8-7b4f-424d-abde-967ff6f40585" returned: 0 in 0.359s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:25 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-202de1c8-63d0-4e69-8ea4-418375682eda tempest-ProjectMemberTests-1830166883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e3971ca8-67bd-4290-8b51-246ce134c0b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:33:25 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[b060efba-fbab-4fa7-a5b9-75df92a23404]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:33:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-202de1c8-63d0-4e69-8ea4-418375682eda tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:25 devstack sudo[107233]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-991b208f-41f4-4d00-96e9-e12a60cd9299 tempest-ProjectReaderTests-1111155487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c7061010-d6fc-49eb-9f6a-1f99ae6f2ccf" returned: 0 in 0.242s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:25 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-991b208f-41f4-4d00-96e9-e12a60cd9299 tempest-ProjectReaderTests-1111155487 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:33:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-991b208f-41f4-4d00-96e9-e12a60cd9299 tempest-ProjectReaderTests-1111155487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:33:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-991b208f-41f4-4d00-96e9-e12a60cd9299 tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e95b0bd-b600-4604-bbd8-f7a944e73bf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7061010-d6fc-49eb-9f6a-1f99ae6f2ccf', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-991b208f-41f4-4d00-96e9-e12a60cd9299 tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad85f50e-ebe9-4f48-86e2-74d65051031a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:25 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-991b208f-41f4-4d00-96e9-e12a60cd9299 tempest-ProjectReaderTests-1111155487 None] Volume volume-c7061010-d6fc-49eb-9f6a-1f99ae6f2ccf (c7061010-d6fc-49eb-9f6a-1f99ae6f2ccf): created successfully Sep 03 11:33:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-991b208f-41f4-4d00-96e9-e12a60cd9299 tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad85f50e-ebe9-4f48-86e2-74d65051031a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:25 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-991b208f-41f4-4d00-96e9-e12a60cd9299 tempest-ProjectReaderTests-1111155487 None] Flow 'volume_create_manager' (dd30f770-50fe-4c52-8d7c-a705d7363e5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:33:25 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-991b208f-41f4-4d00-96e9-e12a60cd9299 tempest-ProjectReaderTests-1111155487 None] Created volume successfully. Sep 03 11:33:25 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8 Sep 03 11:33:25 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:25 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-202de1c8-63d0-4e69-8ea4-418375682eda tempest-ProjectMemberTests-1830166883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8" returned: 0 in 0.357s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:25 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-202de1c8-63d0-4e69-8ea4-418375682eda tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8.200730c8-7b4f-424d-abde-967ff6f40585 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:25 devstack sudo[107244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8.200730c8-7b4f-424d-abde-967ff6f40585 Sep 03 11:33:25 devstack sudo[107244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:26 devstack sudo[107244]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-202de1c8-63d0-4e69-8ea4-418375682eda tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8.200730c8-7b4f-424d-abde-967ff6f40585" returned: 0 in 0.325s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-202de1c8-63d0-4e69-8ea4-418375682eda tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8.200730c8-7b4f-424d-abde-967ff6f40585 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:26 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8.200730c8-7b4f-424d-abde-967ff6f40585 Sep 03 11:33:26 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:26 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-202de1c8-63d0-4e69-8ea4-418375682eda tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8.200730c8-7b4f-424d-abde-967ff6f40585" returned: 0 in 0.242s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:26 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-202de1c8-63d0-4e69-8ea4-418375682eda tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-200730c8-7b4f-424d-abde-967ff6f40585" released by "_delete_snapshot" :: held 1.367s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:26 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-202de1c8-63d0-4e69-8ea4-418375682eda tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-e3971ca8-67bd-4290-8b51-246ce134c0b8" released by "delete_snapshot" :: held 1.387s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:26 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-202de1c8-63d0-4e69-8ea4-418375682eda tempest-ProjectMemberTests-1830166883 None] Created reservations ['632b5010-352c-489e-80a3-5262cc142f5d', '67c2cf1f-2b55-422d-8b56-e16230de08ea', '41b26aca-8d4e-4729-807b-fd706868cc76', '264225a0-83dc-4b93-bb31-dbf9da1b0ddd'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:33:26 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-202de1c8-63d0-4e69-8ea4-418375682eda tempest-ProjectMemberTests-1830166883 None] Delete snapshot completed successfully. Sep 03 11:33:26 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-202de1c8-63d0-4e69-8ea4-418375682eda tempest-ProjectMemberTests-1830166883 None] Lock "cinder-200730c8-7b4f-424d-abde-967ff6f40585-delete_snapshot" released by "delete_snapshot" :: held 1.529s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:26 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f643d647-a2b4-44c7-b028-194027888400 tempest-ProjectReaderTests-1111155487 None] Acquiring lock "cinder-c7061010-d6fc-49eb-9f6a-1f99ae6f2ccf-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:33:26 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f643d647-a2b4-44c7-b028-194027888400 tempest-ProjectReaderTests-1111155487 None] Lock "cinder-c7061010-d6fc-49eb-9f6a-1f99ae6f2ccf-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:33:26 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f643d647-a2b4-44c7-b028-194027888400 tempest-ProjectReaderTests-1111155487 None] Acquiring lock "cinder-quobyte-c7061010-d6fc-49eb-9f6a-1f99ae6f2ccf" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:33:26 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f643d647-a2b4-44c7-b028-194027888400 tempest-ProjectReaderTests-1111155487 None] Lock "cinder-quobyte-c7061010-d6fc-49eb-9f6a-1f99ae6f2ccf" acquired by "delete_volume" :: waited 0.012s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:33:26 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d01a00-ea58-4f8f-9dce-dad3dadcd145]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:33:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f643d647-a2b4-44c7-b028-194027888400 tempest-ProjectReaderTests-1111155487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c7061010-d6fc-49eb-9f6a-1f99ae6f2ccf {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:26 devstack sudo[107252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c7061010-d6fc-49eb-9f6a-1f99ae6f2ccf Sep 03 11:33:26 devstack sudo[107252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:26 devstack sudo[107252]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f643d647-a2b4-44c7-b028-194027888400 tempest-ProjectReaderTests-1111155487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c7061010-d6fc-49eb-9f6a-1f99ae6f2ccf" returned: 0 in 0.334s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:26 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f643d647-a2b4-44c7-b028-194027888400 tempest-ProjectReaderTests-1111155487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c7061010-d6fc-49eb-9f6a-1f99ae6f2ccf {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:26 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c7061010-d6fc-49eb-9f6a-1f99ae6f2ccf Sep 03 11:33:26 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:27 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-7ec69bdd-411b-4b7f-b554-ae1c3dc8393d tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-e3971ca8-67bd-4290-8b51-246ce134c0b8-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:33:27 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-7ec69bdd-411b-4b7f-b554-ae1c3dc8393d tempest-ProjectMemberTests-1830166883 None] Lock "cinder-e3971ca8-67bd-4290-8b51-246ce134c0b8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:33:27 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-7ec69bdd-411b-4b7f-b554-ae1c3dc8393d tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-quobyte-e3971ca8-67bd-4290-8b51-246ce134c0b8" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:33:27 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-7ec69bdd-411b-4b7f-b554-ae1c3dc8393d tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-e3971ca8-67bd-4290-8b51-246ce134c0b8" acquired by "delete_volume" :: waited 0.017s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:33:27 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84db232-62fa-4215-923b-260f0f2cabf9]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:33:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7ec69bdd-411b-4b7f-b554-ae1c3dc8393d tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:27 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f643d647-a2b4-44c7-b028-194027888400 tempest-ProjectReaderTests-1111155487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-c7061010-d6fc-49eb-9f6a-1f99ae6f2ccf" returned: 0 in 0.261s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:27 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f643d647-a2b4-44c7-b028-194027888400 tempest-ProjectReaderTests-1111155487 None] Lock "cinder-quobyte-c7061010-d6fc-49eb-9f6a-1f99ae6f2ccf" released by "delete_volume" :: held 0.638s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:27 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-f643d647-a2b4-44c7-b028-194027888400 tempest-ProjectReaderTests-1111155487 None] Created reservations ['fb51ebac-c5c1-4e7a-85c1-178e1fd8120a', '5615a035-5c3f-471f-8962-d9b72718d317', 'a58d9e64-cd23-4c1f-8639-e53815df342a', '797691b8-ac51-42a0-8bee-beabccd34ee8'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:33:27 devstack sudo[107260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8 Sep 03 11:33:27 devstack sudo[107260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f643d647-a2b4-44c7-b028-194027888400 tempest-ProjectReaderTests-1111155487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:33:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f643d647-a2b4-44c7-b028-194027888400 tempest-ProjectReaderTests-1111155487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:33:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f643d647-a2b4-44c7-b028-194027888400 tempest-ProjectReaderTests-1111155487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:33:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-f643d647-a2b4-44c7-b028-194027888400 tempest-ProjectReaderTests-1111155487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:33:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-f643d647-a2b4-44c7-b028-194027888400 tempest-ProjectReaderTests-1111155487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:33:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f643d647-a2b4-44c7-b028-194027888400 tempest-ProjectReaderTests-1111155487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:27 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:33:27 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:27 devstack sudo[107260]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7ec69bdd-411b-4b7f-b554-ae1c3dc8393d tempest-ProjectMemberTests-1830166883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8" returned: 0 in 0.367s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7ec69bdd-411b-4b7f-b554-ae1c3dc8393d tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:27 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-f643d647-a2b4-44c7-b028-194027888400 tempest-ProjectReaderTests-1111155487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.247s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:27 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-f643d647-a2b4-44c7-b028-194027888400 tempest-ProjectReaderTests-1111155487 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:33:27 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-f643d647-a2b4-44c7-b028-194027888400 tempest-ProjectReaderTests-1111155487 None] Deleted volume successfully. Sep 03 11:33:27 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8 Sep 03 11:33:27 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:27 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-f643d647-a2b4-44c7-b028-194027888400 tempest-ProjectReaderTests-1111155487 None] Lock "cinder-c7061010-d6fc-49eb-9f6a-1f99ae6f2ccf-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:27 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7ec69bdd-411b-4b7f-b554-ae1c3dc8393d tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-e3971ca8-67bd-4290-8b51-246ce134c0b8" returned: 0 in 0.254s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:27 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-7ec69bdd-411b-4b7f-b554-ae1c3dc8393d tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-e3971ca8-67bd-4290-8b51-246ce134c0b8" released by "delete_volume" :: held 0.690s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:27 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-7ec69bdd-411b-4b7f-b554-ae1c3dc8393d tempest-ProjectMemberTests-1830166883 None] Created reservations ['e284f7f8-8940-4a66-ae00-16ba0f8d296d', 'a2b3e988-04db-481c-be91-745d8184ca04', '21a79555-2d6f-409a-9ba9-a5447841c57e', 'd1bbf04b-7758-403a-9de1-073c04b0f4a4'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:33:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7ec69bdd-411b-4b7f-b554-ae1c3dc8393d tempest-ProjectMemberTests-1830166883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:33:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7ec69bdd-411b-4b7f-b554-ae1c3dc8393d tempest-ProjectMemberTests-1830166883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:33:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7ec69bdd-411b-4b7f-b554-ae1c3dc8393d tempest-ProjectMemberTests-1830166883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:33:27 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-7ec69bdd-411b-4b7f-b554-ae1c3dc8393d tempest-ProjectMemberTests-1830166883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:33:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-7ec69bdd-411b-4b7f-b554-ae1c3dc8393d tempest-ProjectMemberTests-1830166883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:33:27 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7ec69bdd-411b-4b7f-b554-ae1c3dc8393d tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:27 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:33:27 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b105ca-188c-4e5d-8785-0c417c796c19 tempest-ProjectReaderTests-1111155487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-41b105ca-188c-4e5d-8785-0c417c796c19 tempest-ProjectReaderTests-1111155487 None] Flow 'volume_create_manager' (95d53ea6-7f5a-45e1-929d-c0fff98dfc00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-41b105ca-188c-4e5d-8785-0c417c796c19 tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff80d111-172c-406a-9da0-aa2136bef1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-41b105ca-188c-4e5d-8785-0c417c796c19 tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff80d111-172c-406a-9da0-aa2136bef1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1654574480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=176a5c2b-651d-4f16-ad6a-ac6db8d3507c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2e65bfad7f34ca2aa1420d76086fdfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:33:28Z,use_quota=True,user_id='6582462860e94247a16b78e95869a430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-41b105ca-188c-4e5d-8785-0c417c796c19 tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d9f5194-b820-4ed0-bbe2-144c4ad74d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-41b105ca-188c-4e5d-8785-0c417c796c19 tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d9f5194-b820-4ed0-bbe2-144c4ad74d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-41b105ca-188c-4e5d-8785-0c417c796c19 tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d5ab5da-88ed-4dc9-9cf9-5e7bdd4bfc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-41b105ca-188c-4e5d-8785-0c417c796c19 tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d5ab5da-88ed-4dc9-9cf9-5e7bdd4bfc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '176a5c2b-651d-4f16-ad6a-ac6db8d3507c', 'volume_name': 'volume-176a5c2b-651d-4f16-ad6a-ac6db8d3507c', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-41b105ca-188c-4e5d-8785-0c417c796c19 tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa025a2-c58a-45bf-afb4-60a218f42a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-41b105ca-188c-4e5d-8785-0c417c796c19 tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0aa025a2-c58a-45bf-afb4-60a218f42a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-41b105ca-188c-4e5d-8785-0c417c796c19 tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b7e57bc-2421-4c18-a1e4-4854bcb72f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:28 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-41b105ca-188c-4e5d-8785-0c417c796c19 tempest-ProjectReaderTests-1111155487 None] Volume 176a5c2b-651d-4f16-ad6a-ac6db8d3507c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-176a5c2b-651d-4f16-ad6a-ac6db8d3507c', 'volume_size': 1} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-41b105ca-188c-4e5d-8785-0c417c796c19 tempest-ProjectReaderTests-1111155487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-41b105ca-188c-4e5d-8785-0c417c796c19 tempest-ProjectReaderTests-1111155487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-41b105ca-188c-4e5d-8785-0c417c796c19 tempest-ProjectReaderTests-1111155487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1654574480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=176a5c2b-651d-4f16-ad6a-ac6db8d3507c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2e65bfad7f34ca2aa1420d76086fdfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:33:28Z,use_quota=True,user_id='6582462860e94247a16b78e95869a430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-41b105ca-188c-4e5d-8785-0c417c796c19 tempest-ProjectReaderTests-1111155487 None] Creating volume 176a5c2b-651d-4f16-ad6a-ac6db8d3507c {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-41b105ca-188c-4e5d-8785-0c417c796c19 tempest-ProjectReaderTests-1111155487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-41b105ca-188c-4e5d-8785-0c417c796c19 tempest-ProjectReaderTests-1111155487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:33:28 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-41b105ca-188c-4e5d-8785-0c417c796c19 tempest-ProjectReaderTests-1111155487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-41b105ca-188c-4e5d-8785-0c417c796c19 tempest-ProjectReaderTests-1111155487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-41b105ca-188c-4e5d-8785-0c417c796c19 tempest-ProjectReaderTests-1111155487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-41b105ca-188c-4e5d-8785-0c417c796c19 tempest-ProjectReaderTests-1111155487 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:33:28 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-41b105ca-188c-4e5d-8785-0c417c796c19 tempest-ProjectReaderTests-1111155487 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-41b105ca-188c-4e5d-8785-0c417c796c19 tempest-ProjectReaderTests-1111155487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-176a5c2b-651d-4f16-ad6a-ac6db8d3507c 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-7ec69bdd-411b-4b7f-b554-ae1c3dc8393d tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.262s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-7ec69bdd-411b-4b7f-b554-ae1c3dc8393d tempest-ProjectMemberTests-1830166883 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:33:28 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-7ec69bdd-411b-4b7f-b554-ae1c3dc8393d tempest-ProjectMemberTests-1830166883 None] Deleted volume successfully. Sep 03 11:33:28 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-176a5c2b-651d-4f16-ad6a-ac6db8d3507c 1073741824 Sep 03 11:33:28 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-7ec69bdd-411b-4b7f-b554-ae1c3dc8393d tempest-ProjectMemberTests-1830166883 None] Lock "cinder-e3971ca8-67bd-4290-8b51-246ce134c0b8-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:28 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-41b105ca-188c-4e5d-8785-0c417c796c19 tempest-ProjectReaderTests-1111155487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-176a5c2b-651d-4f16-ad6a-ac6db8d3507c 1073741824" returned: 0 in 0.451s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d0e6f3-4abe-4135-9318-fb3f0a4a0424 tempest-ProjectMemberTests-1830166883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-52d0e6f3-4abe-4135-9318-fb3f0a4a0424 tempest-ProjectMemberTests-1830166883 None] Flow 'volume_create_manager' (6bbf52de-867a-415d-a322-5edf8f02e6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-52d0e6f3-4abe-4135-9318-fb3f0a4a0424 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36ae04fb-150b-460b-bfb0-2091dbaf6987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-41b105ca-188c-4e5d-8785-0c417c796c19 tempest-ProjectReaderTests-1111155487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-176a5c2b-651d-4f16-ad6a-ac6db8d3507c {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-52d0e6f3-4abe-4135-9318-fb3f0a4a0424 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36ae04fb-150b-460b-bfb0-2091dbaf6987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1896228779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67125db8-12b2-4540-8b82-2cc2eb62f771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e9ee545cbb4eb99d3a310cf4efc844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:33:29Z,use_quota=True,user_id='badece1d173b4e51add55b4a7c961a4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:28 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-176a5c2b-651d-4f16-ad6a-ac6db8d3507c Sep 03 11:33:28 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-52d0e6f3-4abe-4135-9318-fb3f0a4a0424 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a70f6bab-7973-4c37-b255-65795bdce384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-52d0e6f3-4abe-4135-9318-fb3f0a4a0424 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a70f6bab-7973-4c37-b255-65795bdce384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-52d0e6f3-4abe-4135-9318-fb3f0a4a0424 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d586a640-d278-429f-898a-db719372bc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-52d0e6f3-4abe-4135-9318-fb3f0a4a0424 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d586a640-d278-429f-898a-db719372bc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67125db8-12b2-4540-8b82-2cc2eb62f771', 'volume_name': 'volume-67125db8-12b2-4540-8b82-2cc2eb62f771', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-52d0e6f3-4abe-4135-9318-fb3f0a4a0424 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe25030b-108a-4b7a-8ed6-35615a8be80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-52d0e6f3-4abe-4135-9318-fb3f0a4a0424 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe25030b-108a-4b7a-8ed6-35615a8be80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-52d0e6f3-4abe-4135-9318-fb3f0a4a0424 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e59d20e-6f20-4b54-81f6-5bf410b193fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:28 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-52d0e6f3-4abe-4135-9318-fb3f0a4a0424 tempest-ProjectMemberTests-1830166883 None] Volume 67125db8-12b2-4540-8b82-2cc2eb62f771: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67125db8-12b2-4540-8b82-2cc2eb62f771', 'volume_size': 1} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-52d0e6f3-4abe-4135-9318-fb3f0a4a0424 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:33:28 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-41b105ca-188c-4e5d-8785-0c417c796c19 tempest-ProjectReaderTests-1111155487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-176a5c2b-651d-4f16-ad6a-ac6db8d3507c" returned: 0 in 0.249s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-41b105ca-188c-4e5d-8785-0c417c796c19 tempest-ProjectReaderTests-1111155487 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-41b105ca-188c-4e5d-8785-0c417c796c19 tempest-ProjectReaderTests-1111155487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-52d0e6f3-4abe-4135-9318-fb3f0a4a0424 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.193s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-52d0e6f3-4abe-4135-9318-fb3f0a4a0424 tempest-ProjectMemberTests-1830166883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1896228779',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67125db8-12b2-4540-8b82-2cc2eb62f771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46e9ee545cbb4eb99d3a310cf4efc844',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:33:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:33:29Z,use_quota=True,user_id='badece1d173b4e51add55b4a7c961a4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-52d0e6f3-4abe-4135-9318-fb3f0a4a0424 tempest-ProjectMemberTests-1830166883 None] Creating volume 67125db8-12b2-4540-8b82-2cc2eb62f771 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-52d0e6f3-4abe-4135-9318-fb3f0a4a0424 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-52d0e6f3-4abe-4135-9318-fb3f0a4a0424 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-52d0e6f3-4abe-4135-9318-fb3f0a4a0424 tempest-ProjectMemberTests-1830166883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-52d0e6f3-4abe-4135-9318-fb3f0a4a0424 tempest-ProjectMemberTests-1830166883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-52d0e6f3-4abe-4135-9318-fb3f0a4a0424 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-52d0e6f3-4abe-4135-9318-fb3f0a4a0424 tempest-ProjectMemberTests-1830166883 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:33:28 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-52d0e6f3-4abe-4135-9318-fb3f0a4a0424 tempest-ProjectMemberTests-1830166883 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:33:28 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-52d0e6f3-4abe-4135-9318-fb3f0a4a0424 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-41b105ca-188c-4e5d-8785-0c417c796c19 tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b7e57bc-2421-4c18-a1e4-4854bcb72f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-176a5c2b-651d-4f16-ad6a-ac6db8d3507c', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:29 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771 1073741824 Sep 03 11:33:29 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-41b105ca-188c-4e5d-8785-0c417c796c19 tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c8d6602-ac6d-446c-ba8e-4b83f10685d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:29 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-41b105ca-188c-4e5d-8785-0c417c796c19 tempest-ProjectReaderTests-1111155487 None] Volume volume-176a5c2b-651d-4f16-ad6a-ac6db8d3507c (176a5c2b-651d-4f16-ad6a-ac6db8d3507c): created successfully Sep 03 11:33:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-41b105ca-188c-4e5d-8785-0c417c796c19 tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c8d6602-ac6d-446c-ba8e-4b83f10685d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-41b105ca-188c-4e5d-8785-0c417c796c19 tempest-ProjectReaderTests-1111155487 None] Flow 'volume_create_manager' (95d53ea6-7f5a-45e1-929d-c0fff98dfc00) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:33:29 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-41b105ca-188c-4e5d-8785-0c417c796c19 tempest-ProjectReaderTests-1111155487 None] Created volume successfully. Sep 03 11:33:29 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-52d0e6f3-4abe-4135-9318-fb3f0a4a0424 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771 1073741824" returned: 0 in 0.395s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-52d0e6f3-4abe-4135-9318-fb3f0a4a0424 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:29 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771 Sep 03 11:33:29 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:29 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-52d0e6f3-4abe-4135-9318-fb3f0a4a0424 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771" returned: 0 in 0.245s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:29 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-52d0e6f3-4abe-4135-9318-fb3f0a4a0424 tempest-ProjectMemberTests-1830166883 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:33:29 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-52d0e6f3-4abe-4135-9318-fb3f0a4a0424 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:33:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-52d0e6f3-4abe-4135-9318-fb3f0a4a0424 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e59d20e-6f20-4b54-81f6-5bf410b193fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67125db8-12b2-4540-8b82-2cc2eb62f771', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-52d0e6f3-4abe-4135-9318-fb3f0a4a0424 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8d53c4d-9995-410b-8602-b41fff3495cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:29 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-52d0e6f3-4abe-4135-9318-fb3f0a4a0424 tempest-ProjectMemberTests-1830166883 None] Volume volume-67125db8-12b2-4540-8b82-2cc2eb62f771 (67125db8-12b2-4540-8b82-2cc2eb62f771): created successfully Sep 03 11:33:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-52d0e6f3-4abe-4135-9318-fb3f0a4a0424 tempest-ProjectMemberTests-1830166883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8d53c4d-9995-410b-8602-b41fff3495cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:29 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-52d0e6f3-4abe-4135-9318-fb3f0a4a0424 tempest-ProjectMemberTests-1830166883 None] Flow 'volume_create_manager' (6bbf52de-867a-415d-a322-5edf8f02e6d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:33:29 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-52d0e6f3-4abe-4135-9318-fb3f0a4a0424 tempest-ProjectMemberTests-1830166883 None] Created volume successfully. Sep 03 11:33:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b5381710-865a-4a51-a52a-b683797ea119 tempest-ProjectReaderTests-1111155487 None] Acquiring lock "cinder-176a5c2b-651d-4f16-ad6a-ac6db8d3507c-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:33:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b5381710-865a-4a51-a52a-b683797ea119 tempest-ProjectReaderTests-1111155487 None] Lock "cinder-176a5c2b-651d-4f16-ad6a-ac6db8d3507c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:33:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b5381710-865a-4a51-a52a-b683797ea119 tempest-ProjectReaderTests-1111155487 None] Acquiring lock "cinder-quobyte-176a5c2b-651d-4f16-ad6a-ac6db8d3507c" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:33:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b5381710-865a-4a51-a52a-b683797ea119 tempest-ProjectReaderTests-1111155487 None] Lock "cinder-quobyte-176a5c2b-651d-4f16-ad6a-ac6db8d3507c" acquired by "delete_volume" :: waited 0.013s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:33:30 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cac167-9527-43bf-bdae-5c550b905cd0]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:33:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b5381710-865a-4a51-a52a-b683797ea119 tempest-ProjectReaderTests-1111155487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-176a5c2b-651d-4f16-ad6a-ac6db8d3507c {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:30 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-176a5c2b-651d-4f16-ad6a-ac6db8d3507c Sep 03 11:33:30 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:30 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b5381710-865a-4a51-a52a-b683797ea119 tempest-ProjectReaderTests-1111155487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-176a5c2b-651d-4f16-ad6a-ac6db8d3507c" returned: 0 in 0.356s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b5381710-865a-4a51-a52a-b683797ea119 tempest-ProjectReaderTests-1111155487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-176a5c2b-651d-4f16-ad6a-ac6db8d3507c {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:30 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-176a5c2b-651d-4f16-ad6a-ac6db8d3507c Sep 03 11:33:30 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:30 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b5381710-865a-4a51-a52a-b683797ea119 tempest-ProjectReaderTests-1111155487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-176a5c2b-651d-4f16-ad6a-ac6db8d3507c" returned: 0 in 0.261s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9d665dbe-b90a-4dfe-8d8c-5bdd46819938 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:33:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9d665dbe-b90a-4dfe-8d8c-5bdd46819938 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:33:30 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b5381710-865a-4a51-a52a-b683797ea119 tempest-ProjectReaderTests-1111155487 None] Lock "cinder-quobyte-176a5c2b-651d-4f16-ad6a-ac6db8d3507c" released by "delete_volume" :: held 0.660s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:30 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-9d665dbe-b90a-4dfe-8d8c-5bdd46819938 tempest-ProjectMemberTests-1830166883 None] Creating offline snapshot c04b7e36-aa48-40a7-8032-8012fc595039 of volume 67125db8-12b2-4540-8b82-2cc2eb62f771 {{(pid=87038) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:33:30 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[5767e778-11a6-4c58-a1c5-be294c140eaa]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:33:30 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9d665dbe-b90a-4dfe-8d8c-5bdd46819938 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:30 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-b5381710-865a-4a51-a52a-b683797ea119 tempest-ProjectReaderTests-1111155487 None] Created reservations ['794a53d0-6808-43e5-982f-ac870d388ba7', 'de89eb73-dd43-4560-b7a8-a62ba39c4dd2', '4d707763-9e46-4f7e-8f2f-573bc91bc904', '6a7d414b-6401-4be1-8897-7944c3af2afe'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:33:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b5381710-865a-4a51-a52a-b683797ea119 tempest-ProjectReaderTests-1111155487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:33:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b5381710-865a-4a51-a52a-b683797ea119 tempest-ProjectReaderTests-1111155487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:33:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-b5381710-865a-4a51-a52a-b683797ea119 tempest-ProjectReaderTests-1111155487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:33:31 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-b5381710-865a-4a51-a52a-b683797ea119 tempest-ProjectReaderTests-1111155487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:33:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-b5381710-865a-4a51-a52a-b683797ea119 tempest-ProjectReaderTests-1111155487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:33:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b5381710-865a-4a51-a52a-b683797ea119 tempest-ProjectReaderTests-1111155487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:31 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771 Sep 03 11:33:31 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:31 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:33:31 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:31 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-b5381710-865a-4a51-a52a-b683797ea119 tempest-ProjectReaderTests-1111155487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.263s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:31 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-b5381710-865a-4a51-a52a-b683797ea119 tempest-ProjectReaderTests-1111155487 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:33:31 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-b5381710-865a-4a51-a52a-b683797ea119 tempest-ProjectReaderTests-1111155487 None] Deleted volume successfully. Sep 03 11:33:31 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9d665dbe-b90a-4dfe-8d8c-5bdd46819938 tempest-ProjectMemberTests-1830166883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771" returned: 0 in 0.399s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9d665dbe-b90a-4dfe-8d8c-5bdd46819938 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771.c04b7e36-aa48-40a7-8032-8012fc595039 1G {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:31 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-b5381710-865a-4a51-a52a-b683797ea119 tempest-ProjectReaderTests-1111155487 None] Lock "cinder-176a5c2b-651d-4f16-ad6a-ac6db8d3507c-delete_volume" released by "delete_volume" :: held 1.149s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:31 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771.c04b7e36-aa48-40a7-8032-8012fc595039 1G Sep 03 11:33:31 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:31 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9d665dbe-b90a-4dfe-8d8c-5bdd46819938 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771.c04b7e36-aa48-40a7-8032-8012fc595039 1G" returned: 0 in 0.444s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9d665dbe-b90a-4dfe-8d8c-5bdd46819938 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67125db8-12b2-4540-8b82-2cc2eb62f771 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771.c04b7e36-aa48-40a7-8032-8012fc595039 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:31 devstack sudo[107317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67125db8-12b2-4540-8b82-2cc2eb62f771 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771.c04b7e36-aa48-40a7-8032-8012fc595039 Sep 03 11:33:31 devstack sudo[107317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:31 devstack cinder-volume[87038]: DEBUG cinder.volume.flows.manager.create_volume [None req-64228339-9b61-40d6-ab65-44204aa4004d tempest-ProjectReaderTests-1111155487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87038) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:33:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-64228339-9b61-40d6-ab65-44204aa4004d tempest-ProjectReaderTests-1111155487 None] Flow 'volume_create_manager' (0c538218-7578-45e9-8ebe-16b28a53f7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:33:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-64228339-9b61-40d6-ab65-44204aa4004d tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c61417f0-5cce-4c12-9a32-f956c75a67f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-64228339-9b61-40d6-ab65-44204aa4004d tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c61417f0-5cce-4c12-9a32-f956c75a67f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-182277303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d22d392-06f0-46df-a210-4d3af6425ce5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2e65bfad7f34ca2aa1420d76086fdfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:33:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:33:32Z,use_quota=True,user_id='6582462860e94247a16b78e95869a430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-64228339-9b61-40d6-ab65-44204aa4004d tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (084a4b1c-4c95-42d2-9bdf-0164cd7756b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-64228339-9b61-40d6-ab65-44204aa4004d tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (084a4b1c-4c95-42d2-9bdf-0164cd7756b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-64228339-9b61-40d6-ab65-44204aa4004d tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd1cff7-83ca-423a-9cfb-bbe28a44b095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-64228339-9b61-40d6-ab65-44204aa4004d tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecd1cff7-83ca-423a-9cfb-bbe28a44b095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d22d392-06f0-46df-a210-4d3af6425ce5', 'volume_name': 'volume-6d22d392-06f0-46df-a210-4d3af6425ce5', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-64228339-9b61-40d6-ab65-44204aa4004d tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (726f759a-72d3-4b04-819a-f9dcf2f2f18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-64228339-9b61-40d6-ab65-44204aa4004d tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (726f759a-72d3-4b04-819a-f9dcf2f2f18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:31 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-64228339-9b61-40d6-ab65-44204aa4004d tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf79c542-c434-4625-924a-7bd99eeb925d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:31 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-64228339-9b61-40d6-ab65-44204aa4004d tempest-ProjectReaderTests-1111155487 None] Volume 6d22d392-06f0-46df-a210-4d3af6425ce5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d22d392-06f0-46df-a210-4d3af6425ce5', 'volume_size': 1} Sep 03 11:33:31 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-64228339-9b61-40d6-ab65-44204aa4004d tempest-ProjectReaderTests-1111155487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:33:32 devstack sudo[107317]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9d665dbe-b90a-4dfe-8d8c-5bdd46819938 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-67125db8-12b2-4540-8b82-2cc2eb62f771 -F qcow2 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771.c04b7e36-aa48-40a7-8032-8012fc595039" returned: 0 in 0.292s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:32 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-9d665dbe-b90a-4dfe-8d8c-5bdd46819938 tempest-ProjectMemberTests-1830166883 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771.c04b7e36-aa48-40a7-8032-8012fc595039 is being set with open permissions: ugo+rw Sep 03 11:33:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9d665dbe-b90a-4dfe-8d8c-5bdd46819938 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771.c04b7e36-aa48-40a7-8032-8012fc595039 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:32 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771.c04b7e36-aa48-40a7-8032-8012fc595039 Sep 03 11:33:32 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:32 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9d665dbe-b90a-4dfe-8d8c-5bdd46819938 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771.c04b7e36-aa48-40a7-8032-8012fc595039" returned: 0 in 0.242s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9d665dbe-b90a-4dfe-8d8c-5bdd46819938 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:32 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771.info Sep 03 11:33:32 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:32 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9d665dbe-b90a-4dfe-8d8c-5bdd46819938 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771.info" returned: 0 in 0.284s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:32 devstack cinder-volume[87038]: WARNING cinder.volume.drivers.remotefs [None req-9d665dbe-b90a-4dfe-8d8c-5bdd46819938 tempest-ProjectMemberTests-1830166883 None] /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771.info is being set with open permissions: ugo+rw Sep 03 11:33:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9d665dbe-b90a-4dfe-8d8c-5bdd46819938 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771.info {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:32 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771.info Sep 03 11:33:32 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:32 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-9d665dbe-b90a-4dfe-8d8c-5bdd46819938 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771.info" returned: 0 in 0.252s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-9d665dbe-b90a-4dfe-8d8c-5bdd46819938 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:33:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-64228339-9b61-40d6-ab65-44204aa4004d tempest-ProjectReaderTests-1111155487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.993s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:33:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-64228339-9b61-40d6-ab65-44204aa4004d tempest-ProjectReaderTests-1111155487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:33:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-182277303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d22d392-06f0-46df-a210-4d3af6425ce5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2e65bfad7f34ca2aa1420d76086fdfb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:33:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:33:32Z,use_quota=True,user_id='6582462860e94247a16b78e95869a430',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(85831e20-8bcf-4ca1-8625-dfc7a3df3b2d),volume_type_id=85831e20-8bcf-4ca1-8625-dfc7a3df3b2d)}" {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:33:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-64228339-9b61-40d6-ab65-44204aa4004d tempest-ProjectReaderTests-1111155487 None] Creating volume 6d22d392-06f0-46df-a210-4d3af6425ce5 {{(pid=87038) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:33:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-64228339-9b61-40d6-ab65-44204aa4004d tempest-ProjectReaderTests-1111155487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:33:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-64228339-9b61-40d6-ab65-44204aa4004d tempest-ProjectReaderTests-1111155487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:33:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-64228339-9b61-40d6-ab65-44204aa4004d tempest-ProjectReaderTests-1111155487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:33:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-64228339-9b61-40d6-ab65-44204aa4004d tempest-ProjectReaderTests-1111155487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:33:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-64228339-9b61-40d6-ab65-44204aa4004d tempest-ProjectReaderTests-1111155487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:33:32 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-64228339-9b61-40d6-ab65-44204aa4004d tempest-ProjectReaderTests-1111155487 None] Selected osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 as target Quobyte volume. {{(pid=87038) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:33:32 devstack cinder-volume[87038]: INFO cinder.volume.drivers.remotefs [None req-64228339-9b61-40d6-ab65-44204aa4004d tempest-ProjectReaderTests-1111155487 None] casted to osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912 Sep 03 11:33:32 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-64228339-9b61-40d6-ab65-44204aa4004d tempest-ProjectReaderTests-1111155487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d22d392-06f0-46df-a210-4d3af6425ce5 1073741824 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:32 devstack sudo[107331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d22d392-06f0-46df-a210-4d3af6425ce5 1073741824 Sep 03 11:33:32 devstack sudo[107331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:32 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-9d665dbe-b90a-4dfe-8d8c-5bdd46819938 tempest-ProjectMemberTests-1830166883 None] Create snapshot completed successfully Sep 03 11:33:33 devstack sudo[107331]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-64228339-9b61-40d6-ab65-44204aa4004d tempest-ProjectReaderTests-1111155487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d22d392-06f0-46df-a210-4d3af6425ce5 1073741824" returned: 0 in 0.403s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-64228339-9b61-40d6-ab65-44204aa4004d tempest-ProjectReaderTests-1111155487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d22d392-06f0-46df-a210-4d3af6425ce5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:33 devstack sudo[107336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d22d392-06f0-46df-a210-4d3af6425ce5 Sep 03 11:33:33 devstack sudo[107336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:33 devstack sudo[107336]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-64228339-9b61-40d6-ab65-44204aa4004d tempest-ProjectReaderTests-1111155487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d22d392-06f0-46df-a210-4d3af6425ce5" returned: 0 in 0.239s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:33 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-64228339-9b61-40d6-ab65-44204aa4004d tempest-ProjectReaderTests-1111155487 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'} {{(pid=87038) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:33:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-64228339-9b61-40d6-ab65-44204aa4004d tempest-ProjectReaderTests-1111155487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.681s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:33:33 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-64228339-9b61-40d6-ab65-44204aa4004d tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf79c542-c434-4625-924a-7bd99eeb925d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d22d392-06f0-46df-a210-4d3af6425ce5', 'volume_size': 1}' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:33 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-64228339-9b61-40d6-ab65-44204aa4004d tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a770a99-04d3-42aa-8a56-edbc26771624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:33:33 devstack cinder-volume[87038]: INFO cinder.volume.flows.manager.create_volume [None req-64228339-9b61-40d6-ab65-44204aa4004d tempest-ProjectReaderTests-1111155487 None] Volume volume-6d22d392-06f0-46df-a210-4d3af6425ce5 (6d22d392-06f0-46df-a210-4d3af6425ce5): created successfully Sep 03 11:33:33 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-64228339-9b61-40d6-ab65-44204aa4004d tempest-ProjectReaderTests-1111155487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a770a99-04d3-42aa-8a56-edbc26771624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87038) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:33:33 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-64228339-9b61-40d6-ab65-44204aa4004d tempest-ProjectReaderTests-1111155487 None] Flow 'volume_create_manager' (0c538218-7578-45e9-8ebe-16b28a53f7b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87038) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:33:33 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-64228339-9b61-40d6-ab65-44204aa4004d tempest-ProjectReaderTests-1111155487 None] Created volume successfully. Sep 03 11:33:33 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a0eaef47-c306-494c-8458-2eb561c0729d tempest-ProjectReaderTests-1111155487 None] Acquiring lock "cinder-6d22d392-06f0-46df-a210-4d3af6425ce5-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:33:33 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a0eaef47-c306-494c-8458-2eb561c0729d tempest-ProjectReaderTests-1111155487 None] Lock "cinder-6d22d392-06f0-46df-a210-4d3af6425ce5-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:33:33 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a0eaef47-c306-494c-8458-2eb561c0729d tempest-ProjectReaderTests-1111155487 None] Acquiring lock "cinder-quobyte-6d22d392-06f0-46df-a210-4d3af6425ce5" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:33:33 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a0eaef47-c306-494c-8458-2eb561c0729d tempest-ProjectReaderTests-1111155487 None] Lock "cinder-quobyte-6d22d392-06f0-46df-a210-4d3af6425ce5" acquired by "delete_volume" :: waited 0.019s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:33:33 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[14459728-7982-4a11-bf0d-445c4a2a8baf]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:33:33 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a0eaef47-c306-494c-8458-2eb561c0729d tempest-ProjectReaderTests-1111155487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d22d392-06f0-46df-a210-4d3af6425ce5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:34 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d22d392-06f0-46df-a210-4d3af6425ce5 Sep 03 11:33:34 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:34 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-440795b9-20f2-486b-b43a-227a4e31fcaf tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-c04b7e36-aa48-40a7-8032-8012fc595039-delete_snapshot" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:33:34 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-440795b9-20f2-486b-b43a-227a4e31fcaf tempest-ProjectMemberTests-1830166883 None] Lock "cinder-c04b7e36-aa48-40a7-8032-8012fc595039-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:33:34 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-440795b9-20f2-486b-b43a-227a4e31fcaf tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-quobyte-67125db8-12b2-4540-8b82-2cc2eb62f771" by "delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:33:34 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-440795b9-20f2-486b-b43a-227a4e31fcaf tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-67125db8-12b2-4540-8b82-2cc2eb62f771" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:33:34 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-440795b9-20f2-486b-b43a-227a4e31fcaf tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-quobyte-c04b7e36-aa48-40a7-8032-8012fc595039" by "_delete_snapshot" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:33:34 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-440795b9-20f2-486b-b43a-227a4e31fcaf tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-c04b7e36-aa48-40a7-8032-8012fc595039" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:33:34 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-440795b9-20f2-486b-b43a-227a4e31fcaf tempest-ProjectMemberTests-1830166883 None] Deleting offline snapshot c04b7e36-aa48-40a7-8032-8012fc595039 of volume 67125db8-12b2-4540-8b82-2cc2eb62f771 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:33:34 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-440795b9-20f2-486b-b43a-227a4e31fcaf tempest-ProjectMemberTests-1830166883 None] snapshot_file for this snap is: volume-67125db8-12b2-4540-8b82-2cc2eb62f771.c04b7e36-aa48-40a7-8032-8012fc595039 {{(pid=87038) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:33:34 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[e992da18-bb70-4561-bf48-7d8cdc085bfd]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:33:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-440795b9-20f2-486b-b43a-227a4e31fcaf tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771.c04b7e36-aa48-40a7-8032-8012fc595039 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:34 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771.c04b7e36-aa48-40a7-8032-8012fc595039 Sep 03 11:33:34 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:34 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a0eaef47-c306-494c-8458-2eb561c0729d tempest-ProjectReaderTests-1111155487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d22d392-06f0-46df-a210-4d3af6425ce5" returned: 0 in 0.394s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a0eaef47-c306-494c-8458-2eb561c0729d tempest-ProjectReaderTests-1111155487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d22d392-06f0-46df-a210-4d3af6425ce5 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:34 devstack sudo[107349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d22d392-06f0-46df-a210-4d3af6425ce5 Sep 03 11:33:34 devstack sudo[107349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:34 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-440795b9-20f2-486b-b43a-227a4e31fcaf tempest-ProjectMemberTests-1830166883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771.c04b7e36-aa48-40a7-8032-8012fc595039" returned: 0 in 0.367s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:34 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.remotefs [None req-440795b9-20f2-486b-b43a-227a4e31fcaf tempest-ProjectMemberTests-1830166883 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-67125db8-12b2-4540-8b82-2cc2eb62f771(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87038) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:33:34 devstack sudo[107349]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a0eaef47-c306-494c-8458-2eb561c0729d tempest-ProjectReaderTests-1111155487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-6d22d392-06f0-46df-a210-4d3af6425ce5" returned: 0 in 0.265s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:34 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ada98c1-29a0-4dce-bf6c-f6756d6855f1]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:33:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-440795b9-20f2-486b-b43a-227a4e31fcaf tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:34 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a0eaef47-c306-494c-8458-2eb561c0729d tempest-ProjectReaderTests-1111155487 None] Lock "cinder-quobyte-6d22d392-06f0-46df-a210-4d3af6425ce5" released by "delete_volume" :: held 0.713s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:34 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-a0eaef47-c306-494c-8458-2eb561c0729d tempest-ProjectReaderTests-1111155487 None] Created reservations ['a8060933-cde4-4304-adb9-70a8547c218f', '252817b9-98c3-4725-b611-3bf1b7b1796e', '2b737bf0-a5c8-45fb-a1f4-7cab358afd7a', 'cf265002-5456-4897-82d8-b2424fc8c75a'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:33:34 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771 Sep 03 11:33:34 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a0eaef47-c306-494c-8458-2eb561c0729d tempest-ProjectReaderTests-1111155487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:33:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a0eaef47-c306-494c-8458-2eb561c0729d tempest-ProjectReaderTests-1111155487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:33:34 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a0eaef47-c306-494c-8458-2eb561c0729d tempest-ProjectReaderTests-1111155487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:33:34 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-a0eaef47-c306-494c-8458-2eb561c0729d tempest-ProjectReaderTests-1111155487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:33:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-a0eaef47-c306-494c-8458-2eb561c0729d tempest-ProjectReaderTests-1111155487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:33:34 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a0eaef47-c306-494c-8458-2eb561c0729d tempest-ProjectReaderTests-1111155487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:34 devstack sudo[107357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:33:34 devstack sudo[107357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:35 devstack sudo[107357]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-a0eaef47-c306-494c-8458-2eb561c0729d tempest-ProjectReaderTests-1111155487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.244s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:35 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-a0eaef47-c306-494c-8458-2eb561c0729d tempest-ProjectReaderTests-1111155487 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:33:35 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-a0eaef47-c306-494c-8458-2eb561c0729d tempest-ProjectReaderTests-1111155487 None] Deleted volume successfully. Sep 03 11:33:35 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-440795b9-20f2-486b-b43a-227a4e31fcaf tempest-ProjectMemberTests-1830166883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771" returned: 0 in 0.404s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-440795b9-20f2-486b-b43a-227a4e31fcaf tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771.c04b7e36-aa48-40a7-8032-8012fc595039 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-a0eaef47-c306-494c-8458-2eb561c0729d tempest-ProjectReaderTests-1111155487 None] Lock "cinder-6d22d392-06f0-46df-a210-4d3af6425ce5-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:35 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771.c04b7e36-aa48-40a7-8032-8012fc595039 Sep 03 11:33:35 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:35 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-440795b9-20f2-486b-b43a-227a4e31fcaf tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771.c04b7e36-aa48-40a7-8032-8012fc595039" returned: 0 in 0.351s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-440795b9-20f2-486b-b43a-227a4e31fcaf tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771.c04b7e36-aa48-40a7-8032-8012fc595039 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:35 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771.c04b7e36-aa48-40a7-8032-8012fc595039 Sep 03 11:33:35 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:35 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:35 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-440795b9-20f2-486b-b43a-227a4e31fcaf tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771.c04b7e36-aa48-40a7-8032-8012fc595039" returned: 0 in 0.273s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-440795b9-20f2-486b-b43a-227a4e31fcaf tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-c04b7e36-aa48-40a7-8032-8012fc595039" released by "_delete_snapshot" :: held 1.501s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-440795b9-20f2-486b-b43a-227a4e31fcaf tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-67125db8-12b2-4540-8b82-2cc2eb62f771" released by "delete_snapshot" :: held 1.525s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:35 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-440795b9-20f2-486b-b43a-227a4e31fcaf tempest-ProjectMemberTests-1830166883 None] Created reservations ['618f39ba-7aba-453f-9b27-b0b2379137f1', '4b067b77-f0f7-4161-ae3b-2006f82ae0db', 'f1f95f7d-de3d-4dc6-b8a4-1a7fa3c06e87', '55538cc6-4009-4f39-b20b-5d03fed5044f'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:33:35 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-440795b9-20f2-486b-b43a-227a4e31fcaf tempest-ProjectMemberTests-1830166883 None] Delete snapshot completed successfully. Sep 03 11:33:35 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-440795b9-20f2-486b-b43a-227a4e31fcaf tempest-ProjectMemberTests-1830166883 None] Lock "cinder-c04b7e36-aa48-40a7-8032-8012fc595039-delete_snapshot" released by "delete_snapshot" :: held 1.662s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-23691dcd-d35d-4a4e-a4af-01fc61563128 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-67125db8-12b2-4540-8b82-2cc2eb62f771-delete_volume" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:33:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-23691dcd-d35d-4a4e-a4af-01fc61563128 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-67125db8-12b2-4540-8b82-2cc2eb62f771-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:33:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-23691dcd-d35d-4a4e-a4af-01fc61563128 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "cinder-quobyte-67125db8-12b2-4540-8b82-2cc2eb62f771" by "delete_volume" {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:33:36 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-23691dcd-d35d-4a4e-a4af-01fc61563128 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-67125db8-12b2-4540-8b82-2cc2eb62f771" acquired by "delete_volume" :: waited 0.025s {{(pid=87038) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:33:36 devstack cinder-volume[87038]: DEBUG oslo.privsep.daemon [-] privsep: reply[fca65fd4-be7b-4d76-8828-a715c48a902f]: (4, 'qcow2') {{(pid=88738) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:33:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23691dcd-d35d-4a4e-a4af-01fc61563128 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:36 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771 Sep 03 11:33:36 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:36 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23691dcd-d35d-4a4e-a4af-01fc61563128 tempest-ProjectMemberTests-1830166883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771" returned: 0 in 0.366s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:36 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23691dcd-d35d-4a4e-a4af-01fc61563128 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771 {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:36 devstack sudo[107383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771 Sep 03 11:33:36 devstack sudo[107383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:37 devstack sudo[107383]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23691dcd-d35d-4a4e-a4af-01fc61563128 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a/volume-67125db8-12b2-4540-8b82-2cc2eb62f771" returned: 0 in 0.237s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:37 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-23691dcd-d35d-4a4e-a4af-01fc61563128 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-quobyte-67125db8-12b2-4540-8b82-2cc2eb62f771" released by "delete_volume" :: held 0.670s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:37 devstack cinder-volume[87038]: DEBUG cinder.quota [None req-23691dcd-d35d-4a4e-a4af-01fc61563128 tempest-ProjectMemberTests-1830166883 None] Created reservations ['9784c505-ad57-4efe-a082-bbea1116d2ae', '7ebe1a04-1abe-480f-8772-5f55736885b7', 'aa7f1539-2b83-4875-bf65-30cdb3e17447', 'd8e75961-f238-47b9-9ad0-93fd38d4c5b2'] {{(pid=87038) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:33:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-23691dcd-d35d-4a4e-a4af-01fc61563128 tempest-ProjectMemberTests-1830166883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:33:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-23691dcd-d35d-4a4e-a4af-01fc61563128 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:33:37 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-23691dcd-d35d-4a4e-a4af-01fc61563128 tempest-ProjectMemberTests-1830166883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:33:37 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-23691dcd-d35d-4a4e-a4af-01fc61563128 tempest-ProjectMemberTests-1830166883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:33:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-23691dcd-d35d-4a4e-a4af-01fc61563128 tempest-ProjectMemberTests-1830166883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:33:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23691dcd-d35d-4a4e-a4af-01fc61563128 tempest-ProjectMemberTests-1830166883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:33:37 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:33:37 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:33:37 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Sep 03 11:33:37 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-23691dcd-d35d-4a4e-a4af-01fc61563128 tempest-ProjectMemberTests-1830166883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.239s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:33:37 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-23691dcd-d35d-4a4e-a4af-01fc61563128 tempest-ProjectMemberTests-1830166883 None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:33:37 devstack cinder-volume[87038]: INFO cinder.volume.manager [None req-23691dcd-d35d-4a4e-a4af-01fc61563128 tempest-ProjectMemberTests-1830166883 None] Deleted volume successfully. Sep 03 11:33:37 devstack cinder-volume[87038]: DEBUG cinder.coordination [None req-23691dcd-d35d-4a4e-a4af-01fc61563128 tempest-ProjectMemberTests-1830166883 None] Lock "cinder-67125db8-12b2-4540-8b82-2cc2eb62f771-delete_volume" released by "delete_volume" :: held 1.135s {{(pid=87038) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:33:51 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=69,cinder:INSERT=21,cinder:UPDATE=90,cinder:DELETE=3 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:33:51 devstack cinder-volume[87038]: DEBUG dbcounter [-] [87038] Writing DB stats cinder:SELECT=61,cinder:INSERT=27,cinder:UPDATE=98,cinder:DELETE=12 {{(pid=87038) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:34:17 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:34:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:34:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:34:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912': None} {{(pid=87038) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:34:17 devstack cinder-volume[87038]: DEBUG cinder.volume.drivers.quobyte [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-2ca43860-6f38-42ac-bb3c-0f33b9ef8912'] {{(pid=87038) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:34:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.lockutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87038) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:34:17 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:34:18 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a Sep 03 11:34:18 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:34:18 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Sep 03 11:34:18 devstack cinder-volume[87038]: DEBUG oslo_concurrency.processutils [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/e9dc3e47f4eef9b938a3486e5b89ae7a" returned: 0 in 0.250s {{(pid=87038) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:34:18 devstack cinder-volume[87038]: DEBUG cinder.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Notifying Schedulers of capabilities ... {{(pid=87038) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:34:18 devstack cinder-volume[87038]: DEBUG oslo_service.periodic_task [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] Running periodic task VolumeManager._thread_info {{(pid=87038) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:34:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread count: 28 {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:34:18 devstack cinder-volume[87038]: DEBUG cinder.volume.manager [None req-d5f3dbd7-58bc-465b-99f1-5da2aa7720e2 None None] thread info: [<_MainThread(MainThread, started 139554943000704)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87038) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}